All tags
Catalogue tag

#llamacpp

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

24 records
Tagged “llamacpp”Ranked by health index
PyPI · npm
97Exceptionalhealth index
gptme/gptme
Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!
Python · TypeScript★ 4,400↓ 49.9K/moAug 28, 2026
MITAug 28, 2026 · metrics 2.10.0
PyPI · npm
97Exceptionalhealth index
xorbitsai/inference
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
Python · TypeScript★ 9,579↓ 8,895/moSep 20, 2026
Apache-2.0Sep 20, 2026 · metrics 2.10.0
NuGet
88Excellenthealth index
SciSharp/LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
C# · JavaScript★ 3,791Sep 11, 2026
MITSep 11, 2026 · metrics 2.10.0
npm
84Excellenthealth index
ngxson/wllama
WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
TypeScript · C++★ 1,319↓ 55.3K/moOct 1, 2026
MITOct 1, 2026 · metrics 2.10.0
crates.io · Maven
83Excellenthealth index
eugenehp/llama-cpp-rs
A wrapper around the llama-cpp library for rust, including new Sampler API from llama-cpp.
Rust★ 53↓ 8,825/moOct 20, 2026
Apache-2.0Oct 20, 2026 · metrics 2.10.0
Go · npm
81Excellenthealth index
lordmathis/llamactl
Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
Go · TypeScript★ 152Sep 20, 2026
MITSep 20, 2026 · metrics 2.10.0
RubyGems
80Excellenthealth index
JohnSnowLabs/spark-nlp
State of the Art Natural Language Processing
Scala · Python · HTML★ 4,159Sep 17, 2026
Apache-2.0Sep 17, 2026 · metrics 2.10.0
PyPI
80Excellenthealth index
LostRuins/koboldcpp
Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
C++★ 11.9KSep 24, 2026
AGPL-3.0Sep 24, 2026 · metrics 2.10.0
npm
78Goodhealth index
sybil-solutions/local-studio
Control panel for VLLM, Sglang, llama.cpp, exllamav3
TypeScript★ 1,755Sep 9, 2026
Apache-2.0Sep 9, 2026 · metrics 2.10.0
npm · crates.io · PyPI
77Goodhealth index
Fast-Editor/Lynkr
Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions using Claude Code CLI.
JavaScript · Rust★ 550↓ 1,969/moSep 14, 2026
Apache-2.0Sep 14, 2026 · metrics 2.10.0
Go
77Goodhealth index
craigh33/adk-go-kronk
Kronk model provider and utilities for adk-go
Go★ 2Sep 11, 2026
Apache-2.0Sep 11, 2026 · metrics 2.10.0
crates.io · npm · PyPI
77Goodhealth index
intentee/paddler
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
Rust★ 1,670↓ 40/moSep 13, 2026
Apache-2.0Sep 13, 2026 · metrics 2.10.0
npm
77Goodhealth index
mybigday/llama.node
Node.js binding of llama.cpp
C++ · TypeScript · JavaScript★ 21↓ 2,897/moSep 13, 2026
No licenseSep 13, 2026 · metrics 2.10.0
Go
75Goodhealth index
hybridgroup/yzma
Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
Go★ 597Sep 9, 2026
Custom licenseSep 9, 2026 · metrics 2.10.0
NuGet
67Goodhealth index
awaescher/OllamaSharp
The easiest way to use Ollama in .NET
C#★ 1,405Sep 8, 2026
MITSep 8, 2026 · metrics 2.10.0
Go
67Goodhealth index
dmmdea/offload-harness
Delegate summarize/classify/extract/triage to a FREE local Gemma-4 cascade via llama.cpp. Go CLI + MCP server; never calls a cloud model. Includes a turnkey setup skill for Claude Code.
Go★ 2Sep 15, 2026
Apache-2.0Sep 15, 2026 · metrics 2.10.0
crates.io
60Moderatehealth index
floneum/kalosm
Instant, controllable, local pre-trained AI models in Rust
Rust★ 2,230Sep 19, 2026
Apache-2.0Sep 19, 2026 · metrics 2.10.0
PyPI
60Moderatehealth index
manunicholasjacob/llama-roofline
Is your llama.cpp decode memory-bandwidth-bound? Find out in one command.
Python★ 1↓ 12.4K/moOct 13, 2026
MITOct 13, 2026 · metrics 2.10.0
PyPI
59Moderatehealth index
jjang-ai/jangq
JANG — GGUF for MLX. YOU MUST USE JANG_Q RUNTIME. Adaptive Mixed-Precision Quantization + Runtime for Apple Silicon
Python · Swift★ 225↓ 1,557/moSep 13, 2026
No licenseSep 13, 2026 · metrics 2.10.0
Go
51Moderatehealth index
airiclenz/llama-launcher
Profile-based launcher for local LLM servers - start, stop and switch models on llama.cpp, Ollama and LM Studio from one CLI/TUI. Zero resident overhead, optional MCP control plane, importable as a Go library.
Go★ 2Sep 19, 2026
MITSep 19, 2026 · metrics 2.10.0
Go
50Moderatehealth index
maruel/ask
Run AI at CLI
Go · Python★ 4Sep 10, 2026
Apache-2.0Sep 10, 2026 · metrics 2.10.0
Go · npm
48Weakhealth index
napmany/llmsnap
Fast LLM swapping with sleep/wake support, compatible with vllm, llama.cpp, etc. llama-swap fork.
Go · Svelte★ 56Sep 24, 2026
MITSep 24, 2026 · metrics 2.10.0
Go
38Weakhealth index
altSeneca/picoqmd
Lightweight QMD alternative: fully local hybrid search engine (BM25 + vector + rerank) and MCP server in a single ~15MB Go binary. No Node.js. Runs on Raspberry Pi.
Go★ 5Sep 13, 2026
MITSep 13, 2026 · metrics 2.10.0
npm · crates.io · PyPI
19Criticalhealth index
janhq/jan
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.
TypeScript · Rust★ 44.4KSep 6, 2026
Custom licenseSep 6, 2026 · metrics 2.10.0