All tags
Catalogue tag

#llama-cpp

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

36 records
Tagged “llama-cpp”Ranked by health index
PyPI · npm
97Exceptionalhealth index
xorbitsai/inference
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
Python · TypeScript★ 9,579↓ 8,895/moSep 20, 2026
Apache-2.0Sep 20, 2026 · metrics 2.10.0
npm
95Exceptionalhealth index
juspay/neurolink
One TypeScript interface for 24+ LLM providers — swap providers without rewriting. MCP-native (connect any MCP server), voice (TTS/STT/realtime), RAG, memory, file processors. Production-origin: powers Tara, Yama, and Clairvoyance at Juspay.
TypeScript★ 133↓ 55.6K/moSep 10, 2026
MITSep 10, 2026 · metrics 2.10.0
PyPI · npm
94Exceptionalhealth index
modelscope/FunASR
Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
Python · C · HTML★ 20.4KSep 16, 2026
MITSep 16, 2026 · metrics 2.10.0
npm
93Exceptionalhealth index
Nano-Collective/nanocoder
An open coding agent for your terminal, built by a community collective rather than a company. Bring your own model, keep your code on your machine, and owe nothing to anyone.
TypeScript★ 2,376↓ 9,541/moAug 25, 2026
Custom licenseAug 25, 2026 · metrics 2.10.0
Go
89Excellenthealth index
defilantech/LLMKube
Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
Go★ 207Sep 5, 2026
Apache-2.0Sep 5, 2026 · metrics 2.10.0
NuGet
88Excellenthealth index
SciSharp/LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
C# · JavaScript★ 3,791Sep 11, 2026
MITSep 11, 2026 · metrics 2.10.0
npm · Maven
88Excellenthealth index
mybigday/llama.rn
React Native binding of llama.cpp
C++ · C★ 1,034↓ 97.5K/moSep 9, 2026
MITSep 9, 2026 · metrics 2.10.0
npm
87Excellenthealth index
withcatai/node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
TypeScript★ 2,162↓ 3.6M/moAug 27, 2026
MITAug 27, 2026 · metrics 2.10.0
PyPI
84Excellenthealth index
Sahil170595/Chimeraforge
PyPI capacity-planning CLI for LLM deployment. pip install chimeraforge.
Python★ 2↓ 3,833/moOct 20, 2026
MITOct 20, 2026 · metrics 2.10.0
PyPI
84Excellenthealth index
tobocop2/lilbee
The whole local AI stack in one executable: it runs and manages local AI models across every GPU, and it's a search engine you can talk to, with cited answers from your files, code, and the web. MCP server for coding agents, web crawler, TUI, CLI, REST API, Python library. No Ollama or LM Studio needed, works with both.
Python★ 54↓ 3,110/moSep 18, 2026
MITSep 18, 2026 · metrics 2.10.0
Go
81Excellenthealth index
gpustack/gguf-parser-go
Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
Go★ 295Sep 5, 2026
MITSep 5, 2026 · metrics 2.10.0
Go · npm
81Excellenthealth index
lordmathis/llamactl
Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
Go · TypeScript★ 152Sep 20, 2026
MITSep 20, 2026 · metrics 2.10.0
Go
77Goodhealth index
aimd54/palan
Distribute GGUF and safetensors weights through any OCI registry, with signatures verified before a byte moves. Daemonless, runs offline, one static binary.
Go★ 0Sep 10, 2026
Apache-2.0Sep 10, 2026 · metrics 2.10.0
Go
77Goodhealth index
airiclenz/apogee
Terminal coding agent for local LLMs (llama.cpp, Ollama, vLLM) and any OpenAI-compatible API. OS-sandboxed autonomy, MCP, sessions. Go.
Go★ 8Oct 20, 2026
MITOct 20, 2026 · metrics 2.10.0
npm
77Goodhealth index
jcode-works/jcode-ragmir
Confidential local RAG for your coding agents.
TypeScript · JavaScript★ 6↓ 4,128/moSep 13, 2026
AGPL-3.0Sep 13, 2026 · metrics 2.10.0
npm
77Goodhealth index
mybigday/llama.node
Node.js binding of llama.cpp
C++ · TypeScript · JavaScript★ 21↓ 2,897/moSep 13, 2026
No licenseSep 13, 2026 · metrics 2.10.0
PyPI · crates.io · npm
75Goodhealth index
kharkevich-engineering-lab/spark-pulse
Spark Pulse is a web control plane for spark-vllm-docker
Python · TypeScript★ 11↓ 3,444/moSep 21, 2026
Custom licenseSep 21, 2026 · metrics 2.10.0
PyPI
71Goodhealth index
rokbenko/quackd
One CLI for all your robots. Connect them, command them, and let them work together, each with an LLM for a brain (Claude, OpenAI, Gemini, Grok, or local via Ollama or vLLM), VLAs for arms and decision LLMs (Jev, Laya, Kev). Drives Microduck, Open Duck Mini, LeRobot, XLeRobot, AlohaMini, ToddlerBot, or any ROS 2 base from a laptop, offboard.
Python★ 268↓ 2,077/moOct 21, 2026
Apache-2.0Oct 21, 2026 · metrics 2.10.0
PyPI · crates.io
69Goodhealth index
FedericoTs/quantprobe
Run a 110B on a 2016 PC with 16 GB RAM. Know your tok/s before you download. Placement beats budget: predicts speed + memory fit for any GGUF on your exact hardware, self-calibrates, emits the exact llama.cpp command — or 'quantprobe auto' does it all. Falsification-tested laws; misses published at full size. pip install quantprobe
Python★ 90↓ 490/moOct 19, 2026
MITOct 19, 2026 · metrics 2.10.0
npm
69Goodhealth index
IBazylchuk/paparats-mcp
Local‑first MCP server for multi‑repository semantic code search with Qdrant and llama. Turns your entire workspace into private context for AI coding assistants like Claude Code, Codex, Cursor, Copilot, Antigravity and Windsurf.
TypeScript★ 10↓ 2,593/moSep 10, 2026
MITSep 10, 2026 · metrics 2.10.0
Go
63Moderatehealth index
BalanceBalls/nekot
A portable terminal AI interface
Go★ 195Sep 10, 2026
MITSep 10, 2026 · metrics 2.10.0
npm
63Moderatehealth index
yoloshii/ClawMem
On-device memory layer for AI agents. Claude Code, OpenClaw and Hermes. Hooks + MCP server + hybrid RAG search.
TypeScript★ 210↓ 737/moSep 13, 2026
MITSep 13, 2026 · metrics 2.10.0
Go · PyPI
62Moderatehealth index
scoutme/milk
milk — a CLI/TUI that routes prompts between agents: a primary agent and a configurable escalation agent, with session-aware state management and real-time streaming. Escalation happens automatically (via routing rules) or manually, preserving context across the handoff between agents.
Go★ 6Sep 17, 2026
MITSep 17, 2026 · metrics 2.10.0
Go
62Moderatehealth index
spencerbull/Yokai
Terminal-first GPU fleet manager for deploying, monitoring, and managing vLLM, llama.cpp, and ComfyUI workloads.
Go · TypeScript★ 4Oct 19, 2026
MITOct 19, 2026 · metrics 2.10.0
PyPI · npm
62Moderatehealth index
winterop-com/stabbur
stabbur — the Norwegian storehouse for your models: build a local LLM library, then run, chat and serve it with MCP tools. Source-available, proprietary.
Python · TypeScript★ 0↓ 2,559/moSep 18, 2026
Custom licenseSep 18, 2026 · metrics 2.10.0
npm
60Moderatehealth index
eeshansrivastava89/minimal-ai
Privacy-first CLI for running local LLMs — discover, configure, run, benchmark
JavaScript · TypeScript★ 1↓ 6,668/moSep 10, 2026
No licenseSep 10, 2026 · metrics 2.10.0
PyPI
60Moderatehealth index
manunicholasjacob/llama-roofline
Is your llama.cpp decode memory-bandwidth-bound? Find out in one command.
Python★ 1↓ 12.4K/moOct 13, 2026
MITOct 13, 2026 · metrics 2.10.0
npm
59Moderatehealth index
mohitsoni48/TurboLLM
Run any local LLM engine, auto-tuned to your GPU — polished web UI + OpenAI/Anthropic-compatible API. Point Claude Code at your own machine in one command. No Electron, no Python, offline-first.
TypeScript★ 261↓ 3,713/moSep 9, 2026
No licenseSep 9, 2026 · metrics 2.10.0
npm
57Moderatehealth index
egonSchiele/smoltalk
Wrapper for LLM APIs
TypeScript★ 0↓ 2,310/moSep 16, 2026
No licenseSep 16, 2026 · metrics 2.10.0
npm
57Moderatehealth index
therealtimex/node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
TypeScript★ 1↓ 2,778/moSep 10, 2026
MITSep 10, 2026 · metrics 2.10.0