PyPI · npm97Exceptionalhealth index

gptme/gptmeYour agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!
Python · TypeScript★ 4,400↓ 49.9K/moAug 28, 2026
PyPI · npm97Exceptionalhealth index

xorbitsai/inferenceSwap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
Python · TypeScript★ 9,579↓ 8,895/moSep 20, 2026
NuGet88Excellenthealth index

SciSharp/LLamaSharpA C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
C# · JavaScript★ 3,791Sep 11, 2026
npm84Excellenthealth index

ngxson/wllamaWebAssembly binding for llama.cpp - Enabling on-browser LLM inference
TypeScript · C++★ 1,319↓ 55.3K/moOct 1, 2026
crates.io · Maven83Excellenthealth index

eugenehp/llama-cpp-rsA wrapper around the llama-cpp library for rust, including new Sampler API from llama-cpp.
Rust★ 53↓ 8,825/moOct 20, 2026
Go · npm81Excellenthealth index

lordmathis/llamactlUnified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
Go · TypeScript★ 152Sep 20, 2026
RubyGems80Excellenthealth index
Scala · Python · HTML★ 4,159Sep 17, 2026
PyPI80Excellenthealth index
C++★ 11.9KSep 24, 2026
TypeScript★ 1,755Sep 9, 2026
npm · crates.io · PyPI77Goodhealth index

Fast-Editor/LynkrStreamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions using Claude Code CLI.
JavaScript · Rust★ 550↓ 1,969/moSep 14, 2026
Go★ 2Sep 11, 2026
crates.io · npm · PyPI77Goodhealth index

intentee/paddlerOpen-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
Rust★ 1,670↓ 40/moSep 13, 2026
C++ · TypeScript · JavaScript★ 21↓ 2,897/moSep 13, 2026

hybridgroup/yzmaGo with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
Go★ 597Sep 9, 2026
C#★ 1,405Sep 8, 2026

dmmdea/offload-harnessDelegate summarize/classify/extract/triage to a FREE local Gemma-4 cascade via llama.cpp. Go CLI + MCP server; never calls a cloud model. Includes a turnkey setup skill for Claude Code.
Go★ 2Sep 15, 2026
crates.io60Moderatehealth index

floneum/kalosmInstant, controllable, local pre-trained AI models in Rust
Rust★ 2,230Sep 19, 2026
PyPI60Moderatehealth index
Python★ 1↓ 12.4K/moOct 13, 2026
PyPI59Moderatehealth index

jjang-ai/jangqJANG — GGUF for MLX. YOU MUST USE JANG_Q RUNTIME. Adaptive Mixed-Precision Quantization + Runtime for Apple Silicon
Python · Swift★ 225↓ 1,557/moSep 13, 2026

airiclenz/llama-launcherProfile-based launcher for local LLM servers - start, stop and switch models on llama.cpp, Ollama and LM Studio from one CLI/TUI. Zero resident overhead, optional MCP control plane, importable as a Go library.
Go★ 2Sep 19, 2026
Go · Python★ 4Sep 10, 2026
Go · npm48Weakhealth index

napmany/llmsnapFast LLM swapping with sleep/wake support, compatible with vllm, llama.cpp, etc. llama-swap fork.
Go · Svelte★ 56Sep 24, 2026

altSeneca/picoqmdLightweight QMD alternative: fully local hybrid search engine (BM25 + vector + rerank) and MCP server in a single ~15MB Go binary. No Node.js. Runs on Raspberry Pi.
Go★ 5Sep 13, 2026

janhq/janJan is an open source alternative to ChatGPT that runs 100% offline on your computer.
TypeScript · Rust★ 44.4KSep 6, 2026