npm95Exceptionalhealth index
tetherto/qvacOpen-source local AI SDK - run AI on-device with no cloud, no API keys. Supports GGUF, RAG, image, music, and video generation, speech-to-text, P2P inference, and more. Cross-platform: Linux, macOS, Windows, Android, iOS.
TypeScript · JavaScript · C++★ 597↓ 202.1K/moSep 10, 2026
Go94Exceptionalhealth index
ENTERPILOT/GoModelAI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming, cost tracking, intelligent routing, sticky sessions, failover, real-time logs and usage tracking. Prod ready.
Go · JavaScript★ 1,145Sep 11, 2026
PyPI · npm94Exceptionalhealth index
modelscope/FunASROpen-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
Python · C · HTML★ 20.4KSep 16, 2026
Go93Exceptionalhealth index
Mindburn-Labs/helm-ai-kernelFail-closed execution firewall for AI agents: quarantine MCP tools, proxy OpenAI-compatible requests, emit signed receipts, and verify EvidencePacks offline.
Go★ 55Sep 10, 2026
PyPI · npm91Excellenthealth index
Python★ 137↓ 11.5K/moOct 19, 2026
PyPI91Excellenthealth index
waybarrios/vllm-mlxHigh-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.
Python★ 1,626↓ 5,191/moOct 20, 2026
PyPI · npm90Excellenthealth index
HKUDS/nanobotUltra-lightweight, open-source, self-hosted personal AI agent framework in Python with WebUI, tools, memory, MCP, multi-agent workflows, automation, and chat apps
Python · TypeScript★ 48.3KSep 18, 2026
Go · npm90Excellenthealth index
ferro-labs/ai-gatewayUnified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gateway LiteLLM & Kong AI Gateway alternative.
Go · TypeScript★ 256Sep 9, 2026
npm90Excellenthealth index
tashfeenahmed/freellmapi7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.
TypeScript★ 27.4K↓ 6,354/moSep 20, 2026
Go · npm89Excellenthealth index
seakee/CPA-Manager-PlusA self-hosted CPA / CLIProxyAPI management panel and AI gateway observability dashboard for requests, usage, cost, quota, failures, and account health.
Go★ 3,374Sep 12, 2026
PyPI87Excellenthealth index
berkayturanci/ai-juryStdlib-only Python CLI that orchestrates universal AI agent providers (Claude Code, Codex, Antigravity, OpenRouter, DeepSeek, Groq, local models, Aider) into a multi-agent PR review jury — debate, verify, synthesize one verdict. Local-first, secure by default.
Python★ 8↓ 3,403/moOct 12, 2026
npm84Excellenthealth index
BlockRunAI/blockrun-llm-tsTypeScript SDK for BlockRun — every frontier model behind one OpenAI-compatible client. Pay with a BlockRun API key or per-call in USDC. Smart routing picks the cheapest capable model. Zero rate limits.
TypeScript★ 3↓ 13.1K/moSep 10, 2026
PyPI · npm81Excellenthealth index
vladkesler/initrunnerDefine AI agent roles in YAML and run them anywhere: CLI, API server, or autonomous daemon
Python★ 41↓ 1,603/moSep 10, 2026
npm81Excellenthealth index
TypeScript★ 131↓ 429.1K/moSep 8, 2026
PyPI · npm80Excellenthealth index
jin-bo/agentaoLocal-first, governed AI agent runtime for Python — embed it in your app, or run it as a CLI or ACP server. Permissions, MCP, memory and audit replay built in.
Python★ 309↓ 2,631/moOct 18, 2026
PyPI · npm80Excellenthealth index
youssofal/MTPLX3x faster speeds on MLX | Qwen 3.8 27B | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.
Python · Swift★ 2,329↓ 9,464/moSep 15, 2026
Arthur-Ficial/apfelThe free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API keys, no cloud, no downloads.
Swift · Python★ 6,386Sep 16, 2026
KevRojo/DulusDulus Ai — Free Agentic AI, Making Gemini web cappable of running bash commands in your terminal! [Gui, Web, Cli, Telegram, 2,000 MCP, 100K Skills . LiteLLM (100+ providers), local models via Ollama, /lang in 34 languages, Mesa Redonda, I create the first utility coin that can be used 100% as AI quota or Fuel, is called $Dulus
Python★ 358↓ 7,957/moSep 5, 2026
crates.io77Goodhealth index
arcships/aimuxUnified LLM access layer in Rust — one API for 325 AI providers. 统一 LLM 服务接入层：一套 API 接入 325 家 AI 服务商。
Rust★ 195Oct 2, 2026
verbatra/verbatraCLI, SDK, and local Studio dashboard to automate i18n translation across i18next, vue-i18n, next-intl, ngx-translate, XLIFF, YAML, Flutter ARB, and Java properties, using OpenAI, Anthropic, Gemini, DeepL, or an openai-compatible model.
TypeScript · MDX★ 2↓ 3,766/moSep 9, 2026
TypeScript★ 65↓ 5,248/moSep 16, 2026
ZahiriNatZuke/local-delegateMCP that delegates mechanical text tasks to a local OpenAI-compatible LLM endpoint to conserve Claude subscription quota.
Python★ 5↓ 1,283/moSep 14, 2026
PyPI · npm75Goodhealth index
domondi1/inferrailSelf-hosted OpenAI/Anthropic-compatible gateway: give each AI agent run a dollar budget, enforced before the provider, with a payload-free per-run cost record.
Python★ 0↓ 4,824/moOct 5, 2026
TypeScript★ 5↓ 7,724/moSep 18, 2026
AIsa-team/cliCLI for the AISA unified AI infrastructure platform - access 70+ LLMs, web search, finance, Twitter, and video generation APIs
TypeScript · JavaScript★ 1↓ 2,101/moSep 12, 2026
Tachion-Oy/robozPython framework for typed LLM agents with conditional tool chaining.
Python★ 0↓ 2,500/moOct 8, 2026
crates.io71Goodhealth index
dravr-ai/dravr-embacleRust library wrapping 12 AI CLI tools as pluggable LLM providers — with OpenAI API client, ACP headless mode, agent loop, MCP server, and OpenAI-compatible REST API
Rust★ 7↓ 2,813/moSep 18, 2026
TypeScript★ 5↓ 47/moSep 12, 2026
arikusi/deepseek-mcp-serverMCP server for DeepSeek V4 (v4-flash, v4-pro, 1M context): chat, reasoning, function calling, thinking mode, cost tracking. deepseek-chat/reasoner aliases supported.
TypeScript★ 24↓ 2,086/moOct 14, 2026
hishamkaram/claude-code-routerA local gateway that routes Claude Code sessions to OpenAI-compatible and Anthropic-compatible models, with same-session switching and visible compatibility behavior.
Go★ 4Sep 10, 2026