All tags
Catalogue tag

#llm-gateway

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

17 records
Tagged “llm-gateway”Ranked by health index
Go · npm
84Goodhealth index
maximhq/bifrost
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
Go · TypeScript★ 6,574Jul 17, 2026
Apache-2.0Jul 17, 2026 · metrics 1.13.0
PyPI · crates.io · npm
81Goodhealth index
BerriAI/litellm
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
Python · TypeScript★ 53.6K↓ 1.8M/moJul 15, 2026
Custom licenseJul 15, 2026 · metrics 1.13.0
npm
80Goodhealth index
diegosouzapw/omniroute
Never stop coding. Free AI gateway: one endpoint, 231+ providers (50+ free), connect Claude Code, Codex, Cursor, Cline & Copilot to FREE Claude/GPT/Gemini. RTK+Caveman stacked compression saves 15-95% tokens, smart auto-fallback, MCP/A2A, multimodal APIs, Desktop/PWA.
TypeScript★ 17.7K↓ 70K/moJul 16, 2026
MITJul 16, 2026 · metrics 1.13.0
npm
76Goodhealth index
decolua/9router
Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.
JavaScript★ 22.1K↓ 166.8K/moJul 14, 2026
MITJul 14, 2026 · metrics 1.13.0
Go
75Goodhealth index
enterpilot/gomodel
AI gateway written in Go. Lightweight unified OpenAI-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI & Ollama. LiteLLM alternative with observability, guardrails, streaming, costs and usage tracking.
Go · JavaScript★ 1,011Jul 19, 2026
MITJul 19, 2026 · metrics 1.13.0
Go
73Goodhealth index
ferro-labs/ai-gateway
Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gateway LiteLLM & Kong AI Gateway alternative.
Go★ 183Jul 17, 2026
Apache-2.0Jul 17, 2026 · metrics 1.13.0
PyPI
70Goodhealth index
Nayjest/lm-proxy
OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.
Python★ 141Jul 15, 2026
MITJul 15, 2026 · metrics 1.13.0
Go
65Moderatehealth index
dativo-io/talon
Open-source AI governance gateway for EU teams: enforce PII, cost, model, data residency, and tool policies for LLMs and AI agents with signed evidence.
Go★ 10Jul 17, 2026
Apache-2.0Jul 17, 2026 · metrics 1.13.0
npm
65Moderatehealth index
yuhp/opencode-models-discovery
A universal OpenCode plugin for dynamic model discovery with flexible configuration for OpenAI-compatible providers.
TypeScript★ 75↓ 15.9K/moJul 15, 2026
MITJul 15, 2026 · metrics 1.13.0
Go
62Moderatehealth index
lansespirit/clipal
Minimal LLM API reverse proxy for Claude Code, Codex CLI & Gemini CLI — YAML routing, hot reload, and automatic provider failover. 极简 LLM API 反向代理：面向 Claude Code / Codex CLI / Gemini CLI，支持 YAML 配置、多上游优先级与自动故障转移。
Go · JavaScript★ 143Jul 17, 2026
No licenseJul 17, 2026 · metrics 1.13.0
Go
61Moderatehealth index
r9s-ai/open-next-router
A lightweight, DSL-driven LLM gateway for routing, patching provider quirks, and normalizing APIs across channels
Go★ 26↓ 0/moJul 14, 2026
MITJul 14, 2026 · metrics 1.13.0
npm
59Moderatehealth index
MikeyPetrillo/Agent402
500+ pay-per-call web tools + skill packs for AI agents — every one tested, priced, and settled on-chain. Paid in USDC over x402 on 8 chains, or free via proof-of-work on the pure-CPU tools. Self-hostable, MCP-native, deterministic. Plus the open x402 index (Find / Route / Leaderboard).
JavaScript★ 5↓ 7,099/moJul 16, 2026
MITJul 16, 2026 · metrics 1.13.0
Go
59Moderatehealth index
PAIArtCom/Clipal
Minimal LLM API reverse proxy for Claude Code, Codex CLI & Gemini CLI — YAML routing, hot reload, and automatic provider failover. 极简 LLM API 反向代理：面向 Claude Code / Codex CLI / Gemini CLI，支持 YAML 配置、多上游优先级与自动故障转移。
Go · JavaScript★ 143Jul 17, 2026
No licenseJul 17, 2026 · metrics 1.13.0
Go
57Moderatehealth index
wyolet/relay
High-throughput, self-hostable LLM router in Go. BYO provider keys, k8s-native, key pooling + batch + usage observability.
Go★ 23↓ 0/moJul 13, 2026
Apache-2.0Jul 13, 2026 · metrics 1.13.0
Go · npm
44At riskhealth index
sanhaji182/lintasan
High-performance LLM gateway in Go. 35x less RAM than Node.js version.
Go · Svelte★ 4Jul 22, 2026
MITJul 22, 2026 · metrics 1.13.0
Go · npm
44At riskhealth index
sanhaji182/lintasan-go
High-performance LLM gateway in Go. 35x less RAM than Node.js version.
Go · Svelte★ 4Jul 18, 2026
MITJul 18, 2026 · metrics 1.13.0
Go · npm
43At riskhealth index
aurorallm/aurora
The Fastest enterprise AI gateway — route LLM traffic across OpenAI, Anthropic, Gemini, Groq & 30+ providers via a single API. Self-hosted, no vendor lock-in. ( 55x faster than litellm )
Go · TypeScript★ 4Jul 19, 2026
Apache-2.0Jul 19, 2026 · metrics 1.13.0