All tags
Catalogue tag

#inference-api

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

5 records
Tagged “inference-api”Ranked by health index
PyPI · crates.io
98Exceptionalhealth index
basetenlabs/truss
The simplest way to serve AI/ML models in production
Python · Rust★ 1,195↓ 966.4K/moAug 27, 2026
MITAug 27, 2026 · metrics 2.10.0
PyPI
89Excellenthealth index
qualcomm/ai-hub-models
Qualcomm® AI Hub Models is our collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.
Python★ 1,233↓ 6,732/moOct 21, 2026
BSD-3-ClauseOct 21, 2026 · metrics 2.10.0
Go
88Excellenthealth index
inference-gateway/inference-gateway
An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.
Go★ 212Sep 13, 2026
Apache-2.0Sep 13, 2026 · metrics 2.10.0
PyPI · npm
88Excellenthealth index
roboflow/inference
Turn any computer or edge device into a command center for your computer vision projects.
Python★ 2,480Oct 21, 2026
Custom licenseOct 21, 2026 · metrics 2.10.0
Go
51Moderatehealth index
mostlydev/cllama
The blood-brain barrier for autonomous agents. A context-aware LLM governance proxy that enforces credential starvation — identity-verified, provider-routed, cost-tracked, and audit-logged.
Go★ 1Sep 19, 2026
No licenseSep 19, 2026 · metrics 2.10.0