All tags
Catalogue tag

#ai-inference

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

4 records
Tagged “ai-inference”Ranked by health index
PyPI
96Exceptionalhealth index
bentoml/BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
Python★ 8,847↓ 256.2K/moSep 17, 2026
Apache-2.0Sep 17, 2026 · metrics 2.10.0
PyPI · crates.io
71Goodhealth index
xflops/flame
A distributed engine for elastic workload, e.g. AI Agent, RL, Quant
Rust · Python★ 53Sep 23, 2026
Apache-2.0Sep 23, 2026 · metrics 2.10.0
Go
62Moderatehealth index
spencerbull/Yokai
Terminal-first GPU fleet manager for deploying, monitoring, and managing vLLM, llama.cpp, and ComfyUI workloads.
Go · TypeScript★ 4Oct 19, 2026
MITOct 19, 2026 · metrics 2.10.0
PyPI
34At Riskhealth index
uxlfoundation/oneDAL
oneAPI Data Analytics Library (oneDAL)
C++★ 653Oct 16, 2026
Apache-2.0Oct 16, 2026 · metrics 2.10.0