All tags
Catalogue tag

#inference-server

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

3 records
Tagged “inference-server”Ranked by health index
PyPI · crates.io
98Exceptionalhealth index
basetenlabs/truss
The simplest way to serve AI/ML models in production
Python · Rust★ 1,195↓ 966.4K/moAug 27, 2026
MITAug 27, 2026 · metrics 2.10.0
PyPI · npm
92Excellenthealth index
roboflow/inference
Turn any computer or edge device into a command center for your computer vision projects.
Python★ 2,438Sep 5, 2026
Custom licenseSep 5, 2026 · metrics 2.10.0
PyPI
78Goodhealth index
jundot/omlx
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Python · Swift★ 18.5KAug 5, 2026
Apache-2.0Aug 5, 2026 · metrics 2.10.0