PyPI · crates.io
basetenlabs/truss
The simplest way to serve AI/ML models in production
MITAug 27, 2026 · metrics 2.10.0
All tags
Catalogue tag
#inference-server
Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.
5 records
PyPI
vllm-project/speculators
A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM
Apache-2.0Oct 8, 2026 · metrics 2.10.0
PyPI
waybarrios/vllm-mlx
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.
Apache-2.0Oct 20, 2026 · metrics 2.10.0
PyPI · npm
roboflow/inference
Turn any computer or edge device into a command center for your computer vision projects.
Custom licenseOct 21, 2026 · metrics 2.10.0
PyPI
jundot/omlx
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Apache-2.0Sep 16, 2026 · metrics 2.10.0