Maven · PyPI
ray-project/ray
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Apache-2.0Sep 16, 2026 · metrics 2.10.0
All tags
Catalogue tag
#serving
Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.
6 records
Go
volcano-sh/volcano
A Cloud Native Batch System (Project under CNCF)
Apache-2.0Aug 23, 2026 · metrics 2.10.0
PyPI
vllm-project/speculators
A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM
Apache-2.0Oct 8, 2026 · metrics 2.10.0
npm
lloyal-ai/hdk
Harness Development Kit for Vertical Inference
Custom licenseSep 8, 2026 · metrics 2.10.0
PyPI
nactttch/g2n
A torch.compile backend that pays attention: custom FX fusion passes, a Triton LayerNorm kernel, and a persistent compile cache. Apache-2.0 free core of the g2n platform.
Apache-2.0Sep 15, 2026 · metrics 2.10.0
PyPI · Maven
awslabs/multi-model-server
Multi Model Server is a tool for serving neural net models for inference
Apache-2.0Sep 17, 2026 · metrics 2.10.0