All tags
Catalogue tag

#distributed-inference

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

3 records
Tagged “distributed-inference”Ranked by health index
PyPI
97Exceptionalhealth index
flashinfer-ai/flashinfer
FlashInfer: Kernel Library for LLM Serving
Python · Cuda★ 6,263↓ 7.1M/moAug 27, 2026
Apache-2.0Aug 27, 2026 · metrics 2.10.0
PyPI
95Exceptionalhealth index
gpustack/gpustack
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
Python★ 5,422↓ 2,132/moAug 2, 2026
Apache-2.0Aug 2, 2026 · metrics 2.10.0
PyPI · crates.io
62Moderatehealth index
theoddden/Terradev
An imperative command-line-interface for AI workload orchestration
Python★ 25↓ 3,845/moAug 23, 2026
Apache-2.0Aug 23, 2026 · metrics 2.10.0