All tags
Catalogue tag

#vllm

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

51 records
Tagged “vllm”Ranked by health index
PyPI · crates.io · npm
75Goodhealth index
kharkevich-engineering-lab/spark-pulse
Spark Pulse is a web control plane for spark-vllm-docker
Python · TypeScript★ 11↓ 3,444/moSep 21, 2026
Custom licenseSep 21, 2026 · metrics 2.10.0
Go
75Goodhealth index
openziti/llm-gateway
Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti
Go★ 95Sep 19, 2026
Apache-2.0Sep 19, 2026 · metrics 2.10.0
PyPI
73Goodhealth index
CocoRoF/geny-executor
Manifest-driven 21-stage agent pipeline for Python — 5 LLM backends (Anthropic / OpenAI / Google / vLLM / Claude Code CLI), tools, skills, memory, sandboxed CLI runs, MCP. The engine behind Geny. Apache-2.0.
Python★ 2↓ 9,957/moSep 5, 2026
Apache-2.0Sep 5, 2026 · metrics 2.10.0
PyPI
71Goodhealth index
mobilint/vllm-mblt
An out-of-tree vLLM plugin for Mobilint NPU runtime integration.
Python★ 12↓ 7,300/moOct 12, 2026
Apache-2.0Oct 12, 2026 · metrics 2.10.0
PyPI
69Goodhealth index
Aitherium/awdk
Build AI agent fleets. 3 lines, any backend, local or cloud. Effort-based model routing, 48 identities, knowledge graph memory, fleet orchestration.
Python★ 9Sep 5, 2026
Custom licenseSep 5, 2026 · metrics 2.10.0
PyPI
69Goodhealth index
cdnwetzel/pxx
Local-first AI coding agent runtime — your models, fail-closed safety, evidence-gated self-improvement
Python★ 18↓ 2,410/moSep 15, 2026
MITSep 15, 2026 · metrics 2.10.0
PyPI
69Goodhealth index
varjoranta/turboquant-vllm
TurboQuant+ KV cache compression for vLLM. 3.8x smaller KV cache, same conversation quality. Fused CUDA kernels with automatic PyTorch fallback.
Python · C++ · Cuda★ 80↓ 158/moSep 12, 2026
MITSep 12, 2026 · metrics 2.10.0
npm
69Goodhealth index
yeemio/owlcoda
OwlCoda — local-first foundation for governed AI business execution: evidence, replaceable executors, admitted results, and explicit authority boundaries.
TypeScript · JavaScript★ 6↓ 205/moSep 13, 2026
GPL-3.0Sep 13, 2026 · metrics 2.10.0
PyPI
67Goodhealth index
hackspaces/blueshark-forge
Model-agnostic agentic runtime for the terminal — any local model becomes a capable agent. The intelligence lives in the harness, not the weights.
Python★ 1↓ 473/moSep 5, 2026
MITSep 5, 2026 · metrics 2.10.0
npm
63Moderatehealth index
gabelul/bpx-mono
Booplex pi extensions — AI advisor councils (@booplex/bpx-consult) and model endpoint management (@booplex/bpx-endpoints) for the pi coding agent
TypeScript★ 4↓ 244/moSep 13, 2026
MITSep 13, 2026 · metrics 2.10.0
PyPI
63Moderatehealth index
jagmarques/nexusquant
Training-free KV cache compression via E8 lattice VQ. 2-bit KV that preserves retrieval (30/30 NIAH vs TurboQuant 0/30). Calibration-free, 9 architectures validated.
Python★ 25Jul 16, 2026
Custom licenseJul 16, 2026 · metrics 2.10.0
PyPI
62Moderatehealth index
RobTand/gridbook
Out-of-tree vLLM plugin and open format spec for NVFP4-CB / FP8-CB product-codebook weights — 2-6 bit-per-weight LLM quantization served on native Blackwell tensor cores.
Python · Cuda★ 12↓ 1,474/moSep 18, 2026
Apache-2.0Sep 18, 2026 · metrics 2.10.0
Go
62Moderatehealth index
spencerbull/Yokai
Terminal-first GPU fleet manager for deploying, monitoring, and managing vLLM, llama.cpp, and ComfyUI workloads.
Go · TypeScript★ 4Oct 19, 2026
MITOct 19, 2026 · metrics 2.10.0
PyPI · crates.io
62Moderatehealth index
theoddden/Terradev
An imperative command-line-interface for AI workload orchestration
Python★ 25↓ 3,845/moAug 23, 2026
Apache-2.0Aug 23, 2026 · metrics 2.10.0
npm
60Moderatehealth index
apholdings/jensen-code
AI agent toolkit: coding agent CLI, unified LLM API, TUI & web UI libraries, Slack bot, vLLM pods
TypeScript★ 1↓ 7,421/moSep 18, 2026
MITSep 18, 2026 · metrics 2.10.0
—
50Moderatehealth index
MekayelAnik/vllm-cpu
Wheels & Docker images for running vLLM on CPU-only systems, optimized for different CPU instruction sets
Shell★ 10Sep 17, 2026
GPL-3.0Sep 17, 2026 · metrics 2.10.0
Go · npm
48Weakhealth index
napmany/llmsnap
Fast LLM swapping with sleep/wake support, compatible with vllm, llama.cpp, etc. llama-swap fork.
Go · Svelte★ 56Sep 24, 2026
MITSep 24, 2026 · metrics 2.10.0
PyPI
41Weakhealth index
llaa33219/outo-llms
Deploy local LLMs behind your own managed API server - vLLM or llama.cpp in isolated environments, API keys, workspaces, usage tracking
Python · JavaScript · CSS★ 0↓ 402/moSep 13, 2026
Apache-2.0Sep 13, 2026 · metrics 2.10.0
Go
34At Riskhealth index
hekmon/subtitles-ai-ocr
Read PGS (Bluray) and VobSub (DVD) image subtitles and extract their text using external Vision Language Models.
Go★ 12Oct 20, 2026
MITOct 20, 2026 · metrics 2.10.0
Go
30At Riskhealth index
iguanesolutions/qwen35-rp
Qwen 3.5 Reverse Proxy for handling instant / thinking modes and their variants automatically
Go★ 3Sep 19, 2026
MITSep 19, 2026 · metrics 2.10.0
PyPI
26At Riskhealth index
wuxuedaifu/vllm-surya-ocr
OpenAI-compatible, vLLM-served OCR API for the Surya-OCR-2 model — multilingual document OCR (layout + text recognition) with request batching, a local CLI, and Docker packaging.
Python★ 4Sep 19, 2026
MITSep 19, 2026 · metrics 2.10.0