PyPI · crates.io · npm
kharkevich-engineering-lab/spark-pulse
Spark Pulse is a web control plane for spark-vllm-docker
Eigene Lizenz21. Sept. 2026 · Metriken 2.10.0
Alle Tags
Katalog-Tag
#vllm
Alle Repositories im öffentlichen Register, die dieses Tag tragen — aus ihren GitHub-Topics oder den von ihren Paket-Registries veröffentlichten Schlagwörtern. Die Gesundheit wird nach derselben versionierten Methodik gemessen wie im übrigen Register.
51 Einträge
Go
openziti/llm-gateway
Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti
Apache-2.019. Sept. 2026 · Metriken 2.10.0
PyPI
CocoRoF/geny-executor
Manifest-driven 21-stage agent pipeline for Python — 5 LLM backends (Anthropic / OpenAI / Google / vLLM / Claude Code CLI), tools, skills, memory, sandboxed CLI runs, MCP. The engine behind Geny. Apache-2.0.
Apache-2.021. Okt. 2026 · Metriken 2.10.0
PyPI
mobilint/vllm-mblt
An out-of-tree vLLM plugin for Mobilint NPU runtime integration.
Apache-2.012. Okt. 2026 · Metriken 2.10.0
PyPI
Aitherium/awdk
Build AI agent fleets. 3 lines, any backend, local or cloud. Effort-based model routing, 48 identities, knowledge graph memory, fleet orchestration.
Eigene Lizenz5. Sept. 2026 · Metriken 2.10.0
PyPI
cdnwetzel/pxx
Local-first AI coding agent runtime — your models, fail-closed safety, evidence-gated self-improvement
MIT15. Sept. 2026 · Metriken 2.10.0
PyPI
varjoranta/turboquant-vllm
TurboQuant+ KV cache compression for vLLM. 3.8x smaller KV cache, same conversation quality. Fused CUDA kernels with automatic PyTorch fallback.
MIT12. Sept. 2026 · Metriken 2.10.0
npm
yeemio/owlcoda
OwlCoda — local-first foundation for governed AI business execution: evidence, replaceable executors, admitted results, and explicit authority boundaries.
GPL-3.013. Sept. 2026 · Metriken 2.10.0
PyPI
hackspaces/blueshark-forge
Model-agnostic agentic runtime for the terminal — any local model becomes a capable agent. The intelligence lives in the harness, not the weights.
MIT5. Sept. 2026 · Metriken 2.10.0
npm
gabelul/bpx-mono
Booplex pi extensions — AI advisor councils (@booplex/bpx-consult) and model endpoint management (@booplex/bpx-endpoints) for the pi coding agent
MIT13. Sept. 2026 · Metriken 2.10.0
PyPI
jagmarques/nexusquant
Training-free KV cache compression via E8 lattice VQ. 2-bit KV that preserves retrieval (30/30 NIAH vs TurboQuant 0/30). Calibration-free, 9 architectures validated.
Eigene Lizenz16. Juli 2026 · Metriken 2.10.0
PyPI
RobTand/gridbook
Out-of-tree vLLM plugin and open format spec for NVFP4-CB / FP8-CB product-codebook weights — 2-6 bit-per-weight LLM quantization served on native Blackwell tensor cores.
Apache-2.018. Sept. 2026 · Metriken 2.10.0
Go
spencerbull/Yokai
Terminal-first GPU fleet manager for deploying, monitoring, and managing vLLM, llama.cpp, and ComfyUI workloads.
MIT19. Okt. 2026 · Metriken 2.10.0
PyPI · crates.io
theoddden/Terradev
An imperative command-line-interface for AI workload orchestration
Apache-2.023. Aug. 2026 · Metriken 2.10.0
npm
apholdings/jensen-code
AI agent toolkit: coding agent CLI, unified LLM API, TUI & web UI libraries, Slack bot, vLLM pods
MIT18. Sept. 2026 · Metriken 2.10.0
—
MekayelAnik/vllm-cpu
Wheels & Docker images for running vLLM on CPU-only systems, optimized for different CPU instruction sets
GPL-3.017. Sept. 2026 · Metriken 2.10.0
Go · npm
napmany/llmsnap
Fast LLM swapping with sleep/wake support, compatible with vllm, llama.cpp, etc. llama-swap fork.
MIT24. Sept. 2026 · Metriken 2.10.0
PyPI
llaa33219/outo-llms
Deploy local LLMs behind your own managed API server - vLLM or llama.cpp in isolated environments, API keys, workspaces, usage tracking
Apache-2.013. Sept. 2026 · Metriken 2.10.0
Go
hekmon/subtitles-ai-ocr
Read PGS (Bluray) and VobSub (DVD) image subtitles and extract their text using external Vision Language Models.
MIT20. Okt. 2026 · Metriken 2.10.0
Go
iguanesolutions/qwen35-rp
Qwen 3.5 Reverse Proxy for handling instant / thinking modes and their variants automatically
MIT19. Sept. 2026 · Metriken 2.10.0
PyPI
wuxuedaifu/vllm-surya-ocr
OpenAI-compatible, vLLM-served OCR API for the Surya-OCR-2 model — multilingual document OCR (layout + text recognition) with request batching, a local CLI, and Docker packaging.
MIT19. Sept. 2026 · Metriken 2.10.0