Alle Tags
Katalog-Tag

#gguf

Alle Repositories im öffentlichen Register, die dieses Tag tragen — aus ihren GitHub-Topics oder den von ihren Paket-Registries veröffentlichten Schlagwörtern. Die Gesundheit wird nach derselben versionierten Methodik gemessen wie im übrigen Register.

14 Einträge
Getaggt als „gguf“Geordnet nach Gesundheitsindex
PyPI
87ExzellentGesundheitsindex
ggml-org/llama.cpp
LLM inference in C/C++
C++ · C★ 121.1K↓ 6.6M/Monat21. Juli 2026
MIT21. Juli 2026 · Metriken 1.13.0
PyPI
85ExzellentGesundheitsindex
intel/auto-round
A SOTA quantization algorithm for high-accuracy low-bit LLM inference, seamlessly optimized for CPU/XPU/CUDA, with multi-datatype support and full compatibility with vLLM, SGLang, and Transformers.
Python · C++★ 1.52016. Juli 2026
Apache-2.016. Juli 2026 · Metriken 1.13.0
Go
74GutGesundheitsindex
defilantech/llmkube
Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
Go★ 167↓ 0/Monat14. Juli 2026
Apache-2.014. Juli 2026 · Metriken 1.13.0
PyPI
72GutGesundheitsindex
MakazhanAlpamys/Soup
Soup turns the pain of LLM fine-tuning into a simple workflow. One config, one command, done.
Python★ 7415. Juli 2026
Apache-2.015. Juli 2026 · Metriken 1.13.0
PyPI · crates.io · npm
71GutGesundheitsindex
alexsjones/llmfit
Hundreds of models & providers. One command to find what runs on your hardware.
Rust★ 29.6K↓ 15.8K/Monat17. Juli 2026
MIT17. Juli 2026 · Metriken 1.13.0
Go
65MittelGesundheitsindex
hybridgroup/yzma
Go with your own intelligence - Go applications that directly integrate llama.cpp for local inference using hardware acceleration.
Go★ 52017. Juli 2026
Eigene Lizenz17. Juli 2026 · Metriken 1.13.0
Go
62MittelGesundheitsindex
gpustack/gguf-parser-go
Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
Go★ 276↓ 0/Monat14. Juli 2026
MIT14. Juli 2026 · Metriken 1.13.0
PyPI · crates.io
61MittelGesundheitsindex
handy-computer/transcribe.cpp
ggml speech-to-text inference for 16+ model families
C++ · C★ 197↓ 7.559/Monat17. Juli 2026
MIT17. Juli 2026 · Metriken 1.13.0
Go
60MittelGesundheitsindex
aimd54/palan
Pull, push, pack, and serve GGUF models as OCI ModelPack artifacts — daemonless, air-gap-first, one binary
Go★ 017. Juli 2026
Apache-2.017. Juli 2026 · Metriken 1.13.0
Go · PyPI
59MittelGesundheitsindex
anthony-chaudhary/fak
fak — the Fused Agent Kernel: one Go binary for AI agent loops. Wrap Claude Code/Codex/Cursor, keep long sessions cache-efficient, route work per call, run local GGUF models, and adjudicate tool calls.
Go · Python★ 1517. Juli 2026
Apache-2.017. Juli 2026 · Metriken 1.13.0
npm
59MittelGesundheitsindex
therealtimex/node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
TypeScript★ 1↓ 41.2K/Monat17. Juli 2026
MIT17. Juli 2026 · Metriken 1.13.0
Go
57MittelGesundheitsindex
thxcode/gguf-parser-go
Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
Go★ 27615. Juli 2026
MIT15. Juli 2026 · Metriken 1.13.0
npm
55MittelGesundheitsindex
mohitsoni48/TurboLLM
Run any local LLM engine, auto-tuned to your GPU — polished web UI + OpenAI/Anthropic-compatible API. Point Claude Code at your own machine in one command. No Electron, no Python, offline-first.
TypeScript★ 173↓ 6.179/Monat16. Juli 2026
Keine Lizenz16. Juli 2026 · Metriken 1.13.0
PyPI
54MittelGesundheitsindex
jjang-ai/jangq
JANG — GGUF for MLX. YOU MUST USE JANG_Q RUNTIME. Adaptive Mixed-Precision Quantization + Runtime for Apple Silicon
Python · Swift★ 21422. Juli 2026
Keine Lizenz22. Juli 2026 · Metriken 1.13.0