Alle Tags
Katalog-Tag

#quantization

Alle Repositories im öffentlichen Register, die dieses Tag tragen — aus ihren GitHub-Topics oder den von ihren Paket-Registries veröffentlichten Schlagwörtern. Die Gesundheit wird nach derselben versionierten Methodik gemessen wie im übrigen Register.

47 Einträge
Getaggt als „quantization“Geordnet nach Gesundheitsindex
PyPI
67GutGesundheitsindex
google-ai-edge/LiteRT-CLI
A convenient CLI to streamline LiteRT related development workflows, including converting, quantizing, compiling, managing, running, benchmarking and visualizing LiteRT (TFLite) models on various hardwares (CPU / GPU / NPU) across platforms (desktop, mobile or cloud).
Python★ 41↓ 80/Monat8. Sept. 2026
Apache-2.08. Sept. 2026 · Metriken 2.10.0
PyPI
67GutGesundheitsindex
pjordanandrsn/grouped-nf4-gemm
Triton kernels for 4-bit MoE inference: grouped NF4/MXFP4 GEMM, INT4 GEMV, FP8 paged attention, and CPU/NVMe expert streaming.
Python★ 2↓ 3.717/Monat24. Sept. 2026
MIT24. Sept. 2026 · Metriken 2.10.0
PyPI
65GutGesundheitsindex
SYSTRAN/faster-whisper
Faster Whisper transcription with CTranslate2
Python★ 25.4K↓ 8.7M/Monat16. Sept. 2026
MIT16. Sept. 2026 · Metriken 2.10.0
PyPI
65GutGesundheitsindex
asher/gmlx
Local inference platform for K/IQ-quant GGUF models on Apple Silicon
Python★ 31↓ 2.075/Monat25. Sept. 2026
Eigene Lizenz25. Sept. 2026 · Metriken 2.10.0
PyPI
63MittelGesundheitsindex
jagmarques/nexusquant
Training-free KV cache compression via E8 lattice VQ. 2-bit KV that preserves retrieval (30/30 NIAH vs TurboQuant 0/30). Calibration-free, 9 architectures validated.
Python★ 2516. Juli 2026
Eigene Lizenz16. Juli 2026 · Metriken 2.10.0
PyPI
62MittelGesundheitsindex
RobTand/gridbook
Out-of-tree vLLM plugin and open format spec for NVFP4-CB / FP8-CB product-codebook weights — 2-6 bit-per-weight LLM quantization served on native Blackwell tensor cores.
Python · Cuda★ 12↓ 1.474/Monat18. Sept. 2026
Apache-2.018. Sept. 2026 · Metriken 2.10.0
PyPI
60MittelGesundheitsindex
manunicholasjacob/llama-roofline
Is your llama.cpp decode memory-bandwidth-bound? Find out in one command.
Python★ 1↓ 12.4K/Monat13. Okt. 2026
MIT13. Okt. 2026 · Metriken 2.10.0
PyPI
59MittelGesundheitsindex
jjang-ai/jangq
JANG — GGUF for MLX. YOU MUST USE JANG_Q RUNTIME. Adaptive Mixed-Precision Quantization + Runtime for Apple Silicon
Python · Swift★ 225↓ 1.557/Monat13. Sept. 2026
Keine Lizenz13. Sept. 2026 · Metriken 2.10.0
PyPI · npm · crates.io
54MittelGesundheitsindex
JunHwan-Kwon/deepbom
Local static analysis and evidence generation for deployed AI model artifacts
JavaScript · Rust★ 2↓ 8.091/Monat21. Okt. 2026
Apache-2.021. Okt. 2026 · Metriken 2.10.0
npm
54MittelGesundheitsindex
mkbabb/value.js
CSS value units for color, length, angles, & c.
TypeScript★ 0↓ 156/Monat12. Sept. 2026
MIT12. Sept. 2026 · Metriken 2.10.0
crates.io
42SchwachGesundheitsindex
RecursiveIntell/turbo-quant
Experimental Rust vector-compression sidecars implementing TurboQuant (ICLR 2026), PolarQuant and QJL research primitives, with exact reranking and workload-scoped benchmark receipts.
Rust · Python★ 26↓ 2.127/Monat20. Okt. 2026
MIT20. Okt. 2026 · Metriken 2.10.0
npm
42SchwachGesundheitsindex
stfurkan/bitgpu
Fast WebGPU runtime for 1-bit (binary-weight) LLMs in the browser. Bit-exact, zero runtime dependencies.
TypeScript · WGSL · Python★ 27↓ 204/Monat14. Sept. 2026
MIT14. Sept. 2026 · Metriken 2.10.0
PyPI
38SchwachGesundheitsindex
fermionresearch/phonon
Phonon: open speech recognition models (Phonon-2, Phonon-1) — CLI, CPU and CUDA images
Python★ 25820. Okt. 2026
Apache-2.020. Okt. 2026 · Metriken 2.10.0
PyPI
22GefährdetGesundheitsindex
nactttch/g2n
A torch.compile backend that pays attention: custom FX fusion passes, a Triton LayerNorm kernel, and a persistent compile cache. Apache-2.0 free core of the g2n platform.
Python★ 0↓ 2.377/Monat15. Sept. 2026
Apache-2.015. Sept. 2026 · Metriken 2.10.0
PyPI
19KritischGesundheitsindex
blue-oil/blueoil
Bring Deep Learning to small devices
Python · C++★ 24711. Sept. 2026
Apache-2.011. Sept. 2026 · Metriken 2.10.0