PyPI
openvinotoolkit/nncf
Neural Network Compression Framework for enhanced OpenVINO™ inference
Apache-2.013 ago 2026 · métricas 2.10.0
Todas las etiquetas
Etiqueta del catálogo
#quantization
Todos los repositorios del registro público que llevan esta etiqueta, procedente de sus topics de GitHub o de las palabras clave que publican sus registros de paquetes. La salud se mide con la misma metodología versionada que el resto del registro.
34 registros
PyPI
intel/auto-round
A SOTA quantization algorithm for high-accuracy low-bit LLM inference, seamlessly optimized for CPU/XPU/CUDA, with multi-datatype support and full compatibility with vLLM, SGLang, and Transformers.
Apache-2.016 jul 2026 · métricas 2.10.0
PyPI
pytorch/ao
PyTorch native quantization and sparsity for training and inference
Licencia propia21 jul 2026 · métricas 2.10.0
PyPI
bitsandbytes-foundation/bitsandbytes
Accessible large language models via k-bit quantization for PyTorch.
MIT27 ago 2026 · métricas 2.10.0
PyPI
vllm-project/llm-compressor
Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
Apache-2.025 jul 2026 · métricas 2.10.0
PyPI
huggingface/optimum
🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools
Apache-2.021 jul 2026 · métricas 2.10.0
PyPI
ModelCloud/GPTQModel
LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.
Licencia propia17 jul 2026 · métricas 2.10.0
PyPI
Xilinx/brevitas
Brevitas: neural network quantization in PyTorch
Licencia propia22 jul 2026 · métricas 2.10.0
PyPI · crates.io
RyanCodrai/turbovec
A vector index built on TurboQuant, written in Rust with Python bindings
MIT23 ago 2026 · métricas 2.10.0
PyPI
OpenNMT/CTranslate2
Fast inference engine for Transformer models
MIT27 ago 2026 · métricas 2.10.0
PyPI · npm
rajveer43/VeloxQuant-MLX
Fast KV-cache quantization for Apple Silicon (MLX) — 43 research-adapted compression methods with Metal kernels
MIT5 sept 2026 · métricas 2.10.0
PyPI
google-ai-edge/ai-edge-quantizer
AI Edge Quantizer: flexible post training quantization for LiteRT models.
Apache-2.028 ago 2026 · métricas 2.10.0
PyPI
manjunathshiva/turboquant-mlx
Extreme weight + KV cache compression for LLMs on Apple Silicon (MLX implementation of Google's TurboQuant)
Licencia propia28 ago 2026 · métricas 2.10.0
PyPI
mobilint/mblt-model-zoo
Mobilint Model Zoo Project
BSD-3-Clause1 ago 2026 · métricas 2.10.0
PyPI
Sahil170595/Chimeraforge
PyPI capacity-planning CLI for LLM deployment. pip install chimeraforge.
MIT22 ago 2026 · métricas 2.10.0
crates.io · npm · PyPI
ohdearquant/lattice
Run, quantize, and fine-tune LLMs on Apple Silicon. Pure Rust, no Python, no CUDA, no ONNX
Apache-2.022 ago 2026 · métricas 2.10.0
PyPI · crates.io
ahb-sjsu/turboquant-pro
Consumer-aware compression for embedding indexes and LLM KV caches — compress by the metric the downstream consumer actually uses. PCA-Matryoshka + TurboQuant (27x @ 99.8% recall@10), asymmetric K/V, CUDA/Triton kernels, vLLM plugin, replayable CI-gated claims. MIT.
MIT5 sept 2026 · métricas 2.10.0
PyPI
huggingface/optimum-quanto
A pytorch quantization backend for optimum
Apache-2.013 ago 2026 · métricas 2.10.0
PyPI
Comfy-Org/comfy-kitchen
Fast kernel library for Diffusion inference with multiple compute backends.
Apache-2.018 jul 2026 · métricas 2.10.0
PyPI
asher/mlx-kquant
Native K-quant support for MLX, with a quantization and fine-tuning toolchain for Apple Silicon
MIT23 ago 2026 · métricas 2.10.0
PyPI
varjoranta/turboquant-vllm
TurboQuant+ KV cache compression for vLLM. 3.8x smaller KV cache, same conversation quality. Fused CUDA kernels with automatic PyTorch fallback.
MIT22 jul 2026 · métricas 2.10.0
PyPI · crates.io
FedericoTs/quantprobe
Run a 110B on a 2016 PC with 16 GB RAM. Know your tok/s before you download. Placement beats budget: predicts speed + memory fit for any GGUF on your exact hardware, self-calibrates, emits the exact llama.cpp command — or 'quantprobe auto' does it all. Falsification-tested laws; misses published at full size. pip install quantprobe
MIT20 ago 2026 · métricas 2.10.0
PyPI
RobTand/gridbook
Out-of-tree vLLM plugin and open format spec for NVFP4-CB / FP8-CB product-codebook weights — 2-6 bit-per-weight LLM quantization served on native Blackwell tensor cores.
Apache-2.015 ago 2026 · métricas 2.10.0
PyPI
SYSTRAN/faster-whisper
Faster Whisper transcription with CTranslate2
MIT5 ago 2026 · métricas 2.10.0
PyPI
google-ai-edge/LiteRT-CLI
A convenient CLI to streamline LiteRT related development workflows, including converting, quantizing, compiling, managing, running, benchmarking and visualizing LiteRT (TFLite) models on various hardwares (CPU / GPU / NPU) across platforms (desktop, mobile or cloud).
Apache-2.015 jul 2026 · métricas 2.10.0
PyPI
jagmarques/nexusquant
Training-free KV cache compression via E8 lattice VQ. 2-bit KV that preserves retrieval (30/30 NIAH vs TurboQuant 0/30). Calibration-free, 9 architectures validated.
Licencia propia16 jul 2026 · métricas 2.10.0
npm
mkbabb/value.js
CSS value units for color, length, angles, & c.
MIT20 jul 2026 · métricas 2.10.0
PyPI
jjang-ai/jangq
JANG — GGUF for MLX. YOU MUST USE JANG_Q RUNTIME. Adaptive Mixed-Precision Quantization + Runtime for Apple Silicon
Sin licencia22 jul 2026 · métricas 2.10.0
PyPI · npm · crates.io
JunHwan-Kwon/deepbom
Local static analysis and evidence generation for deployed AI model artifacts
Apache-2.04 sept 2026 · métricas 2.10.0
PyPI
pjordanandrsn/experts4bit-qlora
QLoRA fine-tuning of fused 4-bit Mixture-of-Experts on a single small GPU (bitsandbytes Experts4bit)
Licencia propia1 ago 2026 · métricas 2.10.0