PyPI99Exceptionalhealth index

huggingface/trlTrain transformer language models with reinforcement learning.
Python★ 19.1K↓ 4.1M/moAug 24, 2026
PyPI98Exceptionalhealth index
Python★ 17.9K↓ 263.7K/moSep 17, 2026
PyPI98Exceptionalhealth index

data-privacy-stack/presidioAn open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.
Python★ 10.7K↓ 12.1M/moAug 27, 2026
PyPI98Exceptionalhealth index
Python★ 21.7KSep 16, 2026
PyPI98Exceptionalhealth index
Python★ 1,199↓ 1.3M/moSep 17, 2026
PyPI98Exceptionalhealth index

vllm-project/llm-compressorTransformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
Python★ 3,778↓ 115.7K/moSep 13, 2026
PyPI · npm97Exceptionalhealth index

xorbitsai/inferenceSwap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
Python · TypeScript★ 9,579↓ 8,895/moSep 20, 2026
PyPI96Exceptionalhealth index

MakazhanAlpamys/SoupFine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
Python★ 5,794Sep 8, 2026
PyPI95Exceptionalhealth index

Blaizzy/mlx-audioA text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.
Python★ 7,796↓ 582.2K/moAug 28, 2026
crates.io95Exceptionalhealth index
Rust · Python★ 11K↓ 3.8M/moAug 27, 2026
PyPI95Exceptionalhealth index

intel/auto-roundA SOTA quantization toolkit for high-accuracy low-bit LLM inference|简洁且高效的量化工具包
Python · C++★ 1,609↓ 16K/moSep 8, 2026
PyPI94Exceptionalhealth index

huggingface/optimum🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools
Python★ 3,486↓ 1.5M/moSep 12, 2026
PyPI94Exceptionalhealth index

modelscope/ms-swiftUse PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, ...) (AAAI 2025).
Python★ 15.4K↓ 111K/moAug 27, 2026
PyPI94Exceptionalhealth index

raullenchai/Rapid-MLXThe fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider.
Python · Swift★ 3,753Sep 15, 2026
PyPI94Exceptionalhealth index

vllm-project/speculatorsA unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM
Python★ 865↓ 5,844/moOct 8, 2026
PyPI · Go · npm93Exceptionalhealth index

SwanHubX/SwanLab⚡️SwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc.
Python★ 4,176↓ 155.3K/moAug 28, 2026
PyPI93Exceptionalhealth index
Python★ 5,769↓ 835.1K/moAug 28, 2026
PyPI93Exceptionalhealth index

mflux-community/mfluxApple MLX native implementations of state-of-the-art generative image & video models
Python★ 2,459↓ 30.6K/moOct 8, 2026
PyPI93Exceptionalhealth index

neuml/txtai💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows
Python★ 13KSep 20, 2026
PyPI91Excellenthealth index

ModelCloud/GPTQModelLLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.
Python · Cuda★ 1,253↓ 28.2K/moSep 10, 2026
PyPI90Excellenthealth index

kyegomez/swarmsThe Enterprise-Grade Multi-Agent Orchestration Framework. Website: https://swarms.ai
Python★ 7,172↓ 14.4K/moSep 15, 2026
PyPI90Excellenthealth index

ndif-team/nnsightThe nnsight package enables interpreting and manipulating the internals of deep learned models.
Python★ 1,125↓ 20.2K/moOct 20, 2026
PyPI · crates.io90Excellenthealth index
Rust★ 33↓ 7,303/moSep 18, 2026
PyPI89Excellenthealth index
Python★ 212↓ 47.4K/moSep 11, 2026
PyPI89Excellenthealth index

urchade/GLiNERGeneralist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts)
Python★ 3,734↓ 660.9K/moSep 17, 2026
PyPI88Excellenthealth index
Python★ 11.7K↓ 422.9K/moSep 17, 2026
crates.io · npm · PyPI87Excellenthealth index
Rust · Cuda★ 7,695↓ 296.5K/moSep 17, 2026
PyPI87Excellenthealth index
Python★ 7,838Sep 17, 2026
PyPI87Excellenthealth index

lpalbou/mlx-genGenerative image and video runtimes for Apple Silicon (MLX): text/image-to-image, instruction editing, masked edit, text/image/reference-to-video, video editing, and restoration.
Python★ 25↓ 3,543/moSep 10, 2026
PyPI86Excellenthealth index

GiacomoSaccaggi/scomp_linkEnd-to-end ML toolkit automating the complete workflow — data profiling, preprocessing, feature engineering, model selection, training, validation, explainability, drift monitoring, fairness checks, and interactive HTML reporting. Includes a full CLI for zero-code ML pipelines. Python 3.10+.
Python★ 12↓ 2,313/moSep 9, 2026