PyPI86Excellenthealth index
Scala · Python★ 1,543↓ 2.1M/moAug 27, 2026
npm86Excellenthealth index

shinpr/mcp-local-ragLocal-first RAG server for developers. Semantic + keyword search for code and technical docs. Works with MCP or CLI. Fully private, zero setup.
TypeScript★ 400↓ 17K/moSep 19, 2026
PyPI84Excellenthealth index

RBLN-SW/optimum-rbln⚡ A seamless integration of HuggingFace Transformers & Diffusers with RBLN SDK for efficient inference on RBLN NPUs.
Python★ 19↓ 29.4K/moSep 8, 2026
PyPI84Excellenthealth index

ultralytics/thopPyTorch model profiler for computing MACs and parameter counts to measure deep learning model complexity.
Python★ 156↓ 4.6M/moSep 12, 2026
PyPI83Excellenthealth index
Python★ 23↓ 2,051/moOct 13, 2026
npm · PyPI81Excellenthealth index
TypeScript · Python · JavaScript★ 16↓ 3,366/moSep 18, 2026
RubyGems80Excellenthealth index
Scala · Python · HTML★ 4,159Sep 17, 2026
PyPI80Excellenthealth index
Jupyter Notebook · Python★ 2,807Sep 17, 2026
Packagist80Excellenthealth index
PHP★ 54↓ 212.3K/moSep 6, 2026
Python★ 574↓ 119.1K/moOct 9, 2026
TypeScript · JavaScript★ 6↓ 4,128/moSep 13, 2026
PyPI · npm77Goodhealth index

jjang-ai/vmlxvMLX - Use MLX models easily - JANGQ (GGUF for MLX) - Not dependant on mlx_vlm
Python · TypeScript★ 849↓ 4,381/moSep 13, 2026

pjordanandrsn/experts4bit-qloraTrain and serve MoE models that do not fit in VRAM: fused 4-bit experts, QLoRA, CPU/NVMe offload, and fast inference on consumer NVIDIA GPUs.
Python★ 3↓ 2,064/moSep 15, 2026
PyPI63Moderatehealth index
jagmarques/nexusquantTraining-free KV cache compression via E8 lattice VQ. 2-bit KV that preserves retrieval (30/30 NIAH vs TurboQuant 0/30). Calibration-free, 9 architectures validated.
Python★ 25Jul 16, 2026
PyPI60Moderatehealth index

Sid-MB/interlensPython framework for efficient and precise interpretability research on multi-agent conversations.
Python★ 1↓ 1,979/moSep 8, 2026
PyPI59Moderatehealth index

kha-white/manga-ocrOptical character recognition for Japanese text, with the main focus being Japanese manga
Python★ 2,775Sep 11, 2026
npm59Moderatehealth index

privent-ai/n8n-nodes-priventOpen-source data protection framework for AI agent workflows in n8n. Detects, tokenizes, and reversibly anonymizes sensitive data before it reaches your models.
TypeScript★ 4↓ 267/moSep 14, 2026
npm57Moderatehealth index
TypeScript★ 32↓ 384.2K/moSep 18, 2026
PyPI54Moderatehealth index
Python★ 2↓ 2,415/moSep 26, 2026
npm51Moderatehealth index

damoqiongqiu/mcp-local-ragLocal-first RAG server for developers. Semantic + keyword search for code and technical docs. Works with MCP or CLI. Fully private, zero setup.
TypeScript★ 13↓ 455/moSep 15, 2026
PyPI51Moderatehealth index
Python★ 0↓ 7,795/moSep 15, 2026
C#★ 25Oct 7, 2026
C++★ 10.9KSep 17, 2026
PyPI30At Riskhealth index
Python★ 0Oct 20, 2026

LowinLi/transformers-stream-generatorThis is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.
Python★ 96↓ 344.8K/moSep 12, 2026

intel/ipex-llmAccelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
Python★ 8,853Sep 17, 2026
Python★ 3,207↓ 121.8K/moSep 17, 2026