PyPI94Exceptionalhealth index

huggingface/optimum🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools
Python★ 3,486↓ 1.5M/moSep 12, 2026
PyPI94Exceptionalhealth index

lemonade-sdk/lemonadeLemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
C++ · Python · TypeScript★ 5,510Aug 28, 2026
crates.io · npm · PyPI94Exceptionalhealth index

pykeio/ortFast ML inference & training for ONNX models in Rust
Rust★ 2,477↓ 4.3M/moAug 27, 2026
PyPI93Exceptionalhealth index

RapidAI/RapidOCR📄 Awesome OCR multiple programing languages toolkits based on ONNX Runtime, OpenVINO, MNN, PaddlePaddle, TensorRT and PyTorch.
Python · Jupyter Notebook★ 7,851↓ 3.8M/moSep 17, 2026
npm92Excellenthealth index

PT-Perkasa-Pilar-Utama/ppu-paddle-ocrLightweight, probably the fastest PaddleOCR SDK in TypeScript. Multilingual Support. Runs anywhere JavaScript runs: Node.js, Bun, Deno, mobile react-native, web browsers, web worker, and browser extensions. Docker & CLI supported. The official SDK is browser-only.
TypeScript · HTML★ 134↓ 64.2K/moSep 15, 2026
Maven91Excellenthealth index
Java★ 4,858Oct 19, 2026
PyPI89Excellenthealth index

CVHub520/X-AnyLabelingX-AnyLabeling: A lightweight, efficient, and unified cross-platform desktop application for annotating text, image, video, and multimodal data, combining versatile built-in tools with state-of-the-art AI models and flexible multi-format export.
Python★ 10.7K↓ 2,623/moOct 15, 2026
PyPI89Excellenthealth index
Python★ 518↓ 1.3M/moSep 18, 2026
crates.io · PyPI78Goodhealth index
Rust★ 1,317↓ 9,430/moOct 20, 2026
npm · PyPI78Goodhealth index

arcforgelabs/dictateLocal-only desktop dictation for Linux and Windows: hold a key, speak, and the text lands in the focused app. On-device Parakeet speech-to-text on the CPU, no accounts, no cloud.
Python · JavaScript★ 0↓ 1,610/moOct 18, 2026
Python★ 10.2K↓ 1.7M/moSep 17, 2026

n24q02m/fastretrievalFast multi-model retrieval runtime: ONNX and GGUF embeddings, reranking, and a declarative model contract
Python★ 1↓ 5,221/moSep 18, 2026
Go · npm71Goodhealth index

sigpanic/goinkGoink 桌面 AI 小说创作助手,对话式写作 + 自动状态追踪 + 本地语义搜索。跨平台开箱即用。AI Agent Novel Generator.
Go · TypeScript★ 471Oct 19, 2026
PyPI · npm69Goodhealth index
Python · TypeScript★ 1↓ 3,250/moSep 16, 2026
Python★ 2,732↓ 383.6K/moSep 17, 2026

srfrog/goldie-mcpMulti-agent memory MCP server in Go to share typed memories across Claude Code, Codex, and more
Go★ 4Sep 19, 2026
Go · C★ 725Oct 14, 2026
npm57Moderatehealth index
TypeScript★ 32↓ 384.2K/moSep 18, 2026

microsoft/WindowsMLOfficial repo for Windows ML - Microsoft's high-performance local AI inferencing framework for Windows.
Mixed★ 29Sep 18, 2026

AmusementClub/vs-mlrtEfficient CPU/GPU ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE, SCUNet, ArtCNN and more!)
C++ · Python★ 486Oct 19, 2026
Elixir · Rust★ 208↓ 5,885/moSep 9, 2026
crates.io42Weakhealth index

fbilhaut/orpA Lightweight Framework for Building ONNX Runtime Pipelines with ort
Rust★ 12↓ 25.1K/moSep 17, 2026
Go★ 5Oct 17, 2026
Rust · Python★ 53↓ 661/moSep 20, 2026