npm · crates.io · Maven +1100Exceptionalhealth index

microsoft/onnxruntimeONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
C++★ 21.3K↓ 52.8M/moAug 5, 2026
PyPI100Exceptionalhealth index

onnx/onnxOpen standard for machine learning interoperability
Python · C++★ 21.3KAug 5, 2026
PyPI99Exceptionalhealth index
Python★ 1,189↓ 1.3M/moAug 13, 2026
Maven · npm97Exceptionalhealth index

langchain4j/langchain4jLangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.
Java★ 13KAug 27, 2026
PyPI96Exceptionalhealth index

iree-org/ireeA retargetable MLIR-based machine learning compiler and runtime toolkit.
C++ · C · MLIR★ 3,907Aug 28, 2026
PyPI95Exceptionalhealth index
Python · C++★ 2,081↓ 3,335/moJul 29, 2026
npm · PyPI95Exceptionalhealth index

microsoft/SynapseMLSimple and Distributed Machine Learning Python Library porting ML algorithms for Spark
Scala · Python★ 5,236Aug 12, 2026
PyPI94Exceptionalhealth index
huggingface/optimum🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools
Python★ 3,448Jul 21, 2026
PyPI94Exceptionalhealth index
onnx/ir-pyEfficient in-memory representation for ONNX, in Python
Python★ 45Jul 21, 2026
crates.io · npm · PyPI94Exceptionalhealth index

pykeio/ortFast ML inference & training for ONNX models in Rust
Rust★ 2,477↓ 4.3M/moAug 27, 2026
crates.io94Exceptionalhealth index

tracel-ai/burnBurn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.
Rust★ 15.7K↓ 686.9K/moAug 5, 2026
npm · crates.io93Exceptionalhealth index

ruvnet/RuVectorRuVector is a High Performance, Real-Time, Self-Learning Ai, Vector GNN, Memory DB built in Rust.
Rust · TypeScript★ 4,441↓ 432.2K/moAug 22, 2026
PyPI · npm · Go92Excellenthealth index

google/magikaFast and accurate AI powered file content types detection
Python · Rust · TypeScript★ 17.9K↓ 13.9M/moAug 5, 2026
PyPI · npm92Excellenthealth index

roboflow/inferenceTurn any computer or edge device into a command center for your computer vision projects.
Python★ 2,438Sep 5, 2026
crates.io92Excellenthealth index

sonos/tractTiny, no-nonsense, self-contained, Tensorflow and ONNX inference
Rust★ 3,039↓ 1,800/moAug 22, 2026
npm91Excellenthealth index
PT-Perkasa-Pilar-Utama/ppu-paddle-ocrLightweight, probably the fastest PaddleOCR SDK in TypeScript. Multilingual Support. Runs anywhere JavaScript runs: Node.js, Bun, Deno, mobile react-native, web browsers, and browser extensions. Docker & CLI supported. The official SDK is browser-only.
TypeScript · HTML★ 113↓ 33.9K/moAug 1, 2026
PyPI91Excellenthealth index
Jupyter Notebook · Python★ 2,546↓ 388K/moAug 8, 2026
crates.io91Excellenthealth index
snipsco/tractTiny, no-nonsense, self-contained, Tensorflow and ONNX inference
Rust★ 2,991↓ 912.8K/moJul 16, 2026
PyPI90Excellenthealth index

Tencent/ncnnncnn is a high-performance neural network inference framework optimized for the mobile platform
C++ · C★ 23.7KAug 12, 2026
PyPI · crates.io90Excellenthealth index
Python · C++ · JavaScript★ 4,383Aug 13, 2026
npm · crates.io86Excellenthealth index
drakulavich/kesha-voice-kitGive your tools a voice — speech to text and back, 25 languages, up to ~19× faster than Whisper. On your machine.
Rust · TypeScript★ 67↓ 1,029/moJul 28, 2026
PyPI86Excellenthealth index
Python★ 513↓ 1.3M/moAug 16, 2026
PyPI · npm86Excellenthealth index

n24q02m/mcp-coreShared foundation for building MCP servers -- Streamable HTTP transport, OAuth 2.1, browser-based credential setup, and a shared embedding daemon.
Python · TypeScript★ 1↓ 17.7K/moAug 22, 2026
crates.io · Maven · npm +184Excellenthealth index

k2-fsa/sherpa-onnxSpeech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC-V, RK NPU, Axera NPU, Ascend NPU, x86_64 servers, websocket server/client, support 12 programming languages
C++ · Python★ 14.4KAug 27, 2026
PyPI84Excellenthealth index
Python · TypeScript★ 309Jul 15, 2026
PyPI · npm83Excellenthealth index

lutzroeder/netronVisualizer for neural network, deep learning and machine learning models
JavaScript★ 33.3K↓ 92K/moAug 5, 2026
crates.io · npm · PyPI83Excellenthealth index
Rust★ 329↓ 1.2M/moAug 1, 2026
RubyGems81Excellenthealth index
Scala · Python · HTML★ 4,154Aug 13, 2026
PyPI81Excellenthealth index
istupakov/onnx-asrA lightweight Python package for Automatic Speech Recognition using ONNX models
Python★ 347↓ 244.7K/moJul 20, 2026
PyPI81Excellenthealth index

vietanhdev/anylabelingEffortless AI-assisted data labeling with AI support from YOLO, Segment Anything (SAM+SAM2/2.1+SAM3), MobileSAM!!
Python★ 3,464↓ 3,868/moAug 29, 2026