PyPI · crates.io99Exceptionalhealth index

vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMs
Python★ 91.9K↓ 2.9M/moSep 16, 2026
PyPI · Go98Exceptionalhealth index

LMCache/LMCacheLMCache: Supercharge Your LLM with the Fastest KV Cache Layer
Python★ 11.9K↓ 58.7K/moSep 18, 2026
PyPI97Exceptionalhealth index

Xilinx/mlir-aieA close-to-metal Python API for programming AMD Ryzen™ AI NPUs (AI Engines), built on an open-source MLIR-based compiler toolchain.
C · C++ · MLIR★ 689Sep 19, 2026
npm96Exceptionalhealth index

webpack/webpackA bundler for javascript and friends. Packs many modules into a few bundled assets. Code Splitting allows for loading parts of the application on demand. Through "loaders", modules can be CommonJs, AMD, ES6 modules, CSS, Images, JSON, Coffeescript, LESS, ... and your custom stuff.
JavaScript★ 65.9K↓ 211M/moSep 16, 2026
PyPI · Go · npm94Exceptionalhealth index
Python★ 1,547↓ 3,375/moSep 14, 2026
PyPI94Exceptionalhealth index

lemonade-sdk/lemonadeLemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
C++ · Python · TypeScript★ 5,510Aug 28, 2026
npm94Exceptionalhealth index
JavaScript★ 7,105↓ 13.5M/moAug 27, 2026
crates.io92Excellenthealth index

tracel-ai/cubeclMulti-platform high-performance compute language extension for Rust.
Rust★ 2,372↓ 942.9K/moSep 14, 2026
PyPI89Excellenthealth index
C++ · Python · C★ 227↓ 123.3K/moOct 21, 2026
npm87Excellenthealth index
JavaScript★ 22.6K↓ 113M/moSep 17, 2026
npm81Excellenthealth index
JavaScript★ 234↓ 20.8M/moAug 27, 2026
npm81Excellenthealth index
TypeScript★ 12↓ 43.1K/moSep 10, 2026
Python · C++ · Assembly★ 262Sep 13, 2026

ooples/AiDotNet.TensorsThe fastest .NET tensor library. Beats MathNet (6x), NumSharp (3200x), matches TorchSharp CPU - pure managed C# with hand-tuned AVX2/FMA SIMD kernels. Optional CUDA/OpenCL GPU acceleration.
C#★ 11Sep 6, 2026
crates.io69Goodhealth index
Rust★ 106↓ 3,222/moSep 19, 2026
npm63Moderatehealth index
TypeScript★ 20↓ 6,472/moSep 13, 2026

mbroemme/vdi-stream-clientVDI Stream Client is a very tiny, low latency and GPU accelerated client to connect to Windows running Parsec Host.
C★ 141Sep 18, 2026
npm53Moderatehealth index
JavaScript★ 32↓ 37M/moSep 15, 2026
Go · npm51Moderatehealth index

NexusGPU/gpu-goUse your GPUs like NFS. The agent and IDE extension of GPUGo product
Go · TypeScript★ 9Sep 20, 2026
C#★ 11Sep 14, 2026
C++★ 207Sep 13, 2026
Go · Shell★ 4Sep 14, 2026

dstackai/dstackA unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU clouds, Kubernetes, VMs, or bare-metal clusters.
Python · TypeScript★ 2,272Oct 8, 2026
Python★ 2,391Sep 13, 2026

pahen/madgeCreate graphs from your CommonJS, AMD or ES6 module dependencies
JavaScript★ 10.2K↓ 11.3M/moSep 17, 2026
JavaScript★ 52↓ 85.5K/moSep 29, 2026
TypeScript★ 0↓ 44/moSep 19, 2026

shibukawa/fm-index.jsxFM-index is the fastest full text search algorithm using a compressed index file. This is FM-index for JSX/JS/AMD/Common.js.
JavaScript★ 11↓ 42/moOct 20, 2026

ssube/onnx-webweb UI for GPU-accelerated ONNX pipelines like Stable Diffusion, even on Windows and AMD
Python · TypeScript★ 233↓ 12/moSep 12, 2026
JavaScript★ 49↓ 131M/moSep 16, 2026