crates.io98Exceptionalhealth index

gfx-rs/wgpuA cross-platform, safe, pure-Rust graphics API.
Rust · WGSL★ 17.9K↓ 10.2M/moAug 28, 2026
crates.io95Exceptionalhealth index

tracel-ai/burnBurn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.
Rust★ 15.9K↓ 747.6K/moSep 16, 2026
PyPI94Exceptionalhealth index

tenstorrent/tt-metal:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.
C++ · Python★ 1,664↓ 3,649/moSep 9, 2026
crates.io92Excellenthealth index

tracel-ai/cubeclMulti-platform high-performance compute language extension for Rust.
Rust★ 2,372↓ 942.9K/moSep 14, 2026
Go90Excellenthealth index
Go★ 180Sep 10, 2026
PyPI89Excellenthealth index
C++ · Python · C★ 227↓ 123.3K/moOct 21, 2026
Go89Excellenthealth index

defilantech/LLMKubeKubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
Go★ 207Sep 5, 2026
crates.io89Excellenthealth index
Rust · C++★ 1,811↓ 606.2K/moSep 7, 2026
PyPI88Excellenthealth index

pygfx/pygfxPowerful and versatile visualization for Python.
Python · WGSL★ 880↓ 27.4K/moOct 14, 2026
PyPI · npm87Excellenthealth index

rajveer43/VeloxQuant-MLXFast KV-cache quantization for Apple Silicon (MLX) — 43 research-adapted compression methods with Metal kernels
Python★ 32↓ 14.1K/moOct 21, 2026
crates.io87Excellenthealth index

raphamorim/rioA hardware-accelerated GPU terminal emulator focusing to run in desktops and browsers.
Rust★ 7,409↓ 19K/moAug 28, 2026
npm87Excellenthealth index

withcatai/node-llama-cppRun AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
TypeScript★ 2,162↓ 3.6M/moAug 27, 2026
Go84Excellenthealth index
Go★ 12Sep 13, 2026
crates.io · npm · PyPI84Excellenthealth index
Rust · Python★ 45↓ 42.9K/moOct 20, 2026
PyPI · npm81Excellenthealth index
Python · C++ · HTML★ 5↓ 2,537/moOct 3, 2026
Go80Excellenthealth index

gogpu/nagaPure Go Shader Compiler — WGSL to SPIR-V, MSL, GLSL, HLSL, DXIL. Zero CGO.
Go★ 51Sep 24, 2026
npm80Excellenthealth index
C++★ 1,422↓ 54.3K/moOct 10, 2026
PyPI · npm80Excellenthealth index

youssofal/MTPLX3x faster speeds on MLX | Qwen 3.8 27B | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.
Python · Swift★ 2,329↓ 9,464/moSep 15, 2026

go-webgpu/webgpuZero-CGO WebGPU bindings for Go — GPU-accelerated graphics and compute in pure Go
Go★ 59Aug 27, 2026

gogpu/g3dPure Go 3D rendering library. Scene graph, PBR, GLTF. Zero CGO. Built on gogpu/wgpu.
Go★ 26Sep 25, 2026
npm · crates.io78Goodhealth index
Rust · TypeScript★ 157↓ 1,570/moSep 16, 2026
Python · Objective-C★ 815↓ 4.4M/moSep 10, 2026
crates.io77Goodhealth index

frames-sg/j2kRust JPEG 2000 / HTJ2K codec with CUDA and Metal GPU paths.
Rust★ 6↓ 6,723/moSep 30, 2026

hybridgroup/yzmaGo with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
Go★ 597Sep 9, 2026
Maven · npm75Goodhealth index
Java★ 175Oct 19, 2026

iyulab/lm-supply.NET library for on-demand local AI model inference — zero bundled models, lazy loading, hardware-aware GPU/CPU selection, 10 task types including embeddings, generation, vision, and audio.
C# · TypeScript★ 12Sep 10, 2026

tillahoffmann/jax-mpsA JAX backend for Apple Metal Performance Shaders (MPS), enabling GPU-accelerated JAX computations on Apple Silicon.
C++ · Python★ 222↓ 1,401/moSep 10, 2026

ARahim3/mlx-dsparkUp to 4× faster LLM decoding on Apple Silicon, lossless. Native MLX port of DeepSeek's DSpark & z-lab's DFlash speculative decoding — Gemma-4, Qwen3.8, Muse-Glimmer, Nemotron, LFM2.5, Ornith-1.0, ternary Bonsai-27B.
Python · Swift★ 719↓ 2,266/moOct 19, 2026

asher/mlx-kquantNative K-quant support for MLX, with a quantization and fine-tuning toolchain for Apple Silicon
C++ · Python★ 6↓ 3,360/moAug 23, 2026

ooples/AiDotNet.TensorsThe fastest .NET tensor library. Beats MathNet (6x), NumSharp (3200x), matches TorchSharp CPU - pure managed C# with hand-tuned AVX2/FMA SIMD kernels. Optional CUDA/OpenCL GPU acceleration.
C#★ 11Sep 6, 2026