PyPI88Excellenthealth index

NVIDIA/TensorRTNVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
C++★ 13.3K↓ 1M/moAug 27, 2026
PyPI88Excellenthealth index

NVIDIA/ncclOptimized primitives for collective multi-GPU communication
C++ · Cuda · C★ 5,098↓ 634.8K/moSep 17, 2026
crates.io · PyPI88Excellenthealth index

NVlabs/cutile-rscuTile Rust provides a safe, tile-based kernel programming DSL for the Rust programming language. It features a safe host-side API for passing tensors to asynchronously executed kernel functions.
Rust★ 774↓ 11.5K/moSep 7, 2026
Go87Excellenthealth index

NexusGPU/tensor-fusionTensor Fusion is a state-of-the-art GPU virtualization and pooling solution designed to optimize GPU cluster utilization to its fullest potential.
Go★ 163Sep 9, 2026
PyPI86Excellenthealth index

XuehaiPan/nvitopAn interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.
Python★ 7,153↓ 335.3K/moSep 17, 2026
npm86Excellenthealth index
HTML · JavaScript★ 2,683↓ 11.2K/moSep 13, 2026
crates.io84Excellenthealth index
Rust★ 6↓ 23.3K/moSep 8, 2026
crates.io83Excellenthealth index

altunenes/parakeet-rsvery fast speech-to-text, diarization, streaming (even in CPU) with NVIDIA Parakeet in Rust
Rust★ 393↓ 18.8K/moSep 14, 2026
crates.io83Excellenthealth index
Rust · Cuda★ 6↓ 16.1K/moOct 20, 2026
Go · npm83Excellenthealth index

kdeps/kdepsAI Appliance Builder - YAML-defined AI agents and workflow pipelines. Ship as Docker, K8s, ISO, or a single binary.
Go★ 37Sep 13, 2026
Go · npm83Excellenthealth index
Go · TypeScript · MDX★ 554Sep 14, 2026
npm · PyPI81Excellenthealth index
TypeScript · Python · JavaScript★ 16↓ 3,366/moSep 18, 2026
PyPI80Excellenthealth index

Mandark-droid/genai_otel_instrumentGenAI OpenTelemetry Auto-Instrumentation Library A comprehensive wrapper for automatic instrumentation of LLM/GenAI applications Supports all major LLM providers and MCP (Model Context Protocol) tool calls
Python★ 3↓ 1,768/moOct 21, 2026
Python★ 13↓ 4,163/moOct 19, 2026
crates.io78Goodhealth index

NexusGPU/vgpu.rsvgpu.rs is the fractional GPU & vgpu-hypervisor implementation written in Rust
Rust★ 38Sep 14, 2026
TypeScript★ 16↓ 53.9K/moOct 21, 2026

CVCUDA/CV-CUDACV-CUDA™ is an open-source, GPU accelerated library for cloud-scale image processing and computer vision.
C++ · Cuda · Python★ 2,731Oct 20, 2026

KevRojo/DulusDulus Ai — Free Agentic AI, Making Gemini web cappable of running bash commands in your terminal! [Gui, Web, Cli, Telegram, 2,000 MCP, 100K Skills . LiteLLM (100+ providers), local models via Ollama, /lang in 34 languages, Mesa Redonda, I create the first utility coin that can be used 100% as AI quota or Fuel, is called $Dulus
Python★ 358↓ 7,957/moSep 5, 2026
crates.io · PyPI77Goodhealth index

avencera/speakrsSpeaker diarization in Rust with pyannote-level accuracy. 900–1940x realtime on NVIDIA GPUs, 430–910x on Apple Silicon.
Rust★ 135↓ 2,026/moOct 18, 2026
crates.io77Goodhealth index
Rust★ 1,222↓ 1.1M/moSep 18, 2026

baldwinSPC/glimmer-burninVendor-neutral, Kubernetes-native GPU/accelerator hardware acceptance testing (burn-in). Standalone; integrates via BurnInSink.
Go · C++★ 2Oct 18, 2026

arcships/light-ocrFast, offline OCR for Node.js & C++. PP-OCRv6 with Core ML / WebGPU hardware acceleration — recognize text in images with confidence scores & coordinates. npm: @arcships/light-ocr
C++ · JavaScript★ 503↓ 9,966/moSep 15, 2026
C++★ 4,795↓ 101.9K/moOct 15, 2026

eitamring/gocudrvCUDA driver API in pure Go, no cgo: loads libcuda at runtime, embeds PTX, JIT-compiles through the driver
Go★ 21Sep 10, 2026

ooples/AiDotNet.TensorsThe fastest .NET tensor library. Beats MathNet (6x), NumSharp (3200x), matches TorchSharp CPU - pure managed C# with hand-tuned AVX2/FMA SIMD kernels. Optional CUDA/OpenCL GPU acceleration.
C#★ 11Sep 6, 2026

nvpro-samples/vk_gltf_rendererVulkan ray tracing glTF 2.0 renderer — RTX path tracer with PBR materials, AI denoising (DLSS, OptiX), and scene editing. NVIDIA open-source sample.
C++★ 414Sep 13, 2026
Go · PyPI67Goodhealth index

santimillang/ghostgpuSimulate GPU clusters on Kubernetes. Test GPU-aware schedulers, autoscalers and platform tooling with zero GPU hardware.
Go★ 4Sep 20, 2026
TypeScript★ 414↓ 1,935/moOct 21, 2026
PyPI63Moderatehealth index

NVIDIA-Omniverse/ovstageA C and Python library providing a shared, high-performance, vectorized, GPU-capable scene data substrate for OpenUSD data across Omniverse Libraries (physics, rendering, sensors, animation).
Python · C · C++★ 19↓ 110.8K/moOct 15, 2026
PyPI62Moderatehealth index

PursuitOfDataScience/slurmwatchLive per-process CPU / memory / GPU telemetry for a running Slurm job — see whether you're actually using what you requested.
Python★ 0↓ 2,082/moSep 11, 2026