#gpu

GPUd automates monitoring, diagnostics, and issue identification for GPUs

Multi-platform high-performance compute language extension for Rust.

Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Server models.

Hundreds of models & providers. One command to find what runs on your hardware.

Interactive data visualizations and plotting in Julia

Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.

Notebook images for ODH

📊 Simple package for monitoring and control your NVIDIA Jetson [Orin, Xavier, Nano, TX] series

:pen: Extensions to ImageSharp containing a cross-platform 2D polygon manipulation API and drawing operations.

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

Pure Go GPU Application Framework — windowing, input, lifecycle, platform abstraction. Part of the GoGPU ecosystem.

Pure Go WebGPU Implementation

Scalene: a high-performance, high-precision CPU, GPU, and memory profiler for Python with AI-powered optimization proposals

KEDA External gRPC Scaler for GPU workloads - native NVML metrics via DaemonSet, no Prometheus required

rapids-singlecell: GPU-accelerated framework for scRNA analysis

A modular and open-ended toolkit for WebGPU, with advanced type inference and the ability to write shaders in TypeScript

High-performance multi-platform compiler for physics simulation

Official CLI and Python SDK for Prime Intellect - access GPU compute, remote sandboxes, RL environments, and distributed training infrastructure for AI development at scale.

Molecular dynamics and Monte Carlo soft matter simulation on GPUs.

Next Generation Machine Learning, Statistics and Deep Learning in PURE Rust