#gpu

Vector search engine inside Milvus, integrating FAISS, HNSW, DiskANN.

Interactive data visualizations and plotting in Julia

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

Notebook images for ODH

DSL and compiler framework for automated finite-differences and stencil computation

Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference

Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Server models.

Platform for deploying and routing GPU-accelerated inference, streaming, and batch workloads at scale.

Scalene: a high-performance, high-precision CPU, GPU, and memory profiler for Python with AI-powered optimization proposals

📊 Simple package for monitoring and control your NVIDIA Jetson [Orin, Xavier, Nano, TX] series

rapids-singlecell: GPU-accelerated framework for scRNA analysis

Modular, GPU-capable land surface model of the CliMA Earth System Model, designed for data-driven parameterizations

cuTile is a programming model for writing parallel kernels for NVIDIA GPUs

Aer is a high performance simulator for quantum circuits that includes noise models

Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.

The fastai deep learning library

Pure Go GPU Application Framework — windowing, input, lifecycle, platform abstraction. Part of the GoGPU ecosystem.

Pure Go WebGPU Implementation

MC/DC: Monte Carlo Dynamic Code

Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.

Hundreds of models & providers. One command to find what runs on your hardware.

The Arbor multi-compartment neural network simulation library.

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

📸 A powerful, high-performance React Native Camera library.

Next Generation Machine Learning, Statistics and Deep Learning in PURE Rust

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Mesh optimization library that makes meshes smaller and faster to render

Tensor Fusion is a state-of-the-art GPU virtualization and pooling solution designed to optimize GPU cluster utilization to its fullest potential.

Performance-portable geometric search library