#cuda

cuDF - GPU DataFrame Library

A high-throughput and memory-efficient inference and serving engine for LLMs

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

CUDA Core Compute Libraries

NVIDIA cuML: GPU-Accelerated Machine Learning

A Python framework for GPU-accelerated simulation, robotics, and machine learning.

NumPy & SciPy for GPU

PyTorch native quantization for training and inference

NVIDIA RMM is a library for allocating and managing GPU memory in C++ and Python.

Containers for machine learning

SGLang is a high-performance serving framework for large language models and multimodal models.

FlashInfer: Kernel Library for LLM Serving

cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.

RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

A retargetable MLIR-based machine learning compiler and runtime toolkit.

Making it easier to work with shaders

Multilingual neural TTS (6 languages: JA/EN/ZH/ES/FR/PT, code supports SV) — C++, C#, Rust, Go, Python, npm (WASM). VITS + Prosody, streaming, CUDA/CoreML/DirectML. pip install piper-plus | npm install piper-plus | cargo install piper-plus-cli

DaCe - Data Centric Parallel Programming

Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels

Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.

The NVIDIA® Tools Extension SDK (NVTX) is a C-based Application Programming Interface (API) for annotating events, code ranges, and resources in your applications.

CUDA Templates and Python DSLs for High-Performance Linear Algebra

Main repository for QMCPACK, an open-source production level many-body ab initio Quantum Monte Carlo code for computing the electronic structure of atoms, molecules, and solids with full performance portable GPU support

An electronic structure package based on either plane wave basis or numerical atomic orbitals.

Open security scanner and self-hosted control plane for AI, MCP, and cloud. One evidence model — run scans in your environment, centralize findings, govern in your VPC.

Pytorch domain library for recommendation systems

Open security scanner and self-hosted control plane for AI, MCP, and cloud. One evidence model — run scans in your environment, centralize findings, govern in your VPC.

PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT