#gpu

cuDF - GPU DataFrame Library

Ongoing research training transformer models at scale

NVIDIA cuML: GPU-Accelerated Machine Learning

A Python framework for GPU-accelerated simulation, robotics, and machine learning.

Open ABI and FFI for Machine Learning Systems

NumPy & SciPy for GPU

A cross-platform, safe, pure-Rust graphics API.

On-device AI across mobile, embedded and edge for PyTorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

FlashInfer: Kernel Library for LLM Serving

Tooling for optimized, validated, and reproducible GPU-accelerated AI runtime in Kubernetes

CUDA Core Compute Libraries

RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.

Accessible large language models via k-bit quantization for PyTorch.

🌊 Julia software for fast, friendly, flexible, ocean-flavored fluid dynamics on CPUs and GPUs

Offline optimization of your disaggregated Dynamo graph

Time series forecasting with PyTorch

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

GPU-capable global atmosphere model of the CliMA Earth System Model, designed for calibration with data assimilation and machine learning

CUDA Templates and Python DSLs for High-Performance Linear Algebra

Main repository for QMCPACK, an open-source production level many-body ab initio Quantum Monte Carlo code for computing the electronic structure of atoms, molecules, and solids with full performance portable GPU support

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.