#gpu

Accessible large language models via k-bit quantization for PyTorch.

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

CUDA Core Compute Libraries

A Python framework for GPU-accelerated simulation, robotics, and machine learning.

🌊 Julia software for fast, friendly, flexible, ocean-flavored fluid dynamics on CPUs and GPUs

Tooling for optimized, validated, and reproducible GPU-accelerated AI runtime in Kubernetes

GPU-capable global atmosphere model of the CliMA Earth System Model, designed for calibration with data assimilation and machine learning

Main repository for QMCPACK, an open-source production level many-body ab initio Quantum Monte Carlo code for computing the electronic structure of atoms, molecules, and solids with full performance portable GPU support

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

CUDA Templates and Python DSLs for High-Performance Linear Algebra

A cross-platform, OpenGL terminal emulator.

GPUd automates monitoring, diagnostics, and issue identification for GPUs

DSL and compiler framework for automated finite-differences and stencil computation

rapids-singlecell: GPU-accelerated framework for scRNA analysis

cuTile is a programming model for writing parallel kernels for NVIDIA GPUs

Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference

Platform for deploying and routing GPU-accelerated inference, streaming, and batch workloads at scale.

Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.

The fastai deep learning library

Pure Go GPU Application Framework — windowing, input, lifecycle, platform abstraction. Part of the GoGPU ecosystem.

cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.

Pure Go WebGPU Implementation

📸 A powerful, high-performance React Native Camera library.