#pytorch

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

Open standard for machine learning interoperability

The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.

🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.

The official CLI and Python client for the Hugging Face Hub.

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Ultralytics YOLO27, YOLO26, YOLO11, YOLOv8 — object detection, instance segmentation, semantic segmentation, image classification, pose estimation, object tracking

A high-throughput and memory-efficient inference and serving engine for LLMs

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

Ongoing research training transformer models at scale

Scalable and user friendly neural :brain: forecasting algorithms.

PennyLane is an open-source quantum software platform for quantum computing, quantum machine learning, and quantum chemistry. Create meaningful quantum algorithms, from inspiration to implementation.

AI Toolkit for Healthcare Imaging

Fast and Accurate ML in 3 Lines of Code

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Deep Learning for humans

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

Neural Network Compression Framework for enhanced OpenVINO™ inference

PyTorch native quantization for training and inference

On-device AI across mobile, embedded and edge for PyTorch

High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Containers for machine learning

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

FlashInfer: Kernel Library for LLM Serving

🐍 Geometric Computer Vision Library for Spatial AI

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.