#diffusers

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

A SOTA quantization toolkit for high-accuracy low-bit LLM inference|简洁且高效的量化工具包

Apple MLX native implementations of state-of-the-art generative image & video models