#llm

Build an agent harness and control it end-to-end. Open-source SDK for production AI agents in Python & TypeScript - any model, any cloud.

Community maintained hardware plugin for vLLM on Huawei Ascend

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Build, run and scale AI agents like API and microservices

AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

The programming language for agents

GenBI (Generative BI) for AI agents, an open-source, governed text-to-SQL through an open context layer that turns natural-language questions into trusted dashboards, charts, and SQL across 20+ data sources, such as BigQuery, Snowflake, PostgreSQL, ClickHouse, Amazon Redshift, Databricks and more.

Build Conversational AI in minutes ⚡️

The Frontend Stack for Agents & Generative UI. React, Angular, Mobile, Slack, and more. Makers of the AG-UI Protocol

[EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

🎨 NeMo Data Designer: Generate high-quality synthetic data from scratch or from seed data.

RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.

TimeGPT-2.1: production ready pre-trained Time Series Foundation Model for forecasting and anomaly detection. Generative pretrained transformer for time series trained on over 100B data points. It's capable of accurately predicting various domains such as retail, electricity, finance, and IoT with just a few lines of code 🚀.

🚀 The fast, Pythonic way to build MCP servers and clients.

An open-source AI coding agent that lives in your terminal.

🤖 Type-safe, provider-agnostic TypeScript AI SDK for streaming chat, tool calling, agents, and multimodal apps across OpenAI, Anthropic, Gemini, React, Vue, Svelte, and Solid.

A React Rich Text Editor that's block-based (Notion style) and extensible. Built on top of Prosemirror and Tiptap.

Python SDK for ACP clients and agents.

ReMe: Memory Management Kit for Agents - Remember Me, Refine Me.

Build and run agents you can see, understand and trust.

Go ahead and axolotl questions

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

Accessible large language models via k-bit quantization for PyTorch.

Never stop coding. Free MIT AI gateway: one endpoint, 352 providers (150+ free), 1200+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 550+ contributors

Dynamiq is an orchestration framework for agentic AI and LLM applications

Open-source, secure environment with real-world tools for enterprise-grade agents.

Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.

Open-source framework for building agentic apps in JavaScript, Go, Dart, and Python, built and used in production by Google