#llm

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

The agent engineering platform.

The agent engineering platform

Build resilient agents.

Framework to build resilient language agents as graphs.

The platform for LLM evaluations and AI agent testing

Mastra is the modern TypeScript framework for AI-powered applications and agents.

The Memory Layer for AI Agents - Drop-in memory infrastructure for AI agents and apps. Context that persists. Built for production.

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

The official C# SDK for Model Context Protocol servers and clients. Maintained in collaboration with Microsoft.

The official Python SDK for Model Context Protocol servers and clients

The open-source communication infrastructure for agents and products

A lightweight, powerful framework for multi-agent workflows

Neural Network Compression Framework for enhanced OpenVINO™ inference

A community-supported supercharged document management system: scan, index and archive all your documents

SGLang is a high-performance serving framework for large language models and multimodal models.

A set of tools that gives agents powerful capabilities.

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

🐢 Open-Source Evaluation & Testing library for LLM Agents

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Scalable data pre processing and curation toolkit for LLMs

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!

LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.

Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

Manage state with style in every framework

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

Redis Vector Library (RedisVL) -- the AI-native Python client for Redis.

High-performance, privacy-first on-device AI inference library for React Native, powered by PyTorch's ExecuTorch runtime