#llm

The agent engineering platform

Framework to build resilient language agents as graphs.

The platform for LLM evaluations and AI agent testing

Mastra is the modern TypeScript framework for AI-powered applications and agents.

Universal memory layer for AI Agents

Integrate cutting-edge LLM technology quickly and easily into your apps

The official Python SDK for Model Context Protocol servers and clients

The open-source communication infrastructure for agents and products

SGLang is a high-performance serving framework for large language models and multimodal models.

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

🐢 Open-Source Evaluation & Testing library for LLM Agents

Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!

LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.

Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

Open Source AI Platform - AI Chat with advanced features that works with every LLM

Manage state with style in every framework

Redis Vector Library (RedisVL) -- the AI-native Python client for Redis.

Build an agent harness and control it end-to-end. Open-source SDK for production AI agents in Python & TypeScript - any model, any cloud.

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨

The programming language for agents

GenBI (Generative BI) for AI agents, an open-source, governed text-to-SQL through an open context layer that turns natural-language questions into trusted dashboards, charts, and SQL across 20+ data sources, such as BigQuery, Snowflake, PostgreSQL, ClickHouse, Amazon Redshift, Databricks and more.

Build Conversational AI in minutes ⚡️

The Frontend Stack for Agents & Generative UI. React, Angular, Mobile, Slack, and more. Makers of the AG-UI Protocol

[EMNLP2025] "LightRAG: Simple and Fast Retrieval-Augmented Generation"

Koog is a JVM (Java and Kotlin) framework for building predictable, fault-tolerant and enterprise-ready AI agents across all platforms – from backend services to Android and iOS, JVM, and even in-browser environments. Koog is based on our AI products expertise and provides proven solutions for complex LLM and AI problems

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support