#large-language-models

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Ongoing research training transformer models at scale

Langflow is a powerful tool for building and deploying AI-powered agents and workflows.

Redis Vector Library (RedisVL) -- the AI-native Python client for Redis.

[EMNLP2025] "LightRAG: Simple and Fast Retrieval-Augmented Generation"

Build and run agents you can see, understand and trust.

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

Custom AI agent platform to speed up your work.

🚀 Efficient implementations for emerging model architectures

🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

Efficient in-memory representation for ONNX, in Python

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Evaluate and improve models and agents using environments

Chronos: Pretrained Models for Time Series Forecasting

A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.

Fast, Flexible and Portable Structured Generation