PyPI · npm
Arize-ai/phoenix
AI Observability & Evaluation
Custom licenseAug 28, 2026 · metrics 2.10.0
All tags
Catalogue tag
#llmops
Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.
57 records
PyPI · npm
Agenta-AI/agenta
Agenta is a workspace where you and your team build agents and automations.
Custom licenseAug 28, 2026 · metrics 2.10.0
PyPI · npm
ComposioHQ/composio
Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.
MITAug 5, 2026 · metrics 2.10.0
PyPI
Netflix/metaflow
Build, Manage and Deploy AI/ML Systems
Apache-2.0Aug 12, 2026 · metrics 2.10.0
npm · Go
langwatch/langwatch
The platform for LLM evaluations and AI agent testing
Apache-2.0Aug 13, 2026 · metrics 2.10.0
PyPI
Giskard-AI/giskard-oss
🐢 Open-Source Evaluation & Testing library for LLM Agents
Apache-2.0Aug 28, 2026 · metrics 2.10.0
Go · npm
maximhq/bifrost
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
Apache-2.0Aug 28, 2026 · metrics 2.10.0
PyPI
zenml-io/zenml
ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.
Apache-2.0Aug 13, 2026 · metrics 2.10.0
PyPI
bentoml/BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
Apache-2.0Aug 12, 2026 · metrics 2.10.0
npm · PyPI
comet-ml/opik
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
Apache-2.0Aug 5, 2026 · metrics 2.10.0
PyPI
dynamiq-ai/dynamiq
Dynamiq is an orchestration framework for agentic AI and LLM applications
Apache-2.0Jul 18, 2026 · metrics 2.10.0
npm
promptfoo/promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
MITAug 5, 2026 · metrics 2.10.0
PyPI · crates.io · npm
BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Custom licenseAug 4, 2026 · metrics 2.10.0
crates.io
0xPlaygrounds/rig
⚙️🦀 Build modular and scalable LLM Applications in Rust
MITAug 28, 2026 · metrics 2.10.0
PyPI · Go · Maven +1
Arize-ai/openinference
OpenTelemetry Instrumentation for AI Observability
Apache-2.0Aug 27, 2026 · metrics 2.10.0
npm
langfuse/langfuse
🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
Custom licenseAug 5, 2026 · metrics 2.10.0
npm · PyPI · Go
openlit/openlit
Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.
Apache-2.0Aug 13, 2026 · metrics 2.10.0
PyPI · npm
traceloop/openllmetry
Open-source observability for your GenAI or LLM application, based on OpenTelemetry
Apache-2.0Aug 27, 2026 · metrics 2.10.0
PyPI
clearml/clearml
ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
Apache-2.0Aug 12, 2026 · metrics 2.10.0
PyPI
Portkey-AI/portkey-python-sdk
Build reliable, secure, and production-ready AI apps easily.
MITAug 5, 2026 · metrics 2.10.0
PyPI · npm
evidentlyai/evidently
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
Apache-2.0Aug 12, 2026 · metrics 2.10.0
PyPI
truera/trulens
Evaluation and Tracking for LLM Experiments and AI Agents
MITAug 6, 2026 · metrics 2.10.0
PyPI · npm
UiPath/coder_eval
Test that your Claude Code skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, activation checks, A/B experiments, CI gates.
Apache-2.0Aug 19, 2026 · metrics 2.10.0
PyPI
vibrantlabsai/ragas
Supercharge Your LLM Application Evaluations 🚀
Apache-2.0Aug 8, 2026 · metrics 2.10.0
npm
Portkey-AI/gateway
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
MITAug 27, 2026 · metrics 2.10.0
Go
ferro-labs/ai-gateway
Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gateway LiteLLM & Kong AI Gateway alternative.
Apache-2.0Jul 17, 2026 · metrics 2.10.0
PyPI
MakazhanAlpamys/Soup
Soup turns the pain of LLM fine-tuning into a simple workflow. One config, one command, done.
Apache-2.0Jul 15, 2026 · metrics 2.10.0
PyPI
runtm-ai/runtm
Open-source sandboxes where coding agents build and deploy. Spin up isolated environments where Claude Code, Cursor, and other agents code and deploy software.
Custom licenseJul 27, 2026 · metrics 2.10.0
npm
GeiserX/LynxPrompt
Self-hosted & federated platform for AI IDE/Tools Rules and Commands via WebUI & CLI - Generate, browse, store, share AGENTS.md, CLAUDE.md, and more
Apache-2.0Sep 5, 2026 · metrics 2.10.0
crates.io · npm · PyPI
intentee/paddler
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
Apache-2.0Jul 23, 2026 · metrics 2.10.0