PyPI · npm
Arize-ai/phoenix
AI Observability & Evaluation
Custom licenseAug 28, 2026 · metrics 2.10.0
All tags
Catalogue tag
#evals
Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.
29 records
PyPI · npm
pydantic/logfire
AI observability platform for production LLM and agent systems.
MITAug 27, 2026 · metrics 2.10.0
npm
mastra-ai/mastra
Mastra is the modern TypeScript framework for AI-powered applications and agents.
Custom licenseAug 5, 2026 · metrics 2.10.0
PyPI
langchain-ai/deepagents
The batteries-included agent harness.
MITAug 5, 2026 · metrics 2.10.0
PyPI · npm
harbor-framework/harbor
Framework for evaluating and improving agents
Apache-2.0Aug 27, 2026 · metrics 2.10.0
npm
MCPJam/inspector
Testing and evaluation platform to chat, inspect, and debug MCP servers, MCP apps, and ChatGPT apps.
Custom licenseJul 18, 2026 · metrics 2.10.0
PyPI
truera/trulens
Evaluation and Tracking for LLM Experiments and AI Agents
MITAug 6, 2026 · metrics 2.10.0
PyPI · npm
UiPath/coder_eval
Test that your Claude Code skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, activation checks, A/B experiments, CI gates.
Apache-2.0Aug 19, 2026 · metrics 2.10.0
npm
nearform/lastlight
Self-hostable, MIT Licensed, Enterprise AI Software Factory
MITJul 26, 2026 · metrics 2.10.0
PyPI · npm
AgentOps-AI/agentops
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI
MITAug 28, 2026 · metrics 2.10.0
PyPI
benchflow-ai/benchflow
Research infra for creating RL environments, post-training, and evals.
Apache-2.0Aug 9, 2026 · metrics 2.10.0
npm
o-stepper/graphorin
Project Graphorin is a TypeScript framework for personal AI assistants and long-living agents with rich memory, durable workflow, and observability out of the box.
MITAug 1, 2026 · metrics 2.10.0
Go
realkarych/catacomb
Regression testing for Claude Code and Codex agents.
Apache-2.0Jul 20, 2026 · metrics 2.10.0
PyPI
attenlabs/hotato
Find what broke in your agent calls. Pin it so it never ships again. Local voice-agent call forensics and regression guards.
MITAug 22, 2026 · metrics 2.10.0
npm
getlarge/themoltnet
Trusted context for AI agents
AGPL-3.0Jul 30, 2026 · metrics 2.10.0
PyPI
superlinear-ai/raglite
🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL
MPL-2.0Aug 10, 2026 · metrics 2.10.0
npm
zernie/vigiles
Like Lighthouse for your agent harness - verify your CLAUDE.md/AGENTS.md, skills & hooks are real, then test and measure they actually work. Claude Code + Codex.
MITJul 19, 2026 · metrics 2.10.0
PyPI
kensa-sh/kensa
Kensa turns agent traces into evals that run in CI.
Apache-2.0Jul 23, 2026 · metrics 2.10.0
Packagist
pestphp/pest-plugin-evals
Pest Browser Evals
MITAug 4, 2026 · metrics 2.10.0
Hex
aryaminus/controlkeel
Agent control plane for governed AI coding: validate changes, enforce policy gates, track findings, proofs, and evals based on your habits.
Custom licenseJul 17, 2026 · metrics 2.10.0
npm
shulmansj/teami
Control plane for orchestrating, evaluating, and improving agent work across a company
Custom licenseJul 30, 2026 · metrics 2.10.0
npm
spences10/my-pi
Composable Pi coding agent with MCP, LSP, agent chains, prompt presets, and local eval telemetry
MITJul 18, 2026 · metrics 2.10.0
Go
farazhassan/gantry
A tiny testable, Go-native agent runtime for teams that want control, conformance, and no framework lock-ins.
MITJul 18, 2026 · metrics 2.10.0
npm
inferock/inferock-bench
Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage, failure, and billing-integrity receipts.
Custom licenseJul 29, 2026 · metrics 2.10.0
npm
mykim-aus/hey-llm-you-okay
Hey LLM, you okay? — pyramid-ordered LLM testing CLI for CI/CD. One YAML for every layer, LLM-as-a-judge gates, and A/B triage that tells prompt regressions from model drift.
MITJul 30, 2026 · metrics 2.10.0
npm
HolocronLab/botruntime-packages
botruntime public packages. Consumed by the botruntime platform.
No licenseJul 29, 2026 · metrics 2.10.0
npm
LilMGenius/paperthin
Low-level agentic design patterns. Turning old engineering wisdom into reflexes your agent reaches for on its own—on any agent.
MITJul 31, 2026 · metrics 2.10.0
npm
eigenpal/cli
Create, evaluate, and deploy workflows from your terminal. Agent-ready.
Apache-2.0Jul 18, 2026 · metrics 2.10.0
PyPI
splox-ai/python-sdk
Official Splox SDK
MITJul 16, 2026 · metrics 2.10.0