All tags
Catalogue tag

#agent-evaluation

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

11 records
Tagged “agent-evaluation”Ranked by health index
PyPI
97Exceptionalhealth index
Giskard-AI/giskard-oss
🐢 Open-Source Evaluation & Testing library for LLM Agents
Python★ 5,775Aug 28, 2026
Apache-2.0Aug 28, 2026 · metrics 2.10.0
PyPI
94Exceptionalhealth index
truera/trulens
Evaluation and Tracking for LLM Experiments and AI Agents
Python★ 3,561Sep 17, 2026
MITSep 17, 2026 · metrics 2.10.0
PyPI · npm
92Excellenthealth index
UiPath/coder_eval
Playwright for coding agents. Test that your skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, A/B experiments, CI gates.
Python · TypeScript★ 152↓ 7,982/moOct 19, 2026
Apache-2.0Oct 19, 2026 · metrics 2.10.0
PyPI · npm
87Excellenthealth index
hidai25/eval-view
Regression testing for AI agents. Snapshot behavior,diff tool calls,catch regressions in CI. Works with LangGraph, CrewAI, OpenAI, Anthropic.
Python★ 134↓ 2,093/moSep 13, 2026
Apache-2.0Sep 13, 2026 · metrics 2.10.0
PyPI
84Excellenthealth index
benchflow-ai/benchflow
Research infra for creating RL environments, post-training, and evals.
Python★ 349↓ 14.3K/moSep 17, 2026
Apache-2.0Sep 17, 2026 · metrics 2.10.0
PyPI · npm
80Excellenthealth index
alizahidraja/isnad
Grade every agent, scraper and model in a claim's chain — provenance, trust scoring and audit evidence for LLM pipelines
Python★ 53↓ 2,089/moOct 21, 2026
Apache-2.0Oct 21, 2026 · metrics 2.10.0
PyPI
78Goodhealth index
scaleapi/agentenv-framework
Creating realistic RL environments requires collaboration between researchers, engineers, and domain experts across many dimensions: artifacts, environments tools, dynamism of the environment, reproducibility, and more. There is no open source framework for building these environments effectively. Until now.
Python · TypeScript★ 27↓ 3,086/moOct 6, 2026
Apache-2.0Oct 6, 2026 · metrics 2.10.0
Go · PyPI
62Moderatehealth index
scoutme/milk
milk — a CLI/TUI that routes prompts between agents: a primary agent and a configurable escalation agent, with session-aware state management and real-time streaming. Escalation happens automatically (via routing rules) or manually, preserving context across the handoff between agents.
Go★ 6Sep 17, 2026
MITSep 17, 2026 · metrics 2.10.0
PyPI
59Moderatehealth index
dalmia/calibrate-python-sdk
Python SDK for Calibrate's API
Python★ 0↓ 3,013/moSep 20, 2026
MITSep 20, 2026 · metrics 2.10.0
PyPI
59Moderatehealth index
mrwersa/agentverity
Qualify repeated categorical AI-agent evidence before it becomes a regression reference
Python★ 2Sep 16, 2026
Apache-2.0Sep 16, 2026 · metrics 2.10.0
PyPI · npm · crates.io
19Criticalhealth index
SynthiaResearch/synthia-sdk
Synthia SDKs (npm + PyPI: synthiaresearch) and the synthia CLI — eval your AI agent against simulated users
TypeScript · Rust · Python★ 0↓ 259/moSep 13, 2026
MITSep 13, 2026 · metrics 2.10.0