Alle Tags
Katalog-Tag

#agent-evaluation

Alle Repositories im öffentlichen Register, die dieses Tag tragen — aus ihren GitHub-Topics oder den von ihren Paket-Registries veröffentlichten Schlagwörtern. Die Gesundheit wird nach derselben versionierten Methodik gemessen wie im übrigen Register.

11 Einträge
Getaggt als „agent-evaluation“Geordnet nach Gesundheitsindex
PyPI
97AußergewöhnlichGesundheitsindex
Giskard-AI/giskard-oss
🐢 Open-Source Evaluation & Testing library for LLM Agents
Python★ 5.77528. Aug. 2026
Apache-2.028. Aug. 2026 · Metriken 2.10.0
PyPI
94AußergewöhnlichGesundheitsindex
truera/trulens
Evaluation and Tracking for LLM Experiments and AI Agents
Python★ 3.56117. Sept. 2026
MIT17. Sept. 2026 · Metriken 2.10.0
PyPI · npm
92ExzellentGesundheitsindex
UiPath/coder_eval
Playwright for coding agents. Test that your skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, A/B experiments, CI gates.
Python · TypeScript★ 152↓ 7.982/Monat19. Okt. 2026
Apache-2.019. Okt. 2026 · Metriken 2.10.0
PyPI · npm
87ExzellentGesundheitsindex
hidai25/eval-view
Regression testing for AI agents. Snapshot behavior,diff tool calls,catch regressions in CI. Works with LangGraph, CrewAI, OpenAI, Anthropic.
Python★ 134↓ 2.093/Monat13. Sept. 2026
Apache-2.013. Sept. 2026 · Metriken 2.10.0
PyPI
84ExzellentGesundheitsindex
benchflow-ai/benchflow
Research infra for creating RL environments, post-training, and evals.
Python★ 349↓ 14.3K/Monat17. Sept. 2026
Apache-2.017. Sept. 2026 · Metriken 2.10.0
PyPI · npm
80ExzellentGesundheitsindex
alizahidraja/isnad
Grade every agent, scraper and model in a claim's chain — provenance, trust scoring and audit evidence for LLM pipelines
Python★ 53↓ 2.089/Monat21. Okt. 2026
Apache-2.021. Okt. 2026 · Metriken 2.10.0
PyPI
78GutGesundheitsindex
scaleapi/agentenv-framework
Creating realistic RL environments requires collaboration between researchers, engineers, and domain experts across many dimensions: artifacts, environments tools, dynamism of the environment, reproducibility, and more. There is no open source framework for building these environments effectively. Until now.
Python · TypeScript★ 27↓ 3.086/Monat6. Okt. 2026
Apache-2.06. Okt. 2026 · Metriken 2.10.0
Go · PyPI
62MittelGesundheitsindex
scoutme/milk
milk — a CLI/TUI that routes prompts between agents: a primary agent and a configurable escalation agent, with session-aware state management and real-time streaming. Escalation happens automatically (via routing rules) or manually, preserving context across the handoff between agents.
Go★ 617. Sept. 2026
MIT17. Sept. 2026 · Metriken 2.10.0
PyPI
59MittelGesundheitsindex
dalmia/calibrate-python-sdk
Python SDK for Calibrate's API
Python★ 0↓ 3.013/Monat20. Sept. 2026
MIT20. Sept. 2026 · Metriken 2.10.0
PyPI
59MittelGesundheitsindex
mrwersa/agentverity
Qualify repeated categorical AI-agent evidence before it becomes a regression reference
Python★ 216. Sept. 2026
Apache-2.016. Sept. 2026 · Metriken 2.10.0
PyPI · npm · crates.io
19KritischGesundheitsindex
SynthiaResearch/synthia-sdk
Synthia SDKs (npm + PyPI: synthiaresearch) and the synthia CLI — eval your AI agent against simulated users
TypeScript · Rust · Python★ 0↓ 259/Monat13. Sept. 2026
MIT13. Sept. 2026 · Metriken 2.10.0