PyPI · npm · Go
openlit/openlit
Open-source observability & evaluation platform for AI agents and coding agents. Trace LLMs, tools, prompts, costs & agent workflows with OpenTelemetry.
Apache-2.0Sep 17, 2026 · metrics 2.10.0
All tags
Catalogue tag
#ai-evaluation
Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.
8 records
PyPI · npm
UiPath/coder_eval
Playwright for coding agents. Test that your skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, A/B experiments, CI gates.
Apache-2.0Oct 19, 2026 · metrics 2.10.0
PyPI
cvs-health/uqlm
[JMLR 2026] "UQLM: A Python Package for Uncertainty Quantification in Large Language Models"
Apache-2.0Sep 19, 2026 · metrics 2.10.0
PyPI
b7n0de/proofbundle
Offline cryptographic receipts for AI evaluation results — Ed25519 + RFC 6962 Merkle + optional SD-JWT. Integrity, not truth
MITSep 13, 2026 · metrics 2.10.0
PyPI
HarperZ9/flywheel
Flywheel runs AI tasks with a model you choose and keeps a receipt anyone can recheck offline.
Custom licenseOct 15, 2026 · metrics 2.10.0
PyPI
dalmia/calibrate-python-sdk
Python SDK for Calibrate's API
MITSep 20, 2026 · metrics 2.10.0
PyPI
mrwersa/agentverity
Qualify repeated categorical AI-agent evidence before it becomes a regression reference
Apache-2.0Sep 16, 2026 · metrics 2.10.0
PyPI
JarJarBeatyourattitude/evalt
Budget-bounded LLM routing that finds the cheapest model and prompt meeting your accuracy target.
MITSep 12, 2026 · metrics 2.10.0