PyPI · npm
confident-ai/deepeval
The LLM Evaluation Framework
Apache-2.016. Sept. 2026 · Metriken 2.10.0
Alle Tags
Katalog-Tag
#evaluation-metrics
Alle Repositories im öffentlichen Register, die dieses Tag tragen — aus ihren GitHub-Topics oder den von ihren Paket-Registries veröffentlichten Schlagwörtern. Die Gesundheit wird nach derselben versionierten Methodik gemessen wie im übrigen Register.
5 Einträge
PyPI · crates.io
derekallman/hotcoco
Perception evaluation toolkit in Rust with Python bindings. A pycocotools drop-in for COCO, LVIS, and Open Images detection metrics, up to 36× faster, plus TIDE error analysis, confusion matrices, calibration, model comparison, and a dataset browser.
MIT7. Okt. 2026 · Metriken 2.10.0
PyPI · npm
AgentOps-AI/agentops
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI
MIT28. Aug. 2026 · Metriken 2.10.0
RubyGems
homemade-software-inc/completion-kit
Your prompts need tests too. Run prompts against real datasets, score outputs with LLM judges, version everything, and compare runs to see what got better.
Eigene Lizenz10. Sept. 2026 · Metriken 2.10.0
Go
CircleCI-Research/evalbench
Evaluate LLMs side-by-side. Benchmark AI models and coding agents across providers like OpenAI, Google, Anthropic, DeepSeek, and more. Supports custom tasks, structured JSON responses, tool use, and LLM-as-judge validation. Originally created by Petr Malik as MindTrial.
MPL-2.013. Sept. 2026 · Metriken 2.10.0