PyPI · npm
confident-ai/deepeval
The LLM Evaluation Framework
Apache-2.0Aug 5, 2026 · metrics 2.10.0
All tags
Catalogue tag
#evaluation-metrics
Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.
4 records
PyPI · npm
AgentOps-AI/agentops
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI
MITAug 28, 2026 · metrics 2.10.0
RubyGems
homemade-software-inc/completion-kit
Your prompts need tests too. Run prompts against real datasets, score outputs with LLM judges, version everything, and compare runs to see what got better.
Custom licenseJul 17, 2026 · metrics 2.10.0
Go
CircleCI-Research/evalbench
Evaluate LLMs side-by-side. Benchmark AI models and coding agents across providers like OpenAI, Google, Anthropic, DeepSeek, and more. Supports custom tasks, structured JSON responses, tool use, and LLM-as-judge validation. Originally created by Petr Malik as MindTrial.
MPL-2.0Jul 25, 2026 · metrics 2.10.0