PyPI · npm
Arize-ai/phoenix
AI Observability & Evaluation
Custom licenseAug 28, 2026 · metrics 2.10.0
All tags
Catalogue tag
#llm-eval
Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.
9 records
PyPI
Giskard-AI/giskard-oss
🐢 Open-Source Evaluation & Testing library for LLM Agents
Apache-2.0Aug 28, 2026 · metrics 2.10.0
npm
promptfoo/promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
MITSep 16, 2026 · metrics 2.10.0
PyPI
truera/trulens
Evaluation and Tracking for LLM Experiments and AI Agents
MITSep 17, 2026 · metrics 2.10.0
PyPI · npm
UiPath/coder_eval
Test that your Claude Code skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, activation checks, A/B experiments, CI gates.
Apache-2.0Aug 19, 2026 · metrics 2.10.0
PyPI
attenlabs/hotato
Find what broke in your agent calls. Pin it so it never ships again. Local voice-agent call forensics and regression guards.
MITAug 22, 2026 · metrics 2.10.0
RubyGems
homemade-software-inc/completion-kit
Your prompts need tests too. Run prompts against real datasets, score outputs with LLM judges, version everything, and compare runs to see what got better.
Custom licenseSep 10, 2026 · metrics 2.10.0
Go
lehigh-university-libraries/htr
Handwritten Text Recognition llm eval tool
Apache-2.0Sep 16, 2026 · metrics 2.10.0
Go · npm
valbaudo/awf
Run agents you don't babysit, and trust the result. awf runs agentic workflows with independent gates that check every step and resumes after crashes.
Apache-2.0Sep 12, 2026 · metrics 2.10.0