Catalogue tag

#evaluation-framework

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

5 records

Tagged “evaluation-framework”Ranked by health index

PyPI

83Goodhealth index

EleutherAI/lm-evaluation-harness

A framework for few-shot evaluation of language models.

Python★ 13.3K↓ 1.5M/moJul 21, 2026

MITJul 21, 2026 · metrics 1.13.0

npm

80Goodhealth index

promptfoo/promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

TypeScript★ 23.4K↓ 1.7M/moJul 17, 2026

MITJul 17, 2026 · metrics 1.13.0

npm · PyPI

78Goodhealth index

confident-ai/deepeval

The LLM Evaluation Framework

Python · TypeScript★ 17K↓ 17.7K/moJul 20, 2026

Apache-2.0Jul 20, 2026 · metrics 1.13.0

RubyGems

61Moderatehealth index

homemade-software-inc/completion-kit

Your prompts need tests too. Run prompts against real datasets, score outputs with LLM judges, version everything, and compare runs to see what got better.

Ruby · HTML★ 1Jul 17, 2026

Custom licenseJul 17, 2026 · metrics 1.13.0

npm

48At riskhealth index

empirical-run/empirical

Test and evaluate LLMs and model configurations, across all the scenarios that matter for your application

TypeScript★ 167Jul 15, 2026

MITJul 15, 2026 · metrics 1.13.0