All tags
Catalogue tag

#llm-evaluation

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

13 records
Tagged “llm-evaluation”Ranked by health index
PyPI · npm
89Excellenthealth index
Arize-ai/phoenix
AI Observability & Evaluation
Python · TypeScript · Jupyter Notebook★ 10.6KJul 17, 2026
Custom licenseJul 17, 2026 · metrics 1.13.0
npm · PyPI
87Excellenthealth index
Agenta-AI/agenta
The open-source workspace for building and running AI agents. Build agents through chat, share them with your team, and run background agents on schedules or app events.
TypeScript · Python★ 4,315Jul 20, 2026
Custom licenseJul 20, 2026 · metrics 1.13.0
PyPI · npm
83Goodhealth index
mlflow/mlflow
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
Python · TypeScript★ 27.1K↓ 40.1M/moJul 18, 2026
Apache-2.0Jul 18, 2026 · metrics 1.13.0
npm
81Goodhealth index
langfuse/langfuse
🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
TypeScript★ 31.3KJul 17, 2026
Custom licenseJul 17, 2026 · metrics 1.13.0
npm
80Goodhealth index
promptfoo/promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
TypeScript★ 23.4K↓ 1.7M/moJul 17, 2026
MITJul 17, 2026 · metrics 1.13.0
npm · PyPI
78Goodhealth index
confident-ai/deepeval
The LLM Evaluation Framework
Python · TypeScript★ 17K↓ 17.7K/moJul 20, 2026
Apache-2.0Jul 20, 2026 · metrics 1.13.0
Go · Maven · npm
66Moderatehealth index
hugalafutro/model-hotel
Multi-Provider AI Gateway - No personal logs by design. Model autodiscovery, Failover groups, High availabilty, Android companion app, and more. "Because we have LiteLLM at home"
Go · TypeScript★ 50Jul 18, 2026
MITJul 18, 2026 · metrics 1.13.0
Hex · npm
64Moderatehealth index
ccarvalho-eng/aludel
LLM Evaluation for Phoenix Apps
Elixir · JavaScript · HTML★ 34↓ 19.3K/moJul 17, 2026
Apache-2.0Jul 17, 2026 · metrics 1.13.0
RubyGems
61Moderatehealth index
homemade-software-inc/completion-kit
Your prompts need tests too. Run prompts against real datasets, score outputs with LLM judges, version everything, and compare runs to see what got better.
Ruby · HTML★ 1Jul 17, 2026
Custom licenseJul 17, 2026 · metrics 1.13.0
PyPI · npm
60Moderatehealth index
fastaifoundry/fastaiagent-sdk
No repository description published.
Python · TypeScript★ 0↓ 2,525/moJul 17, 2026
Apache-2.0Jul 17, 2026 · metrics 1.13.0
PyPI
52Moderatehealth index
attenlabs/hotato
Conversation QA for voice agents. Catch the calls that pass every text check but talk over the caller, skip a disclosure, or claim a task that never happened. Self-hosted, offline, MIT.
HTML★ 0↓ 2,575/moJul 13, 2026
MITJul 13, 2026 · metrics 1.13.0
PyPI
50Moderatehealth index
JarJarBeatyourattitude/evalt
Budget-bounded LLM routing that finds the cheapest model and prompt meeting your accuracy target.
Python★ 0↓ 2,908/moJul 22, 2026
MITJul 22, 2026 · metrics 1.13.0
PyPI
39At riskhealth index
waybarrios/crystal
CRYSTAL: Beyond Final Answers: Benchmark for Transparent Multimodal Reasoning Evaluation | arXiv 2603.13099
Python★ 2Jul 17, 2026
No licenseJul 17, 2026 · metrics 1.13.0