Todas las etiquetas
Etiqueta del catálogo

#llm-evaluation

Todos los repositorios del registro público que llevan esta etiqueta, procedente de sus topics de GitHub o de las palabras clave que publican sus registros de paquetes. La salud se mide con la misma metodología versionada que el resto del registro.

13 registros
Con la etiqueta «llm-evaluation»Ordenado por índice de salud
PyPI · npm
89Excelenteíndice de salud
Arize-ai/phoenix
AI Observability & Evaluation
Python · TypeScript · Jupyter Notebook★ 10.6K17 jul 2026
Licencia propia17 jul 2026 · métricas 1.13.0
npm · PyPI
87Excelenteíndice de salud
Agenta-AI/agenta
The open-source workspace for building and running AI agents. Build agents through chat, share them with your team, and run background agents on schedules or app events.
TypeScript · Python★ 431520 jul 2026
Licencia propia20 jul 2026 · métricas 1.13.0
PyPI · npm
83Buenoíndice de salud
mlflow/mlflow
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
Python · TypeScript★ 27.1K↓ 40.1M/mes18 jul 2026
Apache-2.018 jul 2026 · métricas 1.13.0
npm
81Buenoíndice de salud
langfuse/langfuse
🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
TypeScript★ 31.3K17 jul 2026
Licencia propia17 jul 2026 · métricas 1.13.0
npm
80Buenoíndice de salud
promptfoo/promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
TypeScript★ 23.4K↓ 1.7M/mes17 jul 2026
MIT17 jul 2026 · métricas 1.13.0
npm · PyPI
78Buenoíndice de salud
confident-ai/deepeval
The LLM Evaluation Framework
Python · TypeScript★ 17K↓ 17.7K/mes20 jul 2026
Apache-2.020 jul 2026 · métricas 1.13.0
Go · Maven · npm
66Moderadoíndice de salud
hugalafutro/model-hotel
Multi-Provider AI Gateway - No personal logs by design. Model autodiscovery, Failover groups, High availabilty, Android companion app, and more. "Because we have LiteLLM at home"
Go · TypeScript★ 5018 jul 2026
MIT18 jul 2026 · métricas 1.13.0
Hex · npm
64Moderadoíndice de salud
ccarvalho-eng/aludel
LLM Evaluation for Phoenix Apps
Elixir · JavaScript · HTML★ 34↓ 19.3K/mes17 jul 2026
Apache-2.017 jul 2026 · métricas 1.13.0
RubyGems
61Moderadoíndice de salud
homemade-software-inc/completion-kit
Your prompts need tests too. Run prompts against real datasets, score outputs with LLM judges, version everything, and compare runs to see what got better.
Ruby · HTML★ 117 jul 2026
Licencia propia17 jul 2026 · métricas 1.13.0
PyPI · npm
60Moderadoíndice de salud
fastaifoundry/fastaiagent-sdk
El repositorio no publica descripción.
Python · TypeScript★ 0↓ 2525/mes17 jul 2026
Apache-2.017 jul 2026 · métricas 1.13.0
PyPI
52Moderadoíndice de salud
attenlabs/hotato
Conversation QA for voice agents. Catch the calls that pass every text check but talk over the caller, skip a disclosure, or claim a task that never happened. Self-hosted, offline, MIT.
HTML★ 0↓ 2575/mes13 jul 2026
MIT13 jul 2026 · métricas 1.13.0
PyPI
50Moderadoíndice de salud
JarJarBeatyourattitude/evalt
Budget-bounded LLM routing that finds the cheapest model and prompt meeting your accuracy target.
Python★ 0↓ 2908/mes22 jul 2026
MIT22 jul 2026 · métricas 1.13.0
PyPI
39En riesgoíndice de salud
waybarrios/crystal
CRYSTAL: Beyond Final Answers: Benchmark for Transparent Multimodal Reasoning Evaluation | arXiv 2603.13099
Python★ 217 jul 2026
Sin licencia17 jul 2026 · métricas 1.13.0