Alle Tags
Katalog-Tag

#llm-evaluation

Alle Repositories im öffentlichen Register, die dieses Tag tragen — aus ihren GitHub-Topics oder den von ihren Paket-Registries veröffentlichten Schlagwörtern. Die Gesundheit wird nach derselben versionierten Methodik gemessen wie im übrigen Register.

13 Einträge
Getaggt als „llm-evaluation“Geordnet nach Gesundheitsindex
PyPI · npm
89ExzellentGesundheitsindex
Arize-ai/phoenix
AI Observability & Evaluation
Python · TypeScript · Jupyter Notebook★ 10.6K17. Juli 2026
Eigene Lizenz17. Juli 2026 · Metriken 1.13.0
npm · PyPI
87ExzellentGesundheitsindex
Agenta-AI/agenta
The open-source workspace for building and running AI agents. Build agents through chat, share them with your team, and run background agents on schedules or app events.
TypeScript · Python★ 4.31520. Juli 2026
Eigene Lizenz20. Juli 2026 · Metriken 1.13.0
PyPI · npm
83GutGesundheitsindex
mlflow/mlflow
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
Python · TypeScript★ 27.1K↓ 40.1M/Monat18. Juli 2026
Apache-2.018. Juli 2026 · Metriken 1.13.0
npm
81GutGesundheitsindex
langfuse/langfuse
🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
TypeScript★ 31.3K17. Juli 2026
Eigene Lizenz17. Juli 2026 · Metriken 1.13.0
npm
80GutGesundheitsindex
promptfoo/promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
TypeScript★ 23.4K↓ 1.7M/Monat17. Juli 2026
MIT17. Juli 2026 · Metriken 1.13.0
npm · PyPI
78GutGesundheitsindex
confident-ai/deepeval
The LLM Evaluation Framework
Python · TypeScript★ 17K↓ 17.7K/Monat20. Juli 2026
Apache-2.020. Juli 2026 · Metriken 1.13.0
Go · Maven · npm
66MittelGesundheitsindex
hugalafutro/model-hotel
Multi-Provider AI Gateway - No personal logs by design. Model autodiscovery, Failover groups, High availabilty, Android companion app, and more. "Because we have LiteLLM at home"
Go · TypeScript★ 5018. Juli 2026
MIT18. Juli 2026 · Metriken 1.13.0
Hex · npm
64MittelGesundheitsindex
ccarvalho-eng/aludel
LLM Evaluation for Phoenix Apps
Elixir · JavaScript · HTML★ 34↓ 19.3K/Monat17. Juli 2026
Apache-2.017. Juli 2026 · Metriken 1.13.0
RubyGems
61MittelGesundheitsindex
homemade-software-inc/completion-kit
Your prompts need tests too. Run prompts against real datasets, score outputs with LLM judges, version everything, and compare runs to see what got better.
Ruby · HTML★ 117. Juli 2026
Eigene Lizenz17. Juli 2026 · Metriken 1.13.0
PyPI · npm
60MittelGesundheitsindex
fastaifoundry/fastaiagent-sdk
Keine Repository-Beschreibung veröffentlicht.
Python · TypeScript★ 0↓ 2.525/Monat17. Juli 2026
Apache-2.017. Juli 2026 · Metriken 1.13.0
PyPI
52MittelGesundheitsindex
attenlabs/hotato
Conversation QA for voice agents. Catch the calls that pass every text check but talk over the caller, skip a disclosure, or claim a task that never happened. Self-hosted, offline, MIT.
HTML★ 0↓ 2.575/Monat13. Juli 2026
MIT13. Juli 2026 · Metriken 1.13.0
PyPI
50MittelGesundheitsindex
JarJarBeatyourattitude/evalt
Budget-bounded LLM routing that finds the cheapest model and prompt meeting your accuracy target.
Python★ 0↓ 2.908/Monat22. Juli 2026
MIT22. Juli 2026 · Metriken 1.13.0
PyPI
39GefährdetGesundheitsindex
waybarrios/crystal
CRYSTAL: Beyond Final Answers: Benchmark for Transparent Multimodal Reasoning Evaluation | arXiv 2603.13099
Python★ 217. Juli 2026
Keine Lizenz17. Juli 2026 · Metriken 1.13.0