Hex · npm
ccarvalho-eng/aludel
Phoenix-native LLM evaluation, prompt testing, model comparison, red teaming, and observability for Elixir
Apache-2.0Sep 9, 2026 · metrics 2.10.0
All tags
Catalogue tag
#model-comparison
Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.
4 records
—
stan-dev/loo
loo R package for approximate leave-one-out cross-validation (LOO-CV) and Pareto smoothed importance sampling (PSIS)
Custom licenseOct 21, 2026 · metrics 2.10.0
RubyGems
justi/ruby_llm-contract
Validate and retry LLM outputs for ruby_llm. Describe the JSON response you expect, fall back to a stronger model when the cheaper one fails the rules, and gate CI on regressions — all as one contract object per step.
MITOct 20, 2026 · metrics 2.10.0
Go
CircleCI-Research/evalbench
Evaluate LLMs side-by-side. Benchmark AI models and coding agents across providers like OpenAI, Google, Anthropic, DeepSeek, and more. Supports custom tasks, structured JSON responses, tool use, and LLM-as-judge validation. Originally created by Petr Malik as MindTrial.
MPL-2.0Sep 13, 2026 · metrics 2.10.0