PyPI
PrimeIntellect-ai/verifiers
Our library for RL environments + evals
MITAug 28, 2026 · metrics 2.10.0
All tags
Catalogue tag
#eval
Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.
36 records
PyPI · npm
UiPath/coder_eval
Playwright for coding agents. Test that your skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, A/B experiments, CI gates.
Apache-2.0Oct 19, 2026 · metrics 2.10.0
npm
jordanburke/functype
A Functional Library for TypeScript based on Scala
MITSep 18, 2026 · metrics 2.10.0
PyPI
lmfit/asteval
minimalistic evaluator of python expression using ast module
MITSep 12, 2026 · metrics 2.10.0
npm
vercel-labs/agent-eval
No repository description published.
No licenseSep 15, 2026 · metrics 2.10.0
RubyGems
Coolhand-Labs/coolhand-ruby
Zero-config LLM cost & quality monitoring for Ruby apps - automatically log AI API calls and collect user feedback for analysis using Coolhand.
Apache-2.0Oct 14, 2026 · metrics 2.10.0
npm
mattapperson/noetic
No repository description published.
Apache-2.0Sep 18, 2026 · metrics 2.10.0
NuGet
dynamicexpresso/DynamicExpresso
C# expressions interpreter
MITSep 24, 2026 · metrics 2.10.0
npm
zernie/vigiles
Like Lighthouse for your agent harness - verify your CLAUDE.md/AGENTS.md, skills & hooks are real, then test and measure they actually work. Claude Code + Codex.
MITSep 11, 2026 · metrics 2.10.0
npm
Kikobeats/isolated-function
Run JavaScript from AI agents, plugins, and workflows in a separate Node.js process with strict safety limits.
MITSep 12, 2026 · metrics 2.10.0
PyPI
digline/digline
Regression testing for LLM applications — with the baseline in your repository, not on someone's server.
Apache-2.0Sep 18, 2026 · metrics 2.10.0
npm
crewhaus/factory
Open-source compiler for AI agents. Write one crewhaus.yaml; compile it to a CLI, a Slack bot, and an eval harness from the same spec. Apache-2.0.
Apache-2.0Sep 13, 2026 · metrics 2.10.0
npm
tangle-network/agent-app
A feature-full starting point for production agent applications on Tangle.
MITSep 9, 2026 · metrics 2.10.0
Packagist
wp-cli/eval-command
Executes arbitrary PHP code or files.
MITSep 12, 2026 · metrics 2.10.0
npm
agenticklabs/agentick
The component framework for AI.
MITSep 18, 2026 · metrics 2.10.0
RubyGems
justi/ruby_llm-contract
Validate and retry LLM outputs for ruby_llm. Describe the JSON response you expect, fall back to a stronger model when the cheaper one fails the rules, and gate CI on regressions — all as one contract object per step.
MITOct 20, 2026 · metrics 2.10.0
npm
justjake/quickjs-emscripten
Safely execute untrusted Javascript in your Javascript, and execute synchronous code that uses async functions
Custom licenseSep 17, 2026 · metrics 2.10.0
crates.io
AndyCappDev/stet
A pure-Rust graphics engine for PDF, PostScript, and EPS.
Apache-2.0Oct 19, 2026 · metrics 2.10.0
PyPI
danthedeckie/simpleeval
Simple Safe Sandboxed Extensible Expression Evaluator for Python
Custom licenseSep 12, 2026 · metrics 2.10.0
npm
peerigon/angular-expressions
Angular expressions as standalone module
UnlicenseOct 21, 2026 · metrics 2.10.0
Packagist
pestphp/pest-plugin-evals
Pest Browser Evals
MITSep 16, 2026 · metrics 2.10.0
PyPI
phierceweb/pw-core
Python foundation for LLM apps whose prompts and spend you can actually see — versioned prompts, every call recorded and replayable, budgets, evals, jobs.
Apache-2.0Oct 21, 2026 · metrics 2.10.0
npm
PruvoNet/json-expression-eval
json serializable rule engine / boolean expression evaluator
MITSep 10, 2026 · metrics 2.10.0
PyPI
claimidx/claimidx
Prior art for AI agents. Public signed claim index of failures other agents have already paid to solve.
Apache-2.0Sep 25, 2026 · metrics 2.10.0
npm
mgechev/skillgrade
"Unit tests" for your agent skills
MITSep 16, 2026 · metrics 2.10.0
NuGet
AntonovAnton/math.evaluation
This .NET library allows you to evaluate and compile any mathematical expression from a string dynamically at runtime. It supports a wide range of operations and allows for the use of custom variables, operators, and functions. The evaluator can be configured for different contexts, such as scientific, programming, boolean math expressions.
Apache-2.0Oct 4, 2026 · metrics 2.10.0
npm
reggi/evalmd
:fishing_pole_and_fish: Evaluates javascript code blocks from markdown files.
MITSep 14, 2026 · metrics 2.10.0
npm
jettyio/jetty-sdk
Typed client SDK for the Jetty AI/ML workflow platform (@jetty/sdk) + worked example
MITSep 15, 2026 · metrics 2.10.0
npm
buttonwoodcx/bcx-expression-evaluator
Safely evaluate JavaScript-like expression in given context.
MITSep 18, 2026 · metrics 2.10.0
npm
mykim-aus/hey-llm-you-okay
Hey LLM, you okay? — pyramid-ordered LLM testing CLI for CI/CD. One YAML for every layer, LLM-as-a-judge gates, and A/B triage that tells prompt regressions from model drift.
MITSep 14, 2026 · metrics 2.10.0