#benchmark

Playwright for coding agents. Test that your skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, A/B experiments, CI gates.

Common cryptographic library used in software at Mysten Labs.

TPC-H benchmark data generation in pure Rust

:zap: A collection of common functions for Fiber with better performance, fewer allocations, and fewer dependencies.

Open-source memory and context for user-aware agents: scoped memory, provenance, retrieval quality, correction, boundaries, evals, and MCP/HTTP access.

Node.js libraries to create CodSpeed benchmarks

Inspect and Debug your Tauri applications in style 💃

Tool for comparing the run time and accuracy of minimizers on fit benchmarking problems

High-precision, one-shot and consistent benchmarking framework/harness for Rust. All Valgrind tools at your fingertips.

A library of Reversible Data Transforms

Crates to benchmark your Rust code

Airspeed Velocity: A simple Python benchmarking tool with web-based reporting

A Living Benchmark for Machine Learning on Tabular Data

One command turns CSV, JSON, or benchmark data into interactive, self-contained HTML charts. 8 types (Bar, Line, Scatter, Heatmap, Sankey, Chord, Pie, Radar) with 3D. Local CLI, Docker, and CI/CD.

A Catalog of Microservices Created by SourceFuse for the Community

Python package for the evaluation of odometry and SLAM

Comprehensive mocking framework for REST, gRPC, GraphQL & WebSockets. Features intelligent RAG-driven data synthesis, latency/fault injection, HTTP bridge, WASM plugins, E2E encryption, workspace sync, and modern admin UI. Production-ready with Docker support.

Paper trading simulator for Polymarket

pytest fixture for benchmarking code

Open source evals for physical AI. Run any LLM/VLA on any arm/humanoid against any real/sim benchmark.

Find, benchmark and install in CLI 170+ FREE coding LLM models across 15+ providers in real time

A pytest plugin to create benchmarks

PyPI capacity-planning CLI for LLM deployment. pip install chimeraforge.

Research infra for creating RL environments, post-training, and evals.

A command-line benchmarking tool

[NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents