#benchmark

IronSBE is a complete Rust implementation of the [Simple Binary Encoding (SBE)](https://www.fixtrading.org/standards/sbe/) protocol, designed for ultra-low-latency financial systems. It provides both server and client capabilities with a focus on performance, type safety, and ease of use.

Run a 110B on a 2016 PC with 16 GB RAM. Know your tok/s before you download. Placement beats budget: predicts speed + memory fit for any GGUF on your exact hardware, self-calibrates, emits the exact llama.cpp command — or 'quantprobe auto' does it all. Falsification-tested laws; misses published at full size. pip install quantprobe

Blazing-fast equality checks, minus the baggage. A lean, standalone alternative to Lodash’s isEqual - because speed matters.

Open-source AI security benchmarking CLI. Measure how AI models perform offensive security tasks with MITRE ATT&CK analysis and KSM scoring.

LLM agent evaluation framework with 7 Harness Gates (A–G) and 58 metrics. Supports LangChain, CrewAI, AutoGen, DSPy, PydanticAI. Native LLM-as-Judge, OTEL tracing, FastAPI dashboard.

Keine Repository-Beschreibung veröffentlicht.

🪑 Benchmark different versions of same or similar gems & Static Gemfile and installed gem library source code analysis

Full Text Search Benchmark, a tool for comparing and evaluating full-text search engines.

A consistent, fair, benchmark for structured extraction.

A convenient CLI to streamline LiteRT related development workflows, including converting, quantizing, compiling, managing, running, benchmarking and visualizing LiteRT (TFLite) models on various hardwares (CPU / GPU / NPU) across platforms (desktop, mobile or cloud).

Repository for all things around tabular dataset curation for benchmarking!

A multi-language base application to test performance of static analysis

JavaScript Console Instrumentation and Benchmarking for Browser and Node

Reproduciable ECG curation and harmonization framework