#llm-evaluation

Python SDK for Calibrate's API

Qualify repeated categorical AI-agent evidence before it becomes a regression reference

A Go library and CLI for complete TAOCP solutions, fast and audited solving modes, reproducible model evaluation, and detailed token and list-cost accounting.

RAMR — Retrieval-Augmented Memory Reliability: a contamination-resistant synthetic benchmark for agentic-RAG / memory systems (findings + method)

Budget-bounded LLM routing that finds the cheapest model and prompt meeting your accuracy target.

Hey LLM, you okay? — pyramid-ordered LLM testing CLI for CI/CD. One YAML for every layer, LLM-as-a-judge gates, and A/B triage that tells prompt regressions from model drift.