PyPI · npm
Arize-ai/phoenix
AI Observability & Evaluation
Eigene Lizenz28. Aug. 2026 · Metriken 2.10.0
Alle Tags
Katalog-Tag
#evals
Alle Repositories im öffentlichen Register, die dieses Tag tragen — aus ihren GitHub-Topics oder den von ihren Paket-Registries veröffentlichten Schlagwörtern. Die Gesundheit wird nach derselben versionierten Methodik gemessen wie im übrigen Register.
29 Einträge
PyPI · npm
pydantic/logfire
AI observability platform for production LLM and agent systems.
MIT27. Aug. 2026 · Metriken 2.10.0
npm
mastra-ai/mastra
Mastra is the modern TypeScript framework for AI-powered applications and agents.
Eigene Lizenz5. Aug. 2026 · Metriken 2.10.0
PyPI
langchain-ai/deepagents
The batteries-included agent harness.
MIT5. Aug. 2026 · Metriken 2.10.0
PyPI · npm
harbor-framework/harbor
Framework for evaluating and improving agents
Apache-2.027. Aug. 2026 · Metriken 2.10.0
npm
MCPJam/inspector
Testing and evaluation platform to chat, inspect, and debug MCP servers, MCP apps, and ChatGPT apps.
Eigene Lizenz18. Juli 2026 · Metriken 2.10.0
PyPI
truera/trulens
Evaluation and Tracking for LLM Experiments and AI Agents
MIT6. Aug. 2026 · Metriken 2.10.0
PyPI · npm
UiPath/coder_eval
Test that your Claude Code skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, activation checks, A/B experiments, CI gates.
Apache-2.019. Aug. 2026 · Metriken 2.10.0
npm
nearform/lastlight
Self-hostable, MIT Licensed, Enterprise AI Software Factory
MIT26. Juli 2026 · Metriken 2.10.0
PyPI · npm
AgentOps-AI/agentops
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI
MIT28. Aug. 2026 · Metriken 2.10.0
PyPI
benchflow-ai/benchflow
Research infra for creating RL environments, post-training, and evals.
Apache-2.09. Aug. 2026 · Metriken 2.10.0
npm
o-stepper/graphorin
Project Graphorin is a TypeScript framework for personal AI assistants and long-living agents with rich memory, durable workflow, and observability out of the box.
MIT1. Aug. 2026 · Metriken 2.10.0
Go
realkarych/catacomb
Regression testing for Claude Code and Codex agents.
Apache-2.020. Juli 2026 · Metriken 2.10.0
PyPI
attenlabs/hotato
Find what broke in your agent calls. Pin it so it never ships again. Local voice-agent call forensics and regression guards.
MIT22. Aug. 2026 · Metriken 2.10.0
npm
getlarge/themoltnet
Trusted context for AI agents
AGPL-3.030. Juli 2026 · Metriken 2.10.0
PyPI
superlinear-ai/raglite
🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL
MPL-2.010. Aug. 2026 · Metriken 2.10.0
npm
zernie/vigiles
Like Lighthouse for your agent harness - verify your CLAUDE.md/AGENTS.md, skills & hooks are real, then test and measure they actually work. Claude Code + Codex.
MIT19. Juli 2026 · Metriken 2.10.0
PyPI
kensa-sh/kensa
Kensa turns agent traces into evals that run in CI.
Apache-2.023. Juli 2026 · Metriken 2.10.0
Packagist
pestphp/pest-plugin-evals
Pest Browser Evals
MIT4. Aug. 2026 · Metriken 2.10.0
Hex
aryaminus/controlkeel
Agent control plane for governed AI coding: validate changes, enforce policy gates, track findings, proofs, and evals based on your habits.
Eigene Lizenz17. Juli 2026 · Metriken 2.10.0
npm
shulmansj/teami
Control plane for orchestrating, evaluating, and improving agent work across a company
Eigene Lizenz30. Juli 2026 · Metriken 2.10.0
npm
spences10/my-pi
Composable Pi coding agent with MCP, LSP, agent chains, prompt presets, and local eval telemetry
MIT18. Juli 2026 · Metriken 2.10.0
Go
farazhassan/gantry
A tiny testable, Go-native agent runtime for teams that want control, conformance, and no framework lock-ins.
MIT18. Juli 2026 · Metriken 2.10.0
npm
inferock/inferock-bench
Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage, failure, and billing-integrity receipts.
Eigene Lizenz29. Juli 2026 · Metriken 2.10.0
npm
mykim-aus/hey-llm-you-okay
Hey LLM, you okay? — pyramid-ordered LLM testing CLI for CI/CD. One YAML for every layer, LLM-as-a-judge gates, and A/B triage that tells prompt regressions from model drift.
MIT30. Juli 2026 · Metriken 2.10.0
npm
HolocronLab/botruntime-packages
botruntime public packages. Consumed by the botruntime platform.
Keine Lizenz29. Juli 2026 · Metriken 2.10.0
npm
LilMGenius/paperthin
Low-level agentic design patterns. Turning old engineering wisdom into reflexes your agent reaches for on its own—on any agent.
MIT31. Juli 2026 · Metriken 2.10.0
npm
eigenpal/cli
Create, evaluate, and deploy workflows from your terminal. Agent-ready.
Apache-2.018. Juli 2026 · Metriken 2.10.0
PyPI
splox-ai/python-sdk
Official Splox SDK
MIT16. Juli 2026 · Metriken 2.10.0