PyPI · npm
Arize-ai/phoenix
AI Observability & Evaluation
Eigene Lizenz28. Aug. 2026 · Metriken 2.10.0
Alle Tags
Katalog-Tag
#evals
Alle Repositories im öffentlichen Register, die dieses Tag tragen — aus ihren GitHub-Topics oder den von ihren Paket-Registries veröffentlichten Schlagwörtern. Die Gesundheit wird nach derselben versionierten Methodik gemessen wie im übrigen Register.
43 Einträge
PyPI · npm
pydantic/logfire
AI observability platform for production LLM and agent systems.
MIT27. Aug. 2026 · Metriken 2.10.0
npm
mastra-ai/mastra
Mastra is the modern TypeScript framework for AI-powered applications and agents.
Eigene Lizenz16. Sept. 2026 · Metriken 2.10.0
PyPI
langchain-ai/deepagents
The batteries-included agent harness.
MIT16. Sept. 2026 · Metriken 2.10.0
PyPI
truera/trulens
Evaluation and Tracking for LLM Experiments and AI Agents
MIT17. Sept. 2026 · Metriken 2.10.0
PyPI · npm
harbor-framework/harbor
Framework for evaluating and improving agents
Apache-2.027. Aug. 2026 · Metriken 2.10.0
PyPI · npm
overmind-core/overmind
The platform for continuously improving AI agents.
AGPL-3.019. Okt. 2026 · Metriken 2.10.0
PyPI · npm
UiPath/coder_eval
Playwright for coding agents. Test that your skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, A/B experiments, CI gates.
Apache-2.019. Okt. 2026 · Metriken 2.10.0
PyPI
hud-evals/hud-python
RL environments + evals for AI agents. Define once, train anything.
MIT20. Sept. 2026 · Metriken 2.10.0
PyPI
Kiln-AI/Kiln
Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.
Eigene Lizenz19. Sept. 2026 · Metriken 2.10.0
npm
cacheplane/b4run
Ridiculous speed. Readable code.
MIT15. Okt. 2026 · Metriken 2.10.0
npm · PyPI · crates.io
FailproofAI/failproofai
Observability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy enforcement. 40 built-in policies, a local dashboard, no account required with a generous free cloud plan
Eigene Lizenz9. Sept. 2026 · Metriken 2.10.0
npm
MCPJam/inspector
Testing and evaluation platform to chat, inspect, and debug MCP servers, MCP apps, and ChatGPT apps.
Eigene Lizenz10. Sept. 2026 · Metriken 2.10.0
PyPI
PrimeIntellect-ai/prime
Official CLI and Python SDK for Prime Intellect - access GPU compute, remote sandboxes, RL environments, and distributed training infrastructure for AI development at scale.
MIT9. Sept. 2026 · Metriken 2.10.0
npm · PyPI
dynatrace-oss/dt-evals
AI evaluators CLI for your AI apps and Agents - Dynatrace AI Observability
Apache-2.08. Okt. 2026 · Metriken 2.10.0
npm
nearform/lastlight
Self-hostable, MIT Licensed, Enterprise AI Software Factory
MIT13. Sept. 2026 · Metriken 2.10.0
PyPI
benchflow-ai/benchflow
Research infra for creating RL environments, post-training, and evals.
Apache-2.017. Sept. 2026 · Metriken 2.10.0
npm
getlarge/themoltnet
Give an agent a job, not your keys. Open-source control plane for AI agent work: each agent gets its own identity, a bounded job, and a signed record of what it did.
AGPL-3.014. Sept. 2026 · Metriken 2.10.0
npm
spences10/my-pi
Composable Pi coding agent with MCP, LSP, agent chains, prompt presets, and local eval telemetry
MIT10. Sept. 2026 · Metriken 2.10.0
Hex · npm
ccarvalho-eng/aludel
Phoenix-native LLM evaluation, prompt testing, model comparison, red teaming, and observability for Elixir
Apache-2.09. Sept. 2026 · Metriken 2.10.0
RubyGems
Coolhand-Labs/coolhand-ruby
Zero-config LLM cost & quality monitoring for Ruby apps - automatically log AI API calls and collect user feedback for analysis using Coolhand.
Apache-2.014. Okt. 2026 · Metriken 2.10.0
PyPI · npm
AgentOps-AI/agentops
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI
MIT28. Aug. 2026 · Metriken 2.10.0
PyPI
attenlabs/hotato
Find what broke in your agent calls. Pin it so it never ships again. Local voice-agent call forensics and regression guards.
MIT20. Okt. 2026 · Metriken 2.10.0
npm · PyPI · Go
memoturn/memoturn
Open-source AI engineering platform — LLM observability, evals, metrics, prompt management, playground, and datasets. OpenTelemetry-native, self-hostable. Because "it worked when I tried it" is not an eval.
Apache-2.03. Okt. 2026 · Metriken 2.10.0
npm
zernie/vigiles
Like Lighthouse for your agent harness - verify your CLAUDE.md/AGENTS.md, skills & hooks are real, then test and measure they actually work. Claude Code + Codex.
MIT11. Sept. 2026 · Metriken 2.10.0
NuGet
elbruno/ElBruno.MarkItDotNet
.NET library that converts file formats to Markdown for AI pipelines
MIT19. Okt. 2026 · Metriken 2.10.0
npm
o-stepper/graphorin
Project Graphorin is a TypeScript framework for personal AI assistants and long-living agents with rich memory, durable workflow, and observability out of the box.
MIT15. Sept. 2026 · Metriken 2.10.0
PyPI
superlinear-ai/raglite
🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL
MPL-2.017. Sept. 2026 · Metriken 2.10.0
npm · crates.io
wanxunyang/mocode
Terminal coding agent with durable memory, hash-gated skill trust and a 61-task eval harness. Works with any OpenAI-compatible backend (GLM / DeepSeek / Qwen / Ollama).
MIT20. Okt. 2026 · Metriken 2.10.0
PyPI
kensa-sh/kensa
Kensa turns agent traces into evals that run in CI.
Apache-2.013. Sept. 2026 · Metriken 2.10.0