PyPI · npm
Arize-ai/phoenix
AI Observability & Evaluation
Licencia propia28 ago 2026 · métricas 2.10.0
Todas las etiquetas
Etiqueta del catálogo
#evals
Todos los repositorios del registro público que llevan esta etiqueta, procedente de sus topics de GitHub o de las palabras clave que publican sus registros de paquetes. La salud se mide con la misma metodología versionada que el resto del registro.
43 registros
PyPI · npm
pydantic/logfire
AI observability platform for production LLM and agent systems.
MIT27 ago 2026 · métricas 2.10.0
npm
mastra-ai/mastra
Mastra is the modern TypeScript framework for AI-powered applications and agents.
Licencia propia16 sept 2026 · métricas 2.10.0
PyPI
langchain-ai/deepagents
The batteries-included agent harness.
MIT16 sept 2026 · métricas 2.10.0
PyPI
truera/trulens
Evaluation and Tracking for LLM Experiments and AI Agents
MIT17 sept 2026 · métricas 2.10.0
PyPI · npm
harbor-framework/harbor
Framework for evaluating and improving agents
Apache-2.027 ago 2026 · métricas 2.10.0
PyPI · npm
overmind-core/overmind
The platform for continuously improving AI agents.
AGPL-3.019 oct 2026 · métricas 2.10.0
PyPI · npm
UiPath/coder_eval
Playwright for coding agents. Test that your skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, A/B experiments, CI gates.
Apache-2.019 oct 2026 · métricas 2.10.0
PyPI
hud-evals/hud-python
RL environments + evals for AI agents. Define once, train anything.
MIT20 sept 2026 · métricas 2.10.0
PyPI
Kiln-AI/Kiln
Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.
Licencia propia19 sept 2026 · métricas 2.10.0
npm
cacheplane/b4run
Ridiculous speed. Readable code.
MIT15 oct 2026 · métricas 2.10.0
npm · PyPI · crates.io
FailproofAI/failproofai
Observability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy enforcement. 40 built-in policies, a local dashboard, no account required with a generous free cloud plan
Licencia propia9 sept 2026 · métricas 2.10.0
npm
MCPJam/inspector
Testing and evaluation platform to chat, inspect, and debug MCP servers, MCP apps, and ChatGPT apps.
Licencia propia10 sept 2026 · métricas 2.10.0
PyPI
PrimeIntellect-ai/prime
Official CLI and Python SDK for Prime Intellect - access GPU compute, remote sandboxes, RL environments, and distributed training infrastructure for AI development at scale.
MIT9 sept 2026 · métricas 2.10.0
npm · PyPI
dynatrace-oss/dt-evals
AI evaluators CLI for your AI apps and Agents - Dynatrace AI Observability
Apache-2.08 oct 2026 · métricas 2.10.0
npm
nearform/lastlight
Self-hostable, MIT Licensed, Enterprise AI Software Factory
MIT13 sept 2026 · métricas 2.10.0
PyPI
benchflow-ai/benchflow
Research infra for creating RL environments, post-training, and evals.
Apache-2.017 sept 2026 · métricas 2.10.0
npm
getlarge/themoltnet
Give an agent a job, not your keys. Open-source control plane for AI agent work: each agent gets its own identity, a bounded job, and a signed record of what it did.
AGPL-3.014 sept 2026 · métricas 2.10.0
npm
spences10/my-pi
Composable Pi coding agent with MCP, LSP, agent chains, prompt presets, and local eval telemetry
MIT10 sept 2026 · métricas 2.10.0
Hex · npm
ccarvalho-eng/aludel
Phoenix-native LLM evaluation, prompt testing, model comparison, red teaming, and observability for Elixir
Apache-2.09 sept 2026 · métricas 2.10.0
RubyGems
Coolhand-Labs/coolhand-ruby
Zero-config LLM cost & quality monitoring for Ruby apps - automatically log AI API calls and collect user feedback for analysis using Coolhand.
Apache-2.014 oct 2026 · métricas 2.10.0
PyPI · npm
AgentOps-AI/agentops
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI
MIT28 ago 2026 · métricas 2.10.0
PyPI
attenlabs/hotato
Find what broke in your agent calls. Pin it so it never ships again. Local voice-agent call forensics and regression guards.
MIT20 oct 2026 · métricas 2.10.0
npm · PyPI · Go
memoturn/memoturn
Open-source AI engineering platform — LLM observability, evals, metrics, prompt management, playground, and datasets. OpenTelemetry-native, self-hostable. Because "it worked when I tried it" is not an eval.
Apache-2.03 oct 2026 · métricas 2.10.0
npm
zernie/vigiles
Like Lighthouse for your agent harness - verify your CLAUDE.md/AGENTS.md, skills & hooks are real, then test and measure they actually work. Claude Code + Codex.
MIT11 sept 2026 · métricas 2.10.0
NuGet
elbruno/ElBruno.MarkItDotNet
.NET library that converts file formats to Markdown for AI pipelines
MIT19 oct 2026 · métricas 2.10.0
npm
o-stepper/graphorin
Project Graphorin is a TypeScript framework for personal AI assistants and long-living agents with rich memory, durable workflow, and observability out of the box.
MIT15 sept 2026 · métricas 2.10.0
PyPI
superlinear-ai/raglite
🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL
MPL-2.017 sept 2026 · métricas 2.10.0
npm · crates.io
wanxunyang/mocode
Terminal coding agent with durable memory, hash-gated skill trust and a 61-task eval harness. Works with any OpenAI-compatible backend (GLM / DeepSeek / Qwen / Ollama).
MIT20 oct 2026 · métricas 2.10.0
PyPI
kensa-sh/kensa
Kensa turns agent traces into evals that run in CI.
Apache-2.013 sept 2026 · métricas 2.10.0