Todas las etiquetas
Etiqueta del catálogo

#ai-safety

Todos los repositorios del registro público que llevan esta etiqueta, procedente de sus topics de GitHub o de las palabras clave que publican sus registros de paquetes. La salud se mide con la misma metodología versionada que el resto del registro.

76 registros
Con la etiqueta «ai-safety»Ordenado por índice de salud
PyPI · npm
99Excepcionalíndice de salud
microsoft/PyRIT
The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.
Python · TypeScript★ 45733 oct 2026
MIT3 oct 2026 · métricas 2.10.0
npm · Go · crates.io
96Excepcionalíndice de salud
microsoft/agent-governance-toolkit
AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.
Python★ 6138↓ 14.7K/mes28 ago 2026
MIT28 ago 2026 · métricas 2.10.0
PyPI
92Excelenteíndice de salud
cvs-health/uqlm
[JMLR 2026] "UQLM: A Python Package for Uncertainty Quantification in Large Language Models"
Python★ 1200↓ 1591/mes19 sept 2026
Apache-2.019 sept 2026 · métricas 2.10.0
PyPI · Go · npm
92Excelenteíndice de salud
preloop/preloop
The open-source AI agent control plane: MCP firewall, model gateway with budgets, human approvals, runtime observability, and audit trails
Python · TypeScript★ 62↓ 364/mes18 sept 2026
Apache-2.018 sept 2026 · métricas 2.10.0
PyPI · npm
91Excelenteíndice de salud
sattyamjjain/agent-audit-kit
Static scanner for MCP-connected AI agent pipelines. 348 rules across 14 categories, 14 compliance frameworks, OWASP Agentic 10/10 + MCP 10/10, GitHub Action, SARIF, public CVE-to-rule ledger.
Python★ 13↓ 4551/mes15 sept 2026
Apache-2.015 sept 2026 · métricas 2.10.0
PyPI · RubyGems
90Excelenteíndice de salud
OWASP/www-project-agent-memory-guard
OWASP Foundation web repository
Python★ 155↓ 2902/mes25 ago 2026
Apache-2.025 ago 2026 · métricas 2.10.0
PyPI · Go · npm
89Excelenteíndice de salud
cordum-io/cordum
The action firewall for AI agents. Enforce policy and human approval before risky tool calls, shell commands, workflows, and production changes, with auditable evidence.
Go · TypeScript · Python★ 505↓ 14/mes17 sept 2026
Licencia propia17 sept 2026 · métricas 2.10.0
npm
89Excelenteíndice de salud
node9-ai/node9-proxy
The Execution Security Layer for the Agentic Era. Providing deterministic "Sudo" governance and audit logs for autonomous AI agents.
TypeScript★ 211↓ 7422/mes13 sept 2026
Apache-2.013 sept 2026 · métricas 2.10.0
PyPI · npm · crates.io +1
86Excelenteíndice de salud
QWED-AI/qwed-verification
Open-source AI verification infrastructure for deterministic verification of LLM outputs, tool calls, code, schemas, and agent state before production execution.
Python★ 58↓ 764/mes18 sept 2026
Apache-2.018 sept 2026 · métricas 2.10.0
npm · PyPI
86Excelenteíndice de salud
issdandavis/SCBE-AETHERMOORE
Geometric AI governance and evaluation framework with a 14-layer security pipeline, semantic projection, and reproducible benchmark lanes.
Python · TypeScript★ 6↓ 4607/mes26 ago 2026
MIT26 ago 2026 · métricas 2.10.0
npm
84Excelenteíndice de salud
IgorGanapolsky/ThumbGate
ThumbGate Pre-Action Checks self-improve from ranked lessons and repeated failures, hard-block detected secret leaks, and block matches in strict mode.
JavaScript · HTML★ 26↓ 2369/mes11 sept 2026
MIT11 sept 2026 · métricas 2.10.0
npm
83Excelenteíndice de salud
JKHeadley/instar
Persistent Claude Code agents with scheduling, sessions, memory, and Telegram.
TypeScript★ 84↓ 41.5K/mes21 oct 2026
MIT21 oct 2026 · métricas 2.10.0
PyPI · npm
83Excelenteíndice de salud
PrismorSec/prismor
Self-hosted runtime control plane for AI agents. Observe or HITL approve or Block rogue tool calls before it executes: secret leaks, prompt injection, supply chain etc in a local dashboard. Agent agnostic (Claude, codex, langchain etc.)
Python★ 343↓ 2863/mes11 sept 2026
Apache-2.011 sept 2026 · métricas 2.10.0
Go · npm
81Excelenteíndice de salud
AltairaLabs/PromptKit
Test, red-team, and deploy LLM applications with confidence. Multi-provider support (OpenAI, Anthropic, Gemini), MCP integration, self-play testing, and production SDK.
Go★ 920 sept 2026
Licencia propia20 sept 2026 · métricas 2.10.0
npm
81Excelenteíndice de salud
lua-ai-global/governance
Zero-dependency TypeScript SDK for AI agent governance: policy enforcement, injection detection, tamper-evident audit, and standards mapping (EU AI Act, OWASP, NIST, ISO 42001)
TypeScript★ 26↓ 18.7K/mes13 sept 2026
MIT13 sept 2026 · métricas 2.10.0
PyPI
80Excelenteíndice de salud
Cogensec/agentegrity
The open standard for AI agent integrity. Evaluate, enforce, and prove that autonomous agents are adversarially coherent, environmentally portable, and verifiably assured.
Python · TypeScript★ 3↓ 156/mes18 sept 2026
Apache-2.018 sept 2026 · métricas 2.10.0
PyPI · npm
80Excelenteíndice de salud
alizahidraja/isnad
Grade every agent, scraper and model in a claim's chain — provenance, trust scoring and audit evidence for LLM pipelines
Python★ 53↓ 2089/mes21 oct 2026
Apache-2.021 oct 2026 · métricas 2.10.0
PyPI
80Excelenteíndice de salud
b7n0de/proofbundle
Offline cryptographic receipts for AI evaluation results — Ed25519 + RFC 6962 Merkle + optional SD-JWT. Integrity, not truth
Python★ 2↓ 1203/mes13 sept 2026
MIT13 sept 2026 · métricas 2.10.0
PyPI
80Excelenteíndice de salud
mauhpr/agentlint
Real-time guardrails for AI coding agents. 77 rules across 8 packs covering code quality, security, and infrastructure safety. Inline ignore directives, path exemptions, hook timing, and session summaries.
Python★ 32↓ 9332/mes1 oct 2026
MIT1 oct 2026 · métricas 2.10.0
PyPI
78Buenoíndice de salud
Sahil170595/quantfit
Quantize an LLM and check it still refuses what it should — a GPU-aware quantization CLI that measures the safety drift of the quantization it just performed.
Python★ 1↓ 2468/mes12 oct 2026
Apache-2.012 oct 2026 · métricas 2.10.0
PyPI
78Buenoíndice de salud
auspexai/tenant-sdk
SDK for authoring research tenants on AuspexAI
Python★ 0↓ 9632/mes8 sept 2026
Apache-2.08 sept 2026 · métricas 2.10.0
PyPI
78Buenoíndice de salud
fathom-lab/styxx
Verification for the agent era. Your coding agent's PR summary cannot lie about its diff - one CI line. Plus the research: the first map of which AI minds can read each other. Every claim machine-verified against committed receipts, negatives included. pip install styxx
Python · HTML★ 15↓ 575/mes19 oct 2026
MIT19 oct 2026 · métricas 2.10.0
Go
78Buenoíndice de salud
gumieri/nenya
A lightweight, highly secure AI API Gateway/Proxy written in Go. Acts as transparent middleware between local AI coding clients (OpenCode/Pi/Cursor) and upstream LLM providers (Gemini, DeepSeek, Zhipu z.ai).
Go★ 2813 sept 2026
Apache-2.013 sept 2026 · métricas 2.10.0
PyPI
78Buenoíndice de salud
provael/provael
Provael — red-team open Vision-Language-Action (VLA) robot policies in simulation and report an Attack Success Rate (ASR). Prove it. Prevail.
Python★ 6↓ 2516/mes11 sept 2026
Apache-2.011 sept 2026 · métricas 2.10.0
npm
77Buenoíndice de salud
Keesan12/martin-loop
Make AI coding agents safe to scale autonomously: assign work, cap spend, enforce policy, verify output, roll back failures, learn from loops, and prove ROI across every repo.
TypeScript · JavaScript★ 51↓ 2344/mes11 sept 2026
Apache-2.011 sept 2026 · métricas 2.10.0
Go · npm
77Buenoíndice de salud
OrlojHQ/orloj
An orchestration runtime for multi-agent AI systems. Declare agents, tools, and policies as YAML; Orloj schedules, executes, routes, and governs them for production-grade operation.
Go · TypeScript★ 12118 sept 2026
Apache-2.018 sept 2026 · métricas 2.10.0
PyPI · npm
77Buenoíndice de salud
QWED-AI/qwed-open-responses
Verification guards for OpenAI Responses API - Verify AI agent outputs before execution
Python · TypeScript★ 1↓ 239/mes18 sept 2026
Apache-2.018 sept 2026 · métricas 2.10.0
PyPI
77Buenoíndice de salud
tuliplabs-ai/tulip-agents
The agent framework where the model never holds the trigger — every consequential action clears your policy first, waits for a human when it matters, and lands on a record you can verify. Build on it, or put it around the agent you already have.
Python★ 1↓ 5295/mes8 oct 2026
Apache-2.08 oct 2026 · métricas 2.10.0
Packagist
77Buenoíndice de salud
voku/agent-loop
♾️ Umbrella php package and unified CLI for the governed agentic-coding loop: board (kanban), learning, and recall-compiler.
PHP★ 4↓ 3672/mes18 sept 2026
MIT18 sept 2026 · métricas 2.10.0
PyPI
75Buenoíndice de salud
crucible-security/crucible
pytest for AI agents - Autonomous red-teaming, behavioral monitoring & security testing for LLM agents
Python★ 48↓ 1793/mes10 sept 2026
Apache-2.010 sept 2026 · métricas 2.10.0