All tags
Catalogue tag

#ai-safety

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

76 records
Tagged “ai-safety”Ranked by health index
PyPI · npm
99Exceptionalhealth index
microsoft/PyRIT
The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.
Python · TypeScript★ 4,573Oct 3, 2026
MITOct 3, 2026 · metrics 2.10.0
npm · Go · crates.io
96Exceptionalhealth index
microsoft/agent-governance-toolkit
AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.
Python★ 6,138↓ 14.7K/moAug 28, 2026
MITAug 28, 2026 · metrics 2.10.0
PyPI
92Excellenthealth index
cvs-health/uqlm
[JMLR 2026] "UQLM: A Python Package for Uncertainty Quantification in Large Language Models"
Python★ 1,200↓ 1,591/moSep 19, 2026
Apache-2.0Sep 19, 2026 · metrics 2.10.0
PyPI · Go · npm
92Excellenthealth index
preloop/preloop
The open-source AI agent control plane: MCP firewall, model gateway with budgets, human approvals, runtime observability, and audit trails
Python · TypeScript★ 62↓ 364/moSep 18, 2026
Apache-2.0Sep 18, 2026 · metrics 2.10.0
PyPI · npm
91Excellenthealth index
sattyamjjain/agent-audit-kit
Static scanner for MCP-connected AI agent pipelines. 348 rules across 14 categories, 14 compliance frameworks, OWASP Agentic 10/10 + MCP 10/10, GitHub Action, SARIF, public CVE-to-rule ledger.
Python★ 13↓ 4,551/moSep 15, 2026
Apache-2.0Sep 15, 2026 · metrics 2.10.0
PyPI · RubyGems
90Excellenthealth index
OWASP/www-project-agent-memory-guard
OWASP Foundation web repository
Python★ 155↓ 2,902/moAug 25, 2026
Apache-2.0Aug 25, 2026 · metrics 2.10.0
PyPI · Go · npm
89Excellenthealth index
cordum-io/cordum
The action firewall for AI agents. Enforce policy and human approval before risky tool calls, shell commands, workflows, and production changes, with auditable evidence.
Go · TypeScript · Python★ 505↓ 14/moSep 17, 2026
Custom licenseSep 17, 2026 · metrics 2.10.0
npm
89Excellenthealth index
node9-ai/node9-proxy
The Execution Security Layer for the Agentic Era. Providing deterministic "Sudo" governance and audit logs for autonomous AI agents.
TypeScript★ 211↓ 7,422/moSep 13, 2026
Apache-2.0Sep 13, 2026 · metrics 2.10.0
PyPI · npm · crates.io +1
86Excellenthealth index
QWED-AI/qwed-verification
Open-source AI verification infrastructure for deterministic verification of LLM outputs, tool calls, code, schemas, and agent state before production execution.
Python★ 58↓ 764/moSep 18, 2026
Apache-2.0Sep 18, 2026 · metrics 2.10.0
npm · PyPI
86Excellenthealth index
issdandavis/SCBE-AETHERMOORE
Geometric AI governance and evaluation framework with a 14-layer security pipeline, semantic projection, and reproducible benchmark lanes.
Python · TypeScript★ 6↓ 4,607/moAug 26, 2026
MITAug 26, 2026 · metrics 2.10.0
npm
84Excellenthealth index
IgorGanapolsky/ThumbGate
ThumbGate Pre-Action Checks self-improve from ranked lessons and repeated failures, hard-block detected secret leaks, and block matches in strict mode.
JavaScript · HTML★ 26↓ 2,369/moSep 11, 2026
MITSep 11, 2026 · metrics 2.10.0
npm
84Excellenthealth index
JKHeadley/instar
Persistent Claude Code agents with scheduling, sessions, memory, and Telegram.
TypeScript★ 77↓ 157.9K/moSep 5, 2026
MITSep 5, 2026 · metrics 2.10.0
PyPI · npm
83Excellenthealth index
PrismorSec/prismor
Self-hosted runtime control plane for AI agents. Observe or HITL approve or Block rogue tool calls before it executes: secret leaks, prompt injection, supply chain etc in a local dashboard. Agent agnostic (Claude, codex, langchain etc.)
Python★ 343↓ 2,863/moSep 11, 2026
Apache-2.0Sep 11, 2026 · metrics 2.10.0
Go · npm
81Excellenthealth index
AltairaLabs/PromptKit
Test, red-team, and deploy LLM applications with confidence. Multi-provider support (OpenAI, Anthropic, Gemini), MCP integration, self-play testing, and production SDK.
Go★ 9Sep 20, 2026
Custom licenseSep 20, 2026 · metrics 2.10.0
npm
81Excellenthealth index
lua-ai-global/governance
Zero-dependency TypeScript SDK for AI agent governance: policy enforcement, injection detection, tamper-evident audit, and standards mapping (EU AI Act, OWASP, NIST, ISO 42001)
TypeScript★ 26↓ 18.7K/moSep 13, 2026
MITSep 13, 2026 · metrics 2.10.0
PyPI
80Excellenthealth index
Cogensec/agentegrity
The open standard for AI agent integrity. Evaluate, enforce, and prove that autonomous agents are adversarially coherent, environmentally portable, and verifiably assured.
Python · TypeScript★ 3↓ 156/moSep 18, 2026
Apache-2.0Sep 18, 2026 · metrics 2.10.0
PyPI · npm
80Excellenthealth index
alizahidraja/isnad
Grade every agent, scraper and model in a claim's chain — provenance, trust scoring and audit evidence for LLM pipelines
Python★ 53↓ 2,089/moOct 21, 2026
Apache-2.0Oct 21, 2026 · metrics 2.10.0
PyPI
80Excellenthealth index
b7n0de/proofbundle
Offline cryptographic receipts for AI evaluation results — Ed25519 + RFC 6962 Merkle + optional SD-JWT. Integrity, not truth
Python★ 2↓ 1,203/moSep 13, 2026
MITSep 13, 2026 · metrics 2.10.0
PyPI
80Excellenthealth index
mauhpr/agentlint
Real-time guardrails for AI coding agents. 77 rules across 8 packs covering code quality, security, and infrastructure safety. Inline ignore directives, path exemptions, hook timing, and session summaries.
Python★ 32↓ 9,332/moOct 1, 2026
MITOct 1, 2026 · metrics 2.10.0
PyPI
78Goodhealth index
Sahil170595/quantfit
Quantize an LLM and check it still refuses what it should — a GPU-aware quantization CLI that measures the safety drift of the quantization it just performed.
Python★ 1↓ 2,468/moOct 12, 2026
Apache-2.0Oct 12, 2026 · metrics 2.10.0
PyPI
78Goodhealth index
auspexai/tenant-sdk
SDK for authoring research tenants on AuspexAI
Python★ 0↓ 9,632/moSep 8, 2026
Apache-2.0Sep 8, 2026 · metrics 2.10.0
PyPI
78Goodhealth index
fathom-lab/styxx
Verification for the agent era. Your coding agent's PR summary cannot lie about its diff - one CI line. Plus the research: the first map of which AI minds can read each other. Every claim machine-verified against committed receipts, negatives included. pip install styxx
Python · HTML★ 15↓ 575/moOct 19, 2026
MITOct 19, 2026 · metrics 2.10.0
Go
78Goodhealth index
gumieri/nenya
A lightweight, highly secure AI API Gateway/Proxy written in Go. Acts as transparent middleware between local AI coding clients (OpenCode/Pi/Cursor) and upstream LLM providers (Gemini, DeepSeek, Zhipu z.ai).
Go★ 28Sep 13, 2026
Apache-2.0Sep 13, 2026 · metrics 2.10.0
PyPI
78Goodhealth index
provael/provael
Provael — red-team open Vision-Language-Action (VLA) robot policies in simulation and report an Attack Success Rate (ASR). Prove it. Prevail.
Python★ 6↓ 2,516/moSep 11, 2026
Apache-2.0Sep 11, 2026 · metrics 2.10.0
npm
77Goodhealth index
Keesan12/martin-loop
Make AI coding agents safe to scale autonomously: assign work, cap spend, enforce policy, verify output, roll back failures, learn from loops, and prove ROI across every repo.
TypeScript · JavaScript★ 51↓ 2,344/moSep 11, 2026
Apache-2.0Sep 11, 2026 · metrics 2.10.0
Go · npm
77Goodhealth index
OrlojHQ/orloj
An orchestration runtime for multi-agent AI systems. Declare agents, tools, and policies as YAML; Orloj schedules, executes, routes, and governs them for production-grade operation.
Go · TypeScript★ 121Sep 18, 2026
Apache-2.0Sep 18, 2026 · metrics 2.10.0
PyPI · npm
77Goodhealth index
QWED-AI/qwed-open-responses
Verification guards for OpenAI Responses API - Verify AI agent outputs before execution
Python · TypeScript★ 1↓ 239/moSep 18, 2026
Apache-2.0Sep 18, 2026 · metrics 2.10.0
PyPI
77Goodhealth index
tuliplabs-ai/tulip-agents
The agent framework where the model never holds the trigger — every consequential action clears your policy first, waits for a human when it matters, and lands on a record you can verify. Build on it, or put it around the agent you already have.
Python★ 1↓ 5,295/moOct 8, 2026
Apache-2.0Oct 8, 2026 · metrics 2.10.0
Packagist
77Goodhealth index
voku/agent-loop
♾️ Umbrella php package and unified CLI for the governed agentic-coding loop: board (kanban), learning, and recall-compiler.
PHP★ 4↓ 3,672/moSep 18, 2026
MITSep 18, 2026 · metrics 2.10.0
PyPI
75Goodhealth index
crucible-security/crucible
pytest for AI agents - Autonomous red-teaming, behavioral monitoring & security testing for LLM agents
Python★ 48↓ 1,793/moSep 10, 2026
Apache-2.0Sep 10, 2026 · metrics 2.10.0