Alle Tags
Katalog-Tag

#ai-safety

Alle Repositories im öffentlichen Register, die dieses Tag tragen — aus ihren GitHub-Topics oder den von ihren Paket-Registries veröffentlichten Schlagwörtern. Die Gesundheit wird nach derselben versionierten Methodik gemessen wie im übrigen Register.

76 Einträge
Getaggt als „ai-safety“Geordnet nach Gesundheitsindex
PyPI · npm
99AußergewöhnlichGesundheitsindex
microsoft/PyRIT
The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.
Python · TypeScript★ 4.5733. Okt. 2026
MIT3. Okt. 2026 · Metriken 2.10.0
npm · Go · crates.io
96AußergewöhnlichGesundheitsindex
microsoft/agent-governance-toolkit
AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.
Python★ 6.138↓ 14.7K/Monat28. Aug. 2026
MIT28. Aug. 2026 · Metriken 2.10.0
PyPI
92ExzellentGesundheitsindex
cvs-health/uqlm
[JMLR 2026] "UQLM: A Python Package for Uncertainty Quantification in Large Language Models"
Python★ 1.200↓ 1.591/Monat19. Sept. 2026
Apache-2.019. Sept. 2026 · Metriken 2.10.0
PyPI · Go · npm
92ExzellentGesundheitsindex
preloop/preloop
The open-source AI agent control plane: MCP firewall, model gateway with budgets, human approvals, runtime observability, and audit trails
Python · TypeScript★ 62↓ 364/Monat18. Sept. 2026
Apache-2.018. Sept. 2026 · Metriken 2.10.0
PyPI · npm
91ExzellentGesundheitsindex
sattyamjjain/agent-audit-kit
Static scanner for MCP-connected AI agent pipelines. 348 rules across 14 categories, 14 compliance frameworks, OWASP Agentic 10/10 + MCP 10/10, GitHub Action, SARIF, public CVE-to-rule ledger.
Python★ 13↓ 4.551/Monat15. Sept. 2026
Apache-2.015. Sept. 2026 · Metriken 2.10.0
PyPI · RubyGems
90ExzellentGesundheitsindex
OWASP/www-project-agent-memory-guard
OWASP Foundation web repository
Python★ 155↓ 2.902/Monat25. Aug. 2026
Apache-2.025. Aug. 2026 · Metriken 2.10.0
PyPI · Go · npm
89ExzellentGesundheitsindex
cordum-io/cordum
The action firewall for AI agents. Enforce policy and human approval before risky tool calls, shell commands, workflows, and production changes, with auditable evidence.
Go · TypeScript · Python★ 505↓ 14/Monat17. Sept. 2026
Eigene Lizenz17. Sept. 2026 · Metriken 2.10.0
npm
89ExzellentGesundheitsindex
node9-ai/node9-proxy
The Execution Security Layer for the Agentic Era. Providing deterministic "Sudo" governance and audit logs for autonomous AI agents.
TypeScript★ 211↓ 7.422/Monat13. Sept. 2026
Apache-2.013. Sept. 2026 · Metriken 2.10.0
PyPI · npm · crates.io +1
86ExzellentGesundheitsindex
QWED-AI/qwed-verification
Open-source AI verification infrastructure for deterministic verification of LLM outputs, tool calls, code, schemas, and agent state before production execution.
Python★ 58↓ 764/Monat18. Sept. 2026
Apache-2.018. Sept. 2026 · Metriken 2.10.0
npm · PyPI
86ExzellentGesundheitsindex
issdandavis/SCBE-AETHERMOORE
Geometric AI governance and evaluation framework with a 14-layer security pipeline, semantic projection, and reproducible benchmark lanes.
Python · TypeScript★ 6↓ 4.607/Monat26. Aug. 2026
MIT26. Aug. 2026 · Metriken 2.10.0
npm
84ExzellentGesundheitsindex
IgorGanapolsky/ThumbGate
ThumbGate Pre-Action Checks self-improve from ranked lessons and repeated failures, hard-block detected secret leaks, and block matches in strict mode.
JavaScript · HTML★ 26↓ 2.369/Monat11. Sept. 2026
MIT11. Sept. 2026 · Metriken 2.10.0
npm
83ExzellentGesundheitsindex
JKHeadley/instar
Persistent Claude Code agents with scheduling, sessions, memory, and Telegram.
TypeScript★ 84↓ 41.5K/Monat21. Okt. 2026
MIT21. Okt. 2026 · Metriken 2.10.0
PyPI · npm
83ExzellentGesundheitsindex
PrismorSec/prismor
Self-hosted runtime control plane for AI agents. Observe or HITL approve or Block rogue tool calls before it executes: secret leaks, prompt injection, supply chain etc in a local dashboard. Agent agnostic (Claude, codex, langchain etc.)
Python★ 343↓ 2.863/Monat11. Sept. 2026
Apache-2.011. Sept. 2026 · Metriken 2.10.0
Go · npm
81ExzellentGesundheitsindex
AltairaLabs/PromptKit
Test, red-team, and deploy LLM applications with confidence. Multi-provider support (OpenAI, Anthropic, Gemini), MCP integration, self-play testing, and production SDK.
Go★ 920. Sept. 2026
Eigene Lizenz20. Sept. 2026 · Metriken 2.10.0
npm
81ExzellentGesundheitsindex
lua-ai-global/governance
Zero-dependency TypeScript SDK for AI agent governance: policy enforcement, injection detection, tamper-evident audit, and standards mapping (EU AI Act, OWASP, NIST, ISO 42001)
TypeScript★ 26↓ 18.7K/Monat13. Sept. 2026
MIT13. Sept. 2026 · Metriken 2.10.0
PyPI
80ExzellentGesundheitsindex
Cogensec/agentegrity
The open standard for AI agent integrity. Evaluate, enforce, and prove that autonomous agents are adversarially coherent, environmentally portable, and verifiably assured.
Python · TypeScript★ 3↓ 156/Monat18. Sept. 2026
Apache-2.018. Sept. 2026 · Metriken 2.10.0
PyPI · npm
80ExzellentGesundheitsindex
alizahidraja/isnad
Grade every agent, scraper and model in a claim's chain — provenance, trust scoring and audit evidence for LLM pipelines
Python★ 53↓ 2.089/Monat21. Okt. 2026
Apache-2.021. Okt. 2026 · Metriken 2.10.0
PyPI
80ExzellentGesundheitsindex
b7n0de/proofbundle
Offline cryptographic receipts for AI evaluation results — Ed25519 + RFC 6962 Merkle + optional SD-JWT. Integrity, not truth
Python★ 2↓ 1.203/Monat13. Sept. 2026
MIT13. Sept. 2026 · Metriken 2.10.0
PyPI
80ExzellentGesundheitsindex
mauhpr/agentlint
Real-time guardrails for AI coding agents. 77 rules across 8 packs covering code quality, security, and infrastructure safety. Inline ignore directives, path exemptions, hook timing, and session summaries.
Python★ 32↓ 9.332/Monat1. Okt. 2026
MIT1. Okt. 2026 · Metriken 2.10.0
PyPI
78GutGesundheitsindex
Sahil170595/quantfit
Quantize an LLM and check it still refuses what it should — a GPU-aware quantization CLI that measures the safety drift of the quantization it just performed.
Python★ 1↓ 2.468/Monat12. Okt. 2026
Apache-2.012. Okt. 2026 · Metriken 2.10.0
PyPI
78GutGesundheitsindex
auspexai/tenant-sdk
SDK for authoring research tenants on AuspexAI
Python★ 0↓ 9.632/Monat8. Sept. 2026
Apache-2.08. Sept. 2026 · Metriken 2.10.0
PyPI
78GutGesundheitsindex
fathom-lab/styxx
Verification for the agent era. Your coding agent's PR summary cannot lie about its diff - one CI line. Plus the research: the first map of which AI minds can read each other. Every claim machine-verified against committed receipts, negatives included. pip install styxx
Python · HTML★ 15↓ 575/Monat19. Okt. 2026
MIT19. Okt. 2026 · Metriken 2.10.0
Go
78GutGesundheitsindex
gumieri/nenya
A lightweight, highly secure AI API Gateway/Proxy written in Go. Acts as transparent middleware between local AI coding clients (OpenCode/Pi/Cursor) and upstream LLM providers (Gemini, DeepSeek, Zhipu z.ai).
Go★ 2813. Sept. 2026
Apache-2.013. Sept. 2026 · Metriken 2.10.0
PyPI
78GutGesundheitsindex
provael/provael
Provael — red-team open Vision-Language-Action (VLA) robot policies in simulation and report an Attack Success Rate (ASR). Prove it. Prevail.
Python★ 6↓ 2.516/Monat11. Sept. 2026
Apache-2.011. Sept. 2026 · Metriken 2.10.0
npm
77GutGesundheitsindex
Keesan12/martin-loop
Make AI coding agents safe to scale autonomously: assign work, cap spend, enforce policy, verify output, roll back failures, learn from loops, and prove ROI across every repo.
TypeScript · JavaScript★ 51↓ 2.344/Monat11. Sept. 2026
Apache-2.011. Sept. 2026 · Metriken 2.10.0
Go · npm
77GutGesundheitsindex
OrlojHQ/orloj
An orchestration runtime for multi-agent AI systems. Declare agents, tools, and policies as YAML; Orloj schedules, executes, routes, and governs them for production-grade operation.
Go · TypeScript★ 12118. Sept. 2026
Apache-2.018. Sept. 2026 · Metriken 2.10.0
PyPI · npm
77GutGesundheitsindex
QWED-AI/qwed-open-responses
Verification guards for OpenAI Responses API - Verify AI agent outputs before execution
Python · TypeScript★ 1↓ 239/Monat18. Sept. 2026
Apache-2.018. Sept. 2026 · Metriken 2.10.0
PyPI
77GutGesundheitsindex
tuliplabs-ai/tulip-agents
The agent framework where the model never holds the trigger — every consequential action clears your policy first, waits for a human when it matters, and lands on a record you can verify. Build on it, or put it around the agent you already have.
Python★ 1↓ 5.295/Monat8. Okt. 2026
Apache-2.08. Okt. 2026 · Metriken 2.10.0
Packagist
77GutGesundheitsindex
voku/agent-loop
♾️ Umbrella php package and unified CLI for the governed agentic-coding loop: board (kanban), learning, and recall-compiler.
PHP★ 4↓ 3.672/Monat18. Sept. 2026
MIT18. Sept. 2026 · Metriken 2.10.0
PyPI
75GutGesundheitsindex
crucible-security/crucible
pytest for AI agents - Autonomous red-teaming, behavioral monitoring & security testing for LLM agents
Python★ 48↓ 1.793/Monat10. Sept. 2026
Apache-2.010. Sept. 2026 · Metriken 2.10.0