#llm

Any PyTorch model to NNEF exchange format

Runtime governance for AI agents. Allow, warn, or block every model and tool call before it commits. Hash-chained audit for every decision. Compliance packs for SOC 2, HIPAA, PCI DSS, EU AI Act, SR 11-7, and FDA CSA. Apache 2.0.

Your Automation Powerhouse

Model Context Protocol for WinDbg.

Your Intelligence, Orchestrated. Every builder. Every team. Every agent. For Everyone.

Persistent memory for LLMs and apps. Content-addressed storage with dedupe, compression, full-text and vector search.

Ollama SDK for .NET

Open-source TypeScript SDK and agent runtime you own end to end. Agent.create / prompt / stream / resume, 43 LLM providers on your own keys, MCP with OAuth PKCE, subagents, workflows, evals, memory, and a bubblewrap+seccomp kernel sandbox for tool execution. Local-first, opt-in cloud, Apache-2.0.

MCP server providing unified access to Claude Code, Codex, Gemini, Grok and Mistral CLIs with session management, retry logic, and async job orchestration.

High-throughput, self-hostable LLM router in Go. BYO provider keys, k8s-native, key pooling + batch + usage observability.

AgentScope Golang: Agent-Oriented Programming for Building LLM Applications

Test, red-team, and deploy LLM applications with confidence. Multi-provider support (OpenAI, Anthropic, Gemini), MCP integration, self-play testing, and production SDK.

Framework for AI agents to build and maintain a digital brain through Obsidian wiki | Memory System for Agents

Local-first personal agentic OS and everything app for coding, knowledge work, web design, automations, and artifacts.

Zero-config LLM cost & quality monitoring for Ruby apps - automatically log AI API calls and collect user feedback for analysis using Coolhand.

⚠️ DEPRECATED — Use adaptive-memory-multi-model-router instead

Multi-resource rate limiting for LLM APIs. Reserve tokens before you call, refund what you don't use, stay under the limit across workers.

Flow Agentique Grimoire-kit

No repository description published.

MindWork AI Studio is a free, independent cross-platform desktop app for local and cloud LLMs across providers, built to democratize AI access.

A high-performance, OpenTelemetry-compliant tracing SDK designed specifically for Large Language Model (LLM) applications and AI workloads.

Kubernetes operator for deploying and managing LiteLLM AI Gateway. Declarative CRDs for models, teams, users, and virtual keys with bidirectional config sync, SSO/SCIM user provisioning, and OLM support. Built with Operator SDK.

SigRank MCP — AI operator evaluation and token cascade efficiency tools. The yield cascade + live leaderboard as MCP tools any agent can call. On-device token scanner + tabbed TUI dashboard. npm i -g sigrank

The missing bridge between your ML models and your AI agents.

Unified observability gateway for AI agents — one MCP server for Prometheus, Loki, and any backend, with cross-signal anomaly detection and a built-in Web UI.

Fabricatio is a Python library designed for building applications that leverage Large Language Models (LLMs) using an event-based agent structure. It utilizes Handlebars for templating and provides a robust framework for managing tasks, workflows, and toolboxes, enabling developers to create intelligent and efficient applications.

Local MCP server that exposes eBay Sell APIs to AI assistants with OAuth, tool gating, and stdio/HTTP transports.

An auto-updating AI Model Catalog - Single binary CLI, REST/SSE Server - SDKs - Golang Package.

Local-first automation Agent & deterministic workflow engine — the secure control layer between AI and your data. Data stays local. Connect your own LLM / files / notes / databases via Connector API. ReAct reasoning · DAG/WAL/Saga/idempotent execution · MCP · offline-capable.

MCP server for RabbitMQ