#llm

Production-grade resilience for Go services calling LLMs and tools. Composable patterns — circuit breaker, retry, rate limit, timeout, bulkhead, fallback, hedge, adaptive concurrency, cost budget, stream timeout — with first-class OpenTelemetry, Prometheus, and slog observability. Zero core deps.

No repository description published.

Power CLI and Workflow manager for LLMs (core package)

Write once. Generate everything. A modular, open-source ecosystem for building durable, observable, multimodal AI systems. Text, voice, image, video, music — one unified interface, any provider, any model, local or cloud.

Ultra-fast token & cost tracker for LLM Token Usage (e.g. Claude Code)

MCP server for Swiss labor market data – unemployment, job seekers, open positions & occupational accidents (SECO/AMSTAT, SSUV)

Swiss cultural heritage: SIKART artists, Nationalmuseum, Helveticat, Memobase, Dodis

MCP Server for Swiss public transport – OJP journey planner, real-time departures, disruptions, occupancy, ticket prices, train formations and open data from opentransportdata.swiss

🚀 Django-CFG: Type-Safe Django Configuration Framework with AI-Ready Infrastructure

Node.js binding of llama.cpp

A cognition aware database engine for AI agent memory. Purpose built in Rust with WAL, HNSW, knowledge graphs, and speculative context pre assembly. Not a wrapper, a ground up storage engine that thinks.

The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken with additional features.

One CLI to orchestrate them all. Manage a team of AI agents executing tasks in parallel from your terminal using a command line interface to manage them all. Manage a team of artificial intelligence agents who perform tasks in parallel from your terminal or offline on a local or server

Practical productivity tools for Claude Code, Codex-CLI, and similar CLI coding agents.

The agentic harness for AI coding agents — intelligence is rented, the harness is owned. Runs the full work cycle: intent briefs, bounded RAG context from real code intelligence, persistent memory, preventive guardrails, and performance evals. One CLI + MCP server, SQLite inside. Claude Code, Codex, Gemini CLI, Cursor & OpenCode.

Unified LLM provider abstraction for Rust - support for OpenAI, Anthropic, Gemini, xAI, OpenRouter, and more

Automated parallel code reviewer using AI Coding Agent CLIs

The immune system for AI coding agents

Deterministic state engine for managing conversation state and constraints in LLM applications.

Rails Engine with MCP compliant Spec.

AI SDK for building AI-powered applications in Go

.NET Framework for Backgrounding & Device Hardware Services (iOS, MacOS, tvOS, Android, Windows, Linxux, & Web)

Open source Enterprise AI Gateway for API, MCP and agent, and AI model traffic. One Apache-2.0 binary: 72 native providers behind an OpenAI-compatible API, or serve vLLM and llama.cpp on your own GPUs. Keys, budgets, guardrails, semantic cache, WAF.

An enum representing various Semantic Kernel types.

Your personal AI assistant - self-hosted, containerized, and intentionally opinionated.

Google Analytics 4 data to AI agents, agentic workflows, and MCP clients. Give agents analysis-ready access to website traffic, user behavior, and performance data with schema discovery, server-side aggregation, and safe defaults that reduce data wrangling.

Integration bundle for Symfony AI components

Desktop AI Assistant powered by GPT-6, GPT-5, o1, o3, Gemini, Claude, Ollama, DeepSeek, Perplexity, Grok, Bielik, chat, vision, voice, RAG, image and video generation, agents, tools, MCP, plugins, speech synthesis and recognition, web search, memory, presets, assistants,and more. Linux, Windows, Mac

C# SDK for the Cohere API -- chat completions, embeddings, and reranking

The agent framework where the model never holds the trigger — every consequential action clears your policy first, waits for a human when it matters, and lands on a record you can verify. Build on it, or put it around the agent you already have.