#llm

Production-grade Harness Engineering Framework for multi-developer AI coding agents — guardrails, state persistence, direction alignment, and self-correction across 6 IDEs. Zero dependencies.

Archived. Development has moved to SpaceFrontiers/summa.

Synthia SDKs (npm + PyPI: synthiaresearch) and the synthia CLI — eval your AI agent against simulated users

Local research agent — one command, a cited answer with its trust signals: source-authority mix, lexical citation verification, confidence, cost. CLI + MCP server. Runs on your own LLM router; nightly public report card. Zero hosted dependencies.

Enhanced fork of OpenWolf — a token-conscious second brain for Claude Code, with bounded storage, self-maintenance (openwolf doctor), .wolfignore scoping, and tunable retention. AGPL-3.0.

LLM capture proxy with Anthropic cache_control TTL stamping, vision handoff, concurrency gating, rate limiting, and a live inspection dashboard

An agent server. Agents, tools and models declared in files; every action checked against your policy before it runs. Any LLM, on your machine, Apache-2.0.

Wilma - AWS Bedrock Security Configuration Checker

Unified batch API for AI providers. Save up to 50% on LLM costs.

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

Local-first shared memory for Claude Code, Codex, OpenCode, Kimi, Grok, Cowork, and Hermes, with bounded observation and searchable Markdown context.

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

LangServe 🦜️🏓

The Tensorloop provide Raw speed AI Compoenents like Embedding, linear etc...

PrimeUIX is a shared package used by all Prime libraries, allowing PrimeTek teams to unify theming.

The Security Toolkit for LLM Interactions

An open-source terminal coding agent runtime and CLI for real project work.

Archived: use github.com/ronhuafeng/llm-go/llmcaller/codex; legacy v0.4.2 is immutable

Archived: use github.com/ronhuafeng/llm-go/llmkit; legacy v0.5.0 is immutable

Omnigent is an open-source AI agent framework and meta-harness: orchestrate Claude Code, Codex, Cursor, Pi, and custom agents — swap harnesses without rewriting, enforce policies and sandboxing, and collaborate in real time from any device.

🧑‍💻 Write your shell scripts in natural language

superglue (YC W25) builds integrations and tools from natural language. Get production-grade tools for long tail and enterprise systems.

Zero-knowledge, offline-first, encrypted document store with pluggable backends and multi-user access control

🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using Agentic Retrieval 🔄.