#local-llm

Privacy-first CLI for running local LLMs — discover, configure, run, benchmark

Is your llama.cpp decode memory-bandwidth-bound? Find out in one command.

Use any AI model, locally or in the cloud, while tracking on-device token usage and collecting token telemetry data.

Run any local LLM engine, auto-tuned to your GPU — polished web UI + OpenAI/Anthropic-compatible API. Point Claude Code at your own machine in one command. No Electron, no Python, offline-first.

Scriptable, multi-provider AI agent for the terminal — pipe into it, script it, run it on any model, cloud or local

ローカルLLM（mlx / mlx-vlm / llama.cpp / router）を OpenAI 互換 API として起動・管理する軽量サーバー

AI Agent SDK designed for Go developers

Fully autonomous AI dev agent in pure Go built on empirical research. Get real work done on consumer hardware, even with tiny context windows.

A private reasoner for your terminal. Direct conversation or grounded multi-agent research, GPU-native and fully local. No API keys, no inference servers.

Llama cpp + CapacitorJS support

Open-source interoperability layer for Coding Agents & LLMs

Profile-based launcher for local LLM servers - start, stop and switch models on llama.cpp, Ollama and LM Studio from one CLI/TUI. Zero resident overhead, optional MCP control plane, importable as a Go library.

localaik is a local compatibility server for a subset of the Gemini and OpenAI APIs. Run one container locally, point your SDK to it, and the proxy serves both protocol shapes on the same port for tests and development.

No repository description published.

Run any local LLM with persistent memory and context. CLI agent over Ollama with SQLite-backed hybrid recall. No cloud.