#llama

llama_cpp.rb provides Ruby bindings for llama.cpp

Node.js binding of llama.cpp

Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.

AI sovereignty for the world's most trusted runtime.

Local-first AI coding agent for desktop, terminal, VS Code, Visual Studio, and CI code reviews.

Train and serve LLMs at extreme speed and massive throughput.

.NET library for on-demand local AI model inference — zero bundled models, lazy loading, hardware-aware GPU/CPU selection, 10 task types including embeddings, generation, vision, and audio.

AirLLM 70B inference with single 4GB GPU

Auto-translate i18n locale files with AI. Translate i18next JSON, Gettext PO, Java .properties, iOS .strings, Rails YAML, and TS/JS catalogues using ChatGPT, Claude, Gemini, or local Ollama models. CLI, Node library, and GitHub Action.

AI Chatbots in terminal for free

The easiest way to use Ollama in .NET

VS Code extension for LLM-assisted code/text completion

Pure-Go, no-cgo local LLM inference — run Gemma, Qwen, Llama and friends from safetensors or GGUF in a single static binary.