PyPI · npm · crates.io99Exceptionalhealth index
C++ · C# · Python★ 2,548↓ 205K/moSep 14, 2026
PyPI96Exceptionalhealth index

MakazhanAlpamys/SoupFine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
Python★ 5,794Sep 8, 2026
PyPI95Exceptionalhealth index

Blaizzy/mlx-vlmMLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
Python★ 5,431↓ 881.2K/moAug 28, 2026
Go95Exceptionalhealth index

qualcomm/GenieXRun frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
Rust · Go · C++★ 8,329Aug 28, 2026
npm95Exceptionalhealth index

tetherto/qvacOpen-source local AI SDK - run AI on-device with no cloud, no API keys. Supports GGUF, RAG, image, music, and video generation, speech-to-text, P2P inference, and more. Cross-platform: Linux, macOS, Windows, Android, iOS.
TypeScript · JavaScript · C++★ 597↓ 202.1K/moSep 10, 2026
npm94Exceptionalhealth index

libre-webui/libre-webuiA local-first workspace for chat, private knowledge, artifacts, and isolated model-driven work. Self-hosted. Provider-flexible. Apache 2.0.
TypeScript · JavaScript★ 81↓ 4,019/moSep 11, 2026
npm · crates.io93Exceptionalhealth index

screenpipe/screenpipeYC (S26) | Open Computer History | Record your screen continuously locally and provide context to your agents (Claude, Codex, Openclaw, Hermes, Runner...)
TypeScript · Rust★ 21.6K↓ 35K/moSep 16, 2026
npm88Excellenthealth index

Mintplex-Labs/anything-llmStop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
JavaScript★ 66.1KSep 16, 2026
Maven87Excellenthealth index

SKaiNET-developers/SKaiNETSKaiNET makes local AI practical for developers: simple to build with, multiplatform by design, and optimized for native performance without compromises.
Kotlin★ 48Sep 9, 2026
PyPI · npm87Excellenthealth index

lyonzin/knowledge-ragLocal RAG MCP server for Claude Code — hybrid search (semantic + BM25), cross-encoder reranking, 13 MCP tools, 20 format parsers. Zero external servers, zero API keys.
Python★ 290↓ 2,794/moOct 4, 2026
Go86Excellenthealth index

initializ/forgeForge is the open-source runtime for Anthropic's Agent Skills standard — built for the agent that runs next to a service, in your environment, on infrastructure you already operate. Write a SKILL.md. Compile to a portable, hardened agent. Deploy it anywhere containers run: Kubernetes, on-prem, air-gapped, embedded in CI, or as an A2A endpoint.
Go★ 227Sep 10, 2026
npm · PyPI86Excellenthealth index
Python★ 224↓ 12.4K/moSep 11, 2026
npm86Excellenthealth index

shinpr/mcp-local-ragLocal-first RAG server for developers. Semantic + keyword search for code and technical docs. Works with MCP or CLI. Fully private, zero setup.
TypeScript★ 400↓ 17K/moSep 19, 2026
npm · PyPI86Excellenthealth index

tobi/qmdmini cli search engine for your docs, knowledge bases, meeting notes, whatever. Tracking current sota approaches while being all local
TypeScript · Python★ 29.8K↓ 173.2K/moSep 18, 2026
PyPI84Excellenthealth index

tobocop2/lilbeeThe whole local AI stack in one executable: it runs and manages local AI models across every GPU, and it's a search engine you can talk to, with cited answers from your files, code, and the web. MCP server for coding agents, web crawler, TUI, CLI, REST API, Python library. No Ollama or LM Studio needed, works with both.
Python★ 54↓ 3,110/moSep 18, 2026
npm83Excellenthealth index

jagreehal/ai-sdk-ollamaA Vercel AI SDK provider for Ollama built on the official ollama package. Type safe, future proof, with cross provider compatibility and native Ollama features.
TypeScript★ 131↓ 223.6K/moSep 17, 2026
PyPI · npm80Excellenthealth index

youssofal/MTPLX3x faster speeds on MLX | Qwen 3.8 27B | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.
Python · Swift★ 2,329↓ 9,464/moSep 15, 2026
npm · PyPI78Goodhealth index

signerless/llm-checkerAdvanced CLI tool that scans your hardware and tells you exactly which LLM or sLLM models you can run locally, with full Ollama integration.
JavaScript★ 2,970↓ 6,841/moSep 15, 2026
TypeScript★ 1,755Sep 9, 2026

xopcai/xopcOpen-source, local-first personal AI assistant that lives on your computer, gets to know you over time, and keeps what matters moving.
TypeScript★ 37↓ 10.2K/moSep 5, 2026

airiclenz/apogeeTerminal coding agent for local LLMs (llama.cpp, Ollama, vLLM) and any OpenAI-compatible API. OS-sandboxed autonomy, MCP, sessions. Go.
Go★ 8Oct 20, 2026

m62624/pi-code-plannerStructured planning, bounded memory, TDD, and Git guardrails for local coding models in Pi Code (I don't know TypeScript at all; this is mostly a local-model experiment, with occasional help from Claude Code)
TypeScript★ 6↓ 421/moSep 13, 2026
Go · npm67Goodhealth index

tevfik/gleannA lightweight, high-performance AI/RAG workspace and autonomous agent framework implemented in Go. Inspired by the Leann RAG backend architecture
Go★ 41Oct 19, 2026
npm · PyPI · crates.io65Goodhealth index

TaeSooPark-PTS/LatticeAILocal-first private AI memory layer / Digital Brain for conversations, documents, decisions, and model-agnostic knowledge.
Rust · TypeScript · Python★ 2↓ 2,389/moSep 11, 2026
PyPI63Moderatehealth index

mizorewww/laya-coremlLocal Laya typed decisions on Apple Core ML and Neural Engine. Validated ports, ~5 ms short decisions on M3 Max, reproducible speed and energy benchmarks.
Python★ 1,567↓ 2,468/moOct 10, 2026

thirawat27/WutYour terminal failed. Now it can answer back. Repair a command. Recall an incantation. Understand the risk — without giving up control.
Go★ 22Oct 5, 2026
npm60Moderatehealth index

wundercorp/openmodelUse any AI model, locally or in the cloud, while tracking on-device token usage and collecting token telemetry data.
TypeScript · JavaScript · CSS★ 18↓ 570/moSep 17, 2026
Packagist59Moderatehealth index

hamdyelbatal122/nativeragNative Local AI & Vector RAG Engine for Laravel. Seamlessly integrate Ollama and LM Studio with zero infra and 100% data privacy.
PHP★ 3↓ 9,562/moOct 4, 2026

microsoft/WindowsMLOfficial repo for Windows ML - Microsoft's high-performance local AI inferencing framework for Windows.
Mixed★ 29Sep 18, 2026
npm · Go56Moderatehealth index

mlhher/late-cliFully autonomous AI dev agent in pure Go built on empirical research. Get real work done on consumer hardware, even with tiny context windows.
Go★ 424Sep 11, 2026