PyPI98Exceptionalhealth index
C++ · Python★ 28.4KSep 16, 2026
PyPI95Exceptionalhealth index

Blaizzy/mlx-audioA text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.
Python★ 7,796↓ 582.2K/moAug 28, 2026
PyPI95Exceptionalhealth index

Blaizzy/mlx-vlmMLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
Python★ 5,431↓ 881.2K/moAug 28, 2026
PyPI · Maven95Exceptionalhealth index

maziyarpanahi/openmedLocal-first healthcare AI: clinical NER & HIPAA PII de-identification that runs 100% on-device. 2,200+ medical models, 21 languages, Apple MLX + Python, no cloud, no patient data leaving your network. Apache-2.0
Python★ 5,328Sep 16, 2026
PyPI95Exceptionalhealth index
Python★ 6,813↓ 1.2M/moAug 28, 2026
PyPI94Exceptionalhealth index

raullenchai/Rapid-MLXThe fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider.
Python · Swift★ 3,753Sep 15, 2026
PyPI93Exceptionalhealth index

mflux-community/mfluxApple MLX native implementations of state-of-the-art generative image & video models
Python★ 2,459↓ 30.6K/moOct 8, 2026
crates.io · PyPI · npm91Excellenthealth index

AlexsJones/llmfitHundreds of models & providers. One command to find what runs on your hardware.
Rust★ 36.7K↓ 3,340/moSep 16, 2026
PyPI91Excellenthealth index

waybarrios/vllm-mlxHigh-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.
Python★ 1,626↓ 5,191/moOct 20, 2026
Go89Excellenthealth index

defilantech/LLMKubeKubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
Go★ 207Sep 5, 2026
PyPI · npm87Excellenthealth index

jagoff/memoYour coding agent starts every session with amnesia — memo fixes that, 100% on your machine. Persistent memory for Claude Code, Codex, Cursor & any MCP client: Markdown source of truth, hybrid search (MLX/CPU + sqlite-vec), time-machine, contradiction radar, nightly self-optimization. No cloud, no keys.
Python★ 18↓ 4,408/moSep 12, 2026
PyPI87Excellenthealth index

lpalbou/mlx-genGenerative image and video runtimes for Apple Silicon (MLX): text/image-to-image, instruction editing, masked edit, text/image/reference-to-video, video editing, and restoration.
Python★ 25↓ 3,543/moSep 10, 2026
PyPI86Excellenthealth index

arogozhnikov/einopsFlexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)
Python · Jupyter Notebook★ 9,582↓ 27.1M/moAug 28, 2026
PyPI86Excellenthealth index

jundot/omlxLLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Python★ 21.8KSep 16, 2026
PyPI · npm84Excellenthealth index
Python · C++★ 1,791↓ 817/moSep 10, 2026
PyPI · npm84Excellenthealth index

rajveer43/VeloxQuant-MLXFast KV-cache quantization for Apple Silicon (MLX) — 43 research-adapted compression methods with Metal kernels
Python★ 15↓ 7,549/moSep 5, 2026
PyPI · npm81Excellenthealth index
Python · C++ · HTML★ 5↓ 2,537/moOct 3, 2026
PyPI81Excellenthealth index

binlecode/actopApple Silicon (M1–M4) power, GPU, ANE & memory-bandwidth monitor — sudoless TUI + Python API for profiling local LLM / MLX / CoreML inference
Python★ 1↓ 2,580/moSep 14, 2026
Go · npm81Excellenthealth index

lordmathis/llamactlUnified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
Go · TypeScript★ 152Sep 20, 2026
PyPI81Excellenthealth index
Python★ 91↓ 574/moOct 20, 2026
PyPI · npm80Excellenthealth index

youssofal/MTPLX3x faster speeds on MLX | Qwen 3.8 27B | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.
Python · Swift★ 2,329↓ 9,464/moSep 15, 2026
npm · crates.io78Goodhealth index
Rust · TypeScript★ 157↓ 1,570/moSep 16, 2026
PyPI · npm77Goodhealth index

jjang-ai/vmlxvMLX - Use MLX models easily - JANGQ (GGUF for MLX) - Not dependant on mlx_vlm
Python · TypeScript★ 849↓ 4,381/moSep 13, 2026

lpalbou/AbstractFrameworkWrite once. Generate everything. A modular, open-source ecosystem for building durable, observable, multimodal AI systems. Text, voice, image, video, music — one unified interface, any provider, any model, local or cloud.
Shell · Python · PowerShell★ 5↓ 3,155/moOct 18, 2026
crates.io75Goodhealth index
Rust · Python★ 372↓ 215.6K/moSep 15, 2026

ARahim3/mlx-dsparkUp to 4× faster LLM decoding on Apple Silicon, lossless. Native MLX port of DeepSeek's DSpark & z-lab's DFlash speculative decoding — Gemma-4, Qwen3.8, Muse-Glimmer, Nemotron, LFM2.5, Ornith-1.0, ternary Bonsai-27B.
Python · Swift★ 719↓ 2,266/moOct 19, 2026

asher/mlx-kquantNative K-quant support for MLX, with a quantization and fine-tuning toolchain for Apple Silicon
C++ · Python★ 6↓ 3,360/moAug 23, 2026

druide67/asiaiMulti-engine LLM benchmark & monitoring CLI for Apple Silicon
Python★ 12↓ 4,662/moSep 11, 2026
PyPI · npm67Goodhealth index
Python★ 1Sep 8, 2026
npm · PyPI · crates.io65Goodhealth index

TaeSooPark-PTS/LatticeAILocal-first private AI memory layer / Digital Brain for conversations, documents, decisions, and model-agnostic knowledge.
Rust · TypeScript · Python★ 2↓ 2,389/moSep 11, 2026