crates.io · npm96Exceptionalhealth index

hashintel/hash🚀 The open-source, multi-tenant platform for self-building knowledge graphs and simulation
TypeScript · Rust★ 1,660↓ 295.3K/moSep 18, 2026
PyPI95Exceptionalhealth index

Blaizzy/mlx-audioA text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.
Python★ 7,796↓ 582.2K/moAug 28, 2026
PyPI95Exceptionalhealth index

Blaizzy/mlx-vlmMLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
Python★ 5,431↓ 881.2K/moAug 28, 2026
PyPI94Exceptionalhealth index

raullenchai/Rapid-MLXThe fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider.
Python · Swift★ 3,753Sep 15, 2026
PyPI93Exceptionalhealth index

mflux-community/mfluxApple MLX native implementations of state-of-the-art generative image & video models
Python★ 2,459↓ 30.6K/moOct 8, 2026
PyPI91Excellenthealth index

waybarrios/vllm-mlxHigh-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.
Python★ 1,626↓ 5,191/moOct 20, 2026
Go89Excellenthealth index

defilantech/LLMKubeKubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
Go★ 207Sep 5, 2026
PyPI · npm87Excellenthealth index

jagoff/memoYour coding agent starts every session with amnesia — memo fixes that, 100% on your machine. Persistent memory for Claude Code, Codex, Cursor & any MCP client: Markdown source of truth, hybrid search (MLX/CPU + sqlite-vec), time-machine, contradiction radar, nightly self-optimization. No cloud, no keys.
Python★ 18↓ 4,408/moSep 12, 2026
PyPI87Excellenthealth index

lpalbou/mlx-genGenerative image and video runtimes for Apple Silicon (MLX): text/image-to-image, instruction editing, masked edit, text/image/reference-to-video, video editing, and restoration.
Python★ 25↓ 3,543/moSep 10, 2026
PyPI · npm87Excellenthealth index

rajveer43/VeloxQuant-MLXFast KV-cache quantization for Apple Silicon (MLX) — 43 research-adapted compression methods with Metal kernels
Python★ 32↓ 14.1K/moOct 21, 2026
npm86Excellenthealth index

achiya-automation/safari-mcpNative Safari browser automation for AI agents. 97 tools via AppleScript — zero overhead, keeps logins, runs silently in background. Drop-in alternative to Chrome DevTools MCP with 40-60% less CPU/heat on Apple Silicon.
JavaScript★ 183↓ 7,160/moSep 10, 2026
npm · crates.io86Excellenthealth index

drakulavich/kesha-voice-kitGive your tools a voice — speech to text and back, 25 languages, up to ~19× faster than Whisper. On your machine.
TypeScript · Rust★ 73↓ 964/moSep 14, 2026
PyPI86Excellenthealth index

jundot/omlxLLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Python★ 21.8KSep 16, 2026
crates.io · npm · PyPI84Excellenthealth index
Rust · Python★ 45↓ 42.9K/moOct 20, 2026
PyPI · npm81Excellenthealth index
Python · C++ · HTML★ 5↓ 2,537/moOct 3, 2026
PyPI81Excellenthealth index

binlecode/actopApple Silicon (M1–M4) power, GPU, ANE & memory-bandwidth monitor — sudoless TUI + Python API for profiling local LLM / MLX / CoreML inference
Python★ 1↓ 2,580/moSep 14, 2026
PyPI81Excellenthealth index
Python★ 91↓ 574/moOct 20, 2026
PyPI · npm80Excellenthealth index

youssofal/MTPLX3x faster speeds on MLX | Qwen 3.8 27B | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.
Python · Swift★ 2,329↓ 9,464/moSep 15, 2026

Arthur-Ficial/apfelThe free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API keys, no cloud, no downloads.
Swift · Python★ 6,386Sep 16, 2026

michaelellis003/smcxSequential inference for state-space models in JAX: Kalman-family filters and smoothers, and SMC methods including particle filters, tempered SMC, and SMC².
Python★ 3↓ 489/moSep 13, 2026

saiyam1814/kiacLocal Kubernetes on Apple's container framework - every node is its own lightweight VM. Metrics, storage, and LoadBalancer included.
Go★ 365Sep 10, 2026
npm · PyPI78Goodhealth index

signerless/llm-checkerAdvanced CLI tool that scans your hardware and tells you exactly which LLM or sLLM models you can run locally, with full Ollama integration.
JavaScript★ 2,970↓ 6,841/moSep 15, 2026
PyPI · npm77Goodhealth index

jjang-ai/vmlxvMLX - Use MLX models easily - JANGQ (GGUF for MLX) - Not dependant on mlx_vlm
Python · TypeScript★ 849↓ 4,381/moSep 13, 2026

arcships/light-ocrFast, offline OCR for Node.js & C++. PP-OCRv6 with Core ML / WebGPU hardware acceleration — recognize text in images with confidence scores & coordinates. npm: @arcships/light-ocr
C++ · JavaScript★ 503↓ 9,966/moSep 15, 2026

tillahoffmann/jax-mpsA JAX backend for Apple Metal Performance Shaders (MPS), enabling GPU-accelerated JAX computations on Apple Silicon.
C++ · Python★ 222↓ 1,401/moSep 10, 2026

ARahim3/mlx-dsparkUp to 4× faster LLM decoding on Apple Silicon, lossless. Native MLX port of DeepSeek's DSpark & z-lab's DFlash speculative decoding — Gemma-4, Qwen3.8, Muse-Glimmer, Nemotron, LFM2.5, Ornith-1.0, ternary Bonsai-27B.
Python · Swift★ 719↓ 2,266/moOct 19, 2026

DLTcollab/sse2neonA translator from Intel SSE intrinsics to Arm/Aarch64 NEON implementation
C++ · C · Python★ 1,532Sep 12, 2026

asher/mlx-kquantNative K-quant support for MLX, with a quantization and fine-tuning toolchain for Apple Silicon
C++ · Python★ 6↓ 3,360/moAug 23, 2026

druide67/asiaiMulti-engine LLM benchmark & monitoring CLI for Apple Silicon
Python★ 12↓ 4,662/moSep 11, 2026

ooples/AiDotNet.TensorsThe fastest .NET tensor library. Beats MathNet (6x), NumSharp (3200x), matches TorchSharp CPU - pure managed C# with hand-tuned AVX2/FMA SIMD kernels. Optional CUDA/OpenCL GPU acceleration.
C#★ 11Sep 6, 2026