All tags
Catalogue tag

#multimodal

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

39 records
Tagged “multimodal”Ranked by health index
PyPI · crates.io
98Exceptionalhealth index
Eventual-Inc/Daft
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
Rust · Python · Jupyter Notebook★ 5,731↓ 6.3M/moAug 28, 2026
Apache-2.0Aug 28, 2026 · metrics 2.10.0
PyPI · crates.io · npm
98Exceptionalhealth index
rerun-io/rerun
Visualize, query, and stream to train on multimodal robotics data.
Rust · Python★ 11.4KAug 27, 2026
Apache-2.0Aug 27, 2026 · metrics 2.10.0
PyPI
96Exceptionalhealth index
bentoml/BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
Python★ 8,782↓ 256.2K/moAug 12, 2026
Apache-2.0Aug 12, 2026 · metrics 2.10.0
npm · Go · PyPI
96Exceptionalhealth index
genkit-ai/genkit
Open-source framework for building agentic apps in JavaScript, Go, Dart, and Python, built and used in production by Google
TypeScript · Go · Python★ 6,384↓ 4.2M/moAug 28, 2026
Apache-2.0Aug 28, 2026 · metrics 2.10.0
PyPI
95Exceptionalhealth index
Blaizzy/mlx-audio
A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.
Python★ 7,796↓ 582.2K/moAug 28, 2026
MITAug 28, 2026 · metrics 2.10.0
npm
95Exceptionalhealth index
TanStack/ai
🤖 Type-safe, provider-agnostic TypeScript AI SDK for streaming chat, tool calling, agents, and multimodal apps across OpenAI, Anthropic, Gemini, React, Vue, Svelte, and Solid.
TypeScript★ 2,907↓ 613.6K/moJul 22, 2026
MITJul 22, 2026 · metrics 2.10.0
PyPI
95Exceptionalhealth index
embeddings-benchmark/mteb
MTEB: State-of-the-art evaluation of embeddings across languages and modalities
Python · Jupyter Notebook★ 3,362Jul 19, 2026
Apache-2.0Jul 19, 2026 · metrics 2.10.0
PyPI
94Exceptionalhealth index
modelscope/ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, ...) (AAAI 2025).
Python★ 15.4K↓ 111K/moAug 27, 2026
Apache-2.0Aug 27, 2026 · metrics 2.10.0
crates.io · Maven · npm +1
94Exceptionalhealth index
spiraldb/vortex
An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.
Rust★ 3,089↓ 42.1K/moJul 16, 2026
Apache-2.0Jul 16, 2026 · metrics 2.10.0
crates.io · Maven · npm +1
94Exceptionalhealth index
vortex-data/vortex
An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.
Rust★ 3,094↓ 2/moJul 23, 2026
Apache-2.0Jul 23, 2026 · metrics 2.10.0
npm
89Excellenthealth index
Mintplex-Labs/anything-llm
Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
JavaScript★ 64.3KAug 4, 2026
MITAug 4, 2026 · metrics 2.10.0
PyPI
89Excellenthealth index
opendatalab/MinerU
Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.
Python★ 76.8K↓ 313.3K/moAug 4, 2026
Custom licenseAug 4, 2026 · metrics 2.10.0
PyPI · npm
89Excellenthealth index
pixeltable/pixeltable
Unified multimodal backend for AI data apps
Python★ 1,606Aug 1, 2026
Apache-2.0Aug 1, 2026 · metrics 2.10.0
crates.io
89Excellenthealth index
screenpipe/screenpipe
YC (S26) | Record your screen 24/7 and plug into your agents. Local, private, secure. Connect to OpenClaw, Hermes agent and 100+ apps
Rust · TypeScript★ 20.7KAug 5, 2026
Custom licenseAug 5, 2026 · metrics 2.10.0
PyPI
88Excellenthealth index
yzhao062/pyod
A Python library for anomaly detection across tabular, time series, graph, text, image, and audio data. 60+ detectors, benchmark-backed ADEngine orchestration, and an agentic workflow for AI agents.
Python★ 9,977↓ 5M/moAug 27, 2026
BSD-2-ClauseAug 27, 2026 · metrics 2.10.0
npm · Go
86Excellenthealth index
mikkoparkkola/trvl
Travel MCP server + CLI for AI assistants — flights, hotels, trains, cars, ferries, price alerts. No API keys, single Go binary. 1 smart MCP tool + 66 aliases (98.9% smaller tools/list). Works with Claude, Cursor, Windsurf, Codex.
Go★ 47↓ 7,583/moJul 17, 2026
Custom licenseJul 17, 2026 · metrics 2.10.0
npm
84Excellenthealth index
muxinc/ai
A typescript library for connecting videos in your Mux account to multi-modal LLMs.
TypeScript★ 71↓ 26.7K/moJul 17, 2026
Custom licenseJul 17, 2026 · metrics 2.10.0
PyPI
83Excellenthealth index
mlfoundations/open_clip
An open source implementation of CLIP.
Python★ 14.1K↓ 3M/moAug 27, 2026
Custom licenseAug 27, 2026 · metrics 2.10.0
NuGet · PyPI
77Goodhealth index
LayeredCraft/alexa-vox-craft
No repository description published.
C#★ 2Jul 22, 2026
Apache-2.0Jul 22, 2026 · metrics 2.10.0
PyPI · npm
77Goodhealth index
tong-io/tongflow
TongFlow : An Open-Source Multi-Modal GenAI Workflow Studio
TypeScript · Python★ 701↓ 2,361/moJul 31, 2026
AGPL-3.0Jul 31, 2026 · metrics 2.10.0
Go · PyPI
75Goodhealth index
JoakimCarlsson/ai
A Go toolkit for building AI agents and applications across multiple providers. Unified LLM client, agent framework with handoffs, tool calling, streaming, structured output, MCP integration, and cost tracking.
Go★ 40Sep 5, 2026
MITSep 5, 2026 · metrics 2.10.0
PyPI
75Goodhealth index
PreferredAI/cornac
A Comparative Framework for Multimodal Recommender Systems
Python · Cython · C++★ 1,052Jul 23, 2026
Apache-2.0Jul 23, 2026 · metrics 2.10.0
PyPI · crates.io
67Goodhealth index
Egoist-Machines/LodeDB
World's fastest and most compact embedded vector database: exact by default, multimodal, local-first, and GPU-accelerated
Python · Rust★ 90Aug 5, 2026
Apache-2.0Aug 5, 2026 · metrics 2.10.0
PyPI
65Goodhealth index
MaximeRivest/attachments
Easiest way to give context to LLMs; Attachments has the ambition to be the general funnel for any files to be transformed into images+text for large language models context by only adding 2 lines to your python code.
Python★ 368↓ 7,307/moAug 24, 2026
MITAug 24, 2026 · metrics 2.10.0
npm
63Moderatehealth index
kenryu42/pi-grok-cli
Use your X Premium or SuperGrok subscription in pi—with automatic vision routing for text-only models.
TypeScript★ 22↓ 2,291/moJul 23, 2026
MITJul 23, 2026 · metrics 2.10.0
npm
63Moderatehealth index
mrgoonie/multix-cli
AI multimodal CLI — Gemini, MiniMax, OpenRouter, ffmpeg, ImageMagick, doc-to-md
TypeScript★ 9↓ 5,820/moSep 4, 2026
MITSep 4, 2026 · metrics 2.10.0
PyPI · crates.io
63Moderatehealth index
solpbc/solstone-journal
Navigate Life Intelligently
Python★ 17↓ 6,851/moAug 1, 2026
AGPL-3.0Aug 1, 2026 · metrics 2.10.0
PyPI
62Moderatehealth index
HUANGCHIHHUNGLeo/claude-real-video
Let Claude (or any LLM) actually watch a video — scene-aware, deduplicated frames + transcript, from a URL or local file. Runs locally, MIT.
Python★ 2,095↓ 6,592/moAug 31, 2026
MITAug 31, 2026 · metrics 2.10.0
PyPI · npm · Maven
59Moderatehealth index
hpnkv/a11
A streaming action runtime for AI agents, model serving, and multimodal APIs
C++ · Python · TypeScript★ 1↓ 17K/moSep 2, 2026
No licenseSep 2, 2026 · metrics 2.10.0
PyPI
59Moderatehealth index
queelius/muse
Model-agnostic multi-modality generation server with plugin discovery: OpenAI-compatible TTS, embeddings, and image generation. Drop a Python file in ~/.muse/models/ to add a backend.
Python★ 1↓ 2,729/moAug 3, 2026
Apache-2.0Aug 3, 2026 · metrics 2.10.0