All tags
Catalogue tag

#multimodal

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

59 records
Tagged “multimodal”Ranked by health index
PyPI · crates.io
98Exceptionalhealth index
Eventual-Inc/Daft
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
Rust · Python · Jupyter Notebook★ 5,731↓ 6.3M/moAug 28, 2026
Apache-2.0Aug 28, 2026 · metrics 2.10.0
PyPI · crates.io · npm
98Exceptionalhealth index
rerun-io/rerun
Visualize, query, and stream to train on multimodal robotics data.
Rust · Python★ 11.4KAug 27, 2026
Apache-2.0Aug 27, 2026 · metrics 2.10.0
PyPI
96Exceptionalhealth index
NVIDIA-NeMo/DataDesigner
🎨 NeMo Data Designer: Generate high-quality synthetic data from scratch or from seed data.
Python · MDX★ 2,237Sep 19, 2026
Apache-2.0Sep 19, 2026 · metrics 2.10.0
npm
96Exceptionalhealth index
TanStack/ai
🤖 Type-safe, provider-agnostic TypeScript AI SDK for streaming chat, tool calling, agents, and multimodal apps across OpenAI, Anthropic, Gemini, React, Vue, Svelte, and Solid.
TypeScript★ 3,099↓ 998.8K/moSep 12, 2026
MITSep 12, 2026 · metrics 2.10.0
PyPI
96Exceptionalhealth index
bentoml/BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
Python★ 8,847↓ 256.2K/moSep 17, 2026
Apache-2.0Sep 17, 2026 · metrics 2.10.0
PyPI
96Exceptionalhealth index
embeddings-benchmark/mteb
MTEB: State-of-the-art evaluation of embeddings across languages and modalities
Python · Jupyter Notebook★ 3,419Sep 11, 2026
Apache-2.0Sep 11, 2026 · metrics 2.10.0
npm · Go · PyPI
96Exceptionalhealth index
genkit-ai/genkit
Open-source framework for building agentic apps in JavaScript, Go, Dart, and Python, built and used in production by Google
TypeScript · Go · Python★ 6,384↓ 4.2M/moAug 28, 2026
Apache-2.0Aug 28, 2026 · metrics 2.10.0
crates.io · Maven · npm +1
96Exceptionalhealth index
vortex-data/vortex
An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.
Rust★ 3,193Sep 13, 2026
Apache-2.0Sep 13, 2026 · metrics 2.10.0
PyPI
95Exceptionalhealth index
Blaizzy/mlx-audio
A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.
Python★ 7,796↓ 582.2K/moAug 28, 2026
MITAug 28, 2026 · metrics 2.10.0
PyPI · npm
95Exceptionalhealth index
pixeltable/pixeltable
The unified multimodal backend for AI data apps. Database, orchestration, and serving in one Python file.
Python★ 1,621↓ 4,543/moSep 15, 2026
Apache-2.0Sep 15, 2026 · metrics 2.10.0
PyPI
94Exceptionalhealth index
modelscope/ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, ...) (AAAI 2025).
Python★ 15.4K↓ 111K/moAug 27, 2026
Apache-2.0Aug 27, 2026 · metrics 2.10.0
PyPI
94Exceptionalhealth index
sgl-project/sglang-omni
SGLang-Omni is a high-performance serving framework for audio models (TTS, ASR) and unified multimodal models.
Python★ 1,289↓ 3,737/moSep 28, 2026
Apache-2.0Sep 28, 2026 · metrics 2.10.0
PyPI
93Exceptionalhealth index
Hebbian-Robotics/hflow
SDK for robotics teams to verify the quality of their data used for AI model training.
Python★ 284↓ 2,091/moOct 4, 2026
Apache-2.0Oct 4, 2026 · metrics 2.10.0
npm · crates.io
93Exceptionalhealth index
screenpipe/screenpipe
YC (S26) | Open Computer History | Record your screen continuously locally and provide context to your agents (Claude, Codex, Openclaw, Hermes, Runner...)
TypeScript · Rust★ 21.6K↓ 35K/moSep 16, 2026
Custom licenseSep 16, 2026 · metrics 2.10.0
PyPI
92Excellenthealth index
laminlabs/lamindb
Open-source data management for multimodal AI. Query, trace, and govern with a lineage-native, format-agnostic lakehouse for agents and teams. Supports biological formats and registries - by the creators of Scanpy. 🍊YC S22
Python★ 364↓ 30.7K/moSep 16, 2026
Apache-2.0Sep 16, 2026 · metrics 2.10.0
RubyGems
91Excellenthealth index
crmne/ruby_llm
The Ruby AI framework.
Ruby★ 4,474Oct 20, 2026
MITOct 20, 2026 · metrics 2.10.0
PyPI
91Excellenthealth index
opendatalab/MinerU
Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.
Python★ 80K↓ 141.6K/moSep 16, 2026
Custom licenseSep 16, 2026 · metrics 2.10.0
PyPI
91Excellenthealth index
waybarrios/vllm-mlx
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.
Python★ 1,626↓ 5,191/moOct 20, 2026
Apache-2.0Oct 20, 2026 · metrics 2.10.0
npm · Go
88Excellenthealth index
MikkoParkkola/trvl
Travel MCP server + CLI for AI assistants — flights, hotels, trains, cars, ferries, price alerts. No API keys, single Go binary. 1 smart MCP tool + 66 aliases (98.9% smaller tools/list). Works with Claude, Cursor, Windsurf, Codex.
Go★ 75↓ 2,518/moSep 9, 2026
Custom licenseSep 9, 2026 · metrics 2.10.0
npm
88Excellenthealth index
Mintplex-Labs/anything-llm
Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
JavaScript★ 66.1KSep 16, 2026
MITSep 16, 2026 · metrics 2.10.0
npm
88Excellenthealth index
muxinc/ai
A typescript library for connecting videos in your Mux account to multi-modal LLMs.
TypeScript★ 71↓ 50.3K/moSep 10, 2026
Custom licenseSep 10, 2026 · metrics 2.10.0
PyPI
88Excellenthealth index
yzhao062/pyod
A Python library for anomaly detection across tabular, time series, graph, text, image, and audio data. 60+ detectors, benchmark-backed ADEngine orchestration, and an agentic workflow for AI agents.
Python★ 9,977↓ 5M/moAug 27, 2026
BSD-2-ClauseAug 27, 2026 · metrics 2.10.0
npm
86Excellenthealth index
motis-project/motis
multimodal routing, geocoding, and map tiles
C++ · TypeScript · Svelte★ 586↓ 2,610/moSep 20, 2026
MITSep 20, 2026 · metrics 2.10.0
PyPI
83Excellenthealth index
mlfoundations/open_clip
An open source implementation of CLIP.
Python★ 14.1K↓ 3M/moAug 27, 2026
Custom licenseAug 27, 2026 · metrics 2.10.0
PyPI · npm
83Excellenthealth index
tong-io/tongflow
Modality-First GenAI Platform
TypeScript · Python★ 1,019↓ 1,123/moSep 15, 2026
AGPL-3.0Sep 15, 2026 · metrics 2.10.0
NuGet · PyPI
78Goodhealth index
LayeredCraft/alexa-vox-craft
No repository description published.
C#★ 2Sep 13, 2026
Apache-2.0Sep 13, 2026 · metrics 2.10.0
crates.io
78Goodhealth index
ai-dynamo/frontend-crates
No repository description published.
Rust · Python★ 24↓ 812.4K/moOct 20, 2026
Apache-2.0Oct 20, 2026 · metrics 2.10.0
crates.io · Go · npm +1
78Goodhealth index
antflydb/antfly
No repository description published.
Zig★ 429Sep 8, 2026
Custom licenseSep 8, 2026 · metrics 2.10.0
PyPI · crates.io
77Goodhealth index
Egoist-Machines/LodeDB
World's fastest and most compact embedded vector database: exact by default, multimodal, local-first, and GPU-accelerated
Python · Rust★ 98Sep 16, 2026
Apache-2.0Sep 16, 2026 · metrics 2.10.0
PyPI
77Goodhealth index
lpalbou/AbstractFramework
Write once. Generate everything. A modular, open-source ecosystem for building durable, observable, multimodal AI systems. Text, voice, image, video, music — one unified interface, any provider, any model, local or cloud.
Shell · Python · PowerShell★ 5↓ 3,155/moOct 18, 2026
MITOct 18, 2026 · metrics 2.10.0