All tags
Catalogue tag

#multimodal

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

19 records
Tagged “multimodal”Ranked by health index
PyPI · crates.io
88Excellenthealth index
eventual-inc/daft
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
Rust · Python · Jupyter Notebook★ 5,635↓ 916.1K/moJul 17, 2026
Apache-2.0Jul 17, 2026 · metrics 1.13.0
PyPI
84Goodhealth index
modelscope/ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, ...) (AAAI 2025).
Python★ 14.8K↓ 103.3K/moJul 15, 2026
Apache-2.0Jul 15, 2026 · metrics 1.13.0
Go · npm · PyPI
83Goodhealth index
genkit-ai/genkit
Open-source framework for building AI-powered apps in JavaScript, Go, and Python, built and used in production by Google
TypeScript · Go · Python★ 6,252Jul 20, 2026
Apache-2.0Jul 20, 2026 · metrics 1.13.0
npm
82Goodhealth index
TanStack/ai
🤖 Type-safe, provider-agnostic TypeScript AI SDK for streaming chat, tool calling, agents, and multimodal apps across OpenAI, Anthropic, Gemini, React, Vue, Svelte, and Solid.
TypeScript★ 2,907↓ 613.6K/moJul 22, 2026
MITJul 22, 2026 · metrics 1.13.0
PyPI
82Goodhealth index
embeddings-benchmark/mteb
MTEB: State-of-the-art evaluation of embeddings across languages and modalities
Python · Jupyter Notebook★ 3,362Jul 19, 2026
Apache-2.0Jul 19, 2026 · metrics 1.13.0
PyPI
82Goodhealth index
modelscope/swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, ...) (AAAI 2025).
Python★ 14.8K↓ 0/moJul 14, 2026
Apache-2.0Jul 14, 2026 · metrics 1.13.0
crates.io · npm · PyPI
82Goodhealth index
rerun-io/rerun
Visualize, query, and stream to train on multimodal robotics data.
Rust★ 11.1K↓ 0/moJul 14, 2026
Apache-2.0Jul 14, 2026 · metrics 1.13.0
crates.io · Maven · npm +1
80Goodhealth index
spiraldb/vortex
An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.
Rust★ 3,089↓ 42.1K/moJul 16, 2026
Apache-2.0Jul 16, 2026 · metrics 1.13.0
npm
75Goodhealth index
Mintplex-Labs/anything-llm
Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
JavaScript★ 63.2K↓ 0/moJul 13, 2026
MITJul 13, 2026 · metrics 1.13.0
PyPI
73Goodhealth index
yzhao062/pyod
A Python library for anomaly detection across tabular, time series, graph, text, image, and audio data. 60+ detectors, benchmark-backed ADEngine orchestration, and an agentic workflow for AI agents.
Python★ 9,920↓ 4.7M/moJul 20, 2026
BSD-2-ClauseJul 20, 2026 · metrics 1.13.0
npm · Go
72Goodhealth index
mikkoparkkola/trvl
Travel MCP server + CLI for AI assistants — flights, hotels, trains, cars, ferries, price alerts. No API keys, single Go binary. 1 smart MCP tool + 66 aliases (98.9% smaller tools/list). Works with Claude, Cursor, Windsurf, Codex.
Go★ 47↓ 7,583/moJul 17, 2026
Custom licenseJul 17, 2026 · metrics 1.13.0
PyPI
72Goodhealth index
mlfoundations/open_clip
An open source implementation of CLIP.
Python★ 14K↓ 2.9M/moJul 21, 2026
Custom licenseJul 21, 2026 · metrics 1.13.0
npm
70Goodhealth index
muxinc/ai
A typescript library for connecting videos in your Mux account to multi-modal LLMs.
TypeScript★ 71↓ 26.7K/moJul 17, 2026
Custom licenseJul 17, 2026 · metrics 1.13.0
Go · PyPI
64Moderatehealth index
JoakimCarlsson/ai
A Go toolkit for building AI agents and applications across multiple providers. Unified LLM client, agent framework with handoffs, tool calling, streaming, structured output, MCP integration, and cost tracking.
Go★ 33↓ 0/moJul 14, 2026
MITJul 14, 2026 · metrics 1.13.0
NuGet · PyPI
64Moderatehealth index
LayeredCraft/alexa-vox-craft
No repository description published.
C#★ 2Jul 22, 2026
Apache-2.0Jul 22, 2026 · metrics 1.13.0
npm · RubyGems · Go +2
50Moderatehealth index
runapi-ai/gemini-omni-sdk
RunAPI Gemini Omni SDK for audio, character, and video workflows in JavaScript, Python, Ruby, Go, Java, and PHP
Java★ 0↓ 218/moJul 21, 2026
Apache-2.0Jul 21, 2026 · metrics 1.13.0
PyPI
49At riskhealth index
Leon-Sander/Local-Multimodal-AI-Chat
Self-hostable multimodal chat with local LLMs (Ollama/OpenAI): PDF RAG, image chat, and Whisper voice, Streamlit + Docker.
Python★ 203Jul 18, 2026
GPL-3.0Jul 18, 2026 · metrics 1.13.0
42At riskhealth index
volcengine/ark-cli
The fastest way to put Volcengine Ark in your terminal and your AI agent — go from prompt to generated media, multimodal answer, or deployed endpoint in a single command, no API glue code.
Python★ 67Jul 15, 2026
Apache-2.0Jul 15, 2026 · metrics 1.13.0
PyPI
39At riskhealth index
waybarrios/crystal
CRYSTAL: Beyond Final Answers: Benchmark for Transparent Multimodal Reasoning Evaluation | arXiv 2603.13099
Python★ 2Jul 17, 2026
No licenseJul 17, 2026 · metrics 1.13.0