All tags
Catalogue tag

#multimodal

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

61 records
Tagged “multimodal”Ranked by health index
PyPI
75Goodhealth index
PreferredAI/cornac
A Comparative Framework for Multimodal Recommender Systems
Python · Cython★ 1,055Sep 13, 2026
Apache-2.0Sep 13, 2026 · metrics 2.10.0
PyPI
73Goodhealth index
HUANGCHIHHUNGLeo/claude-real-video
Let Claude (or any LLM) actually watch a video — scene-aware, deduplicated frames + transcript, from a URL or local file. Runs locally, MIT.
Python · HTML · CSS★ 2,248↓ 3,394/moOct 21, 2026
MITOct 21, 2026 · metrics 2.10.0
Go · PyPI
73Goodhealth index
JoakimCarlsson/ai
A Go toolkit for building AI agents and applications across multiple providers. Unified LLM client, agent framework with handoffs, tool calling, streaming, structured output, MCP integration, and cost tracking.
Go★ 45Oct 21, 2026
MITOct 21, 2026 · metrics 2.10.0
PyPI · crates.io
73Goodhealth index
solpbc/solstone-journal
navigate life intelligently
Rust★ 19↓ 6,851/moSep 15, 2026
AGPL-3.0Sep 15, 2026 · metrics 2.10.0
npm
71Goodhealth index
mrgoonie/multix-cli
AI multimodal CLI — Gemini, MiniMax, OpenRouter, ffmpeg, ImageMagick, doc-to-md
TypeScript★ 46↓ 7,145/moOct 21, 2026
MITOct 21, 2026 · metrics 2.10.0
npm
67Goodhealth index
kenryu42/pi-grok-cli
Use your X Premium or SuperGrok subscription in pi.
TypeScript★ 25↓ 1,535/moSep 13, 2026
MITSep 13, 2026 · metrics 2.10.0
PyPI
65Goodhealth index
MaximeRivest/attachments
Easiest way to give context to LLMs; Attachments has the ambition to be the general funnel for any files to be transformed into images+text for large language models context by only adding 2 lines to your python code.
Python★ 368↓ 7,307/moAug 24, 2026
MITAug 24, 2026 · metrics 2.10.0
npm
63Moderatehealth index
hyssostech/sketch-thru-plan-sdk-js
Quickstart, samples, documentation for the Sketch-thru-Plan multimodal engine SDK
JavaScript★ 1↓ 1,634/moOct 22, 2026
MITOct 22, 2026 · metrics 2.10.0
Go · PyPI
63Moderatehealth index
masterkeysrd/loom
Loom is a high-performance, graph-based AI workflow engine for Go. It allows you to build complex agentic systems by defining multi-step workflows as directed graphs, seamlessly connecting them to any large language model, and persisting execution state for long-running or interrupted tasks.
Go · TypeScript★ 0Sep 14, 2026
No licenseSep 14, 2026 · metrics 2.10.0
PyPI
62Moderatehealth index
EverMind-AI/EverAlgo
EverAlgo is the algorithm library behind EverMind's memory system — stateless, storage-free, focused on extraction and ranking only. Orchestration, persistence, and routing live upstream in evermem.
Python★ 29↓ 178.7K/moOct 13, 2026
Apache-2.0Oct 13, 2026 · metrics 2.10.0
PyPI · npm · Maven
62Moderatehealth index
hpnkv/a11
A streaming action runtime for AI agents, model serving, and multimodal APIs
C++ · Python · TypeScript★ 11↓ 11.7K/moOct 21, 2026
Apache-2.0Oct 21, 2026 · metrics 2.10.0
npm
59Moderatehealth index
talesofai/generation-sdk
No repository description published.
TypeScript★ 1↓ 6,005/moSep 13, 2026
MITSep 13, 2026 · metrics 2.10.0
npm
57Moderatehealth index
FuzzySoul/dsh-free-vision
为DSH(DeepSeek Harness)量身打造的视觉插件,现已支持agent调用图片显示/Vision plugin for DSH(DeepSeek Harness),support Proactive Image Display.
JavaScript★ 7↓ 4,909/moSep 18, 2026
MITSep 18, 2026 · metrics 2.10.0
PyPI
57Moderatehealth index
queelius/muse
Model-agnostic multi-modality generation server with plugin discovery: OpenAI-compatible TTS, embeddings, and image generation. Drop a Python file in ~/.muse/models/ to add a backend.
Python★ 1↓ 262/moSep 16, 2026
Apache-2.0Sep 16, 2026 · metrics 2.10.0
npm · RubyGems · Go +2
57Moderatehealth index
runapi-ai/gemini-omni-sdk
RunAPI Gemini Omni SDK for audio, character, and video workflows in JavaScript, Python, Ruby, Go, Java, and PHP
Java★ 0↓ 312/moSep 12, 2026
Apache-2.0Sep 12, 2026 · metrics 2.10.0
npm
57Moderatehealth index
runtypelabs/mixlayer-ai-provider
AI SDK provider for Mixlayer — the fully oxidized inference API
TypeScript · JavaScript★ 1↓ 4,069/moSep 16, 2026
MITSep 16, 2026 · metrics 2.10.0
npm
54Moderatehealth index
getpipher/vision
Capability-aware vision + paste extension for the pi coding agent. Delegates image analysis only when the active model is text-only; passes through natively for multimodal models (zero delegation).
TypeScript★ 13↓ 1,588/moSep 16, 2026
MITSep 16, 2026 · metrics 2.10.0
PyPI
53Moderatehealth index
PaddlePaddle/PaddleMIX
Paddle Multimodal Integration and eXploration, supporting mainstream multi-modal tasks, including end-to-end large-scale multi-modal pretrain models and diffusion model toolbox. Equipped with high performance and flexibility.
Python · Jupyter Notebook★ 723↓ 1,283/moSep 19, 2026
Apache-2.0Sep 19, 2026 · metrics 2.10.0
npm
51Moderatehealth index
Flyvhidbwo/dsh-vision-proxy
DeepSeek Harness 插件:DeepSeek Pro 大脑 + 自动识图。GUI 附加图片默认经官方 deepseek-v4-flash-vision-exp 原生识图,转译成文字后交给 DeepSeek 作答(纯文本的 V4-Pro 也能看图);支持百炼/智谱/OpenRouter 等任意 OpenAI 兼容 VLM,无 key 自动探测本地 Ollama;安装时有一问式确认
JavaScript★ 14↓ 2,602/moSep 22, 2026
MITSep 22, 2026 · metrics 2.10.0
npm
51Moderatehealth index
hedging8563/tokenlab-mcp-server
OpenAPI-generated MCP server for TokenLab text, image, video, music, 3D, audio, files, embeddings, rerank, translation, and async tasks.
JavaScript★ 0↓ 448/moSep 17, 2026
MITSep 17, 2026 · metrics 2.10.0
PyPI
50Moderatehealth index
danijar/granular
Fast dataset format and loader
Python★ 24↓ 33K/moOct 11, 2026
MITOct 11, 2026 · metrics 2.10.0
PyPI
48Weakhealth index
Leon-Sander/Local-Multimodal-AI-Chat
Self-hostable multimodal chat with local LLMs (Ollama/OpenAI): PDF RAG, image chat, and Whisper voice, Streamlit + Docker.
Python★ 206Sep 11, 2026
GPL-3.0Sep 11, 2026 · metrics 2.10.0
npm
47Weakhealth index
jing-hy/picturereader
DSH plugin: pixel-to-text image reading for text-only models. image_scan/image_ocr/image_sample tools + image-reading skill (34-image trained methodology). Pure local, optional PaddleOCR.
JavaScript★ 36↓ 2,442/moOct 21, 2026
MITOct 21, 2026 · metrics 2.10.0
npm
45Weakhealth index
volcengine/ark-cli
The fastest way to put Volcengine Ark in your terminal and your AI agent — go from prompt to generated media, multimodal answer, or deployed endpoint in a single command, no API glue code.
Python★ 120↓ 491/moSep 8, 2026
Apache-2.0Sep 8, 2026 · metrics 2.10.0
Go
44Weakhealth index
ikhsan3adi/gemini-web2api
Blazing fast Go port of gemini-web2api. Convert Google Gemini web into OpenAI-compatible API. Zero cost, single static binary.
Go★ 38Sep 20, 2026
MITSep 20, 2026 · metrics 2.10.0
PyPI
34At Riskhealth index
datachain-ai/datachain
The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure
Python★ 2,827↓ 15.9K/moOct 21, 2026
Apache-2.0Oct 21, 2026 · metrics 2.10.0
PyPI
34At Riskhealth index
waybarrios/crystal
CRYSTAL: Beyond Final Answers: Benchmark for Transparent Multimodal Reasoning Evaluation | arXiv 2603.13099
Python★ 2Jul 17, 2026
No licenseJul 17, 2026 · metrics 2.10.0
npm
33At Riskhealth index
AnEntrypoint/acptoapi
OpenAI-compatible HTTP facade over ACP (Kilo + opencode)
JavaScript★ 0↓ 5,312/moSep 15, 2026
MITSep 15, 2026 · metrics 2.10.0
npm
33At Riskhealth index
kalyanjanumpally/sap-joule-ai-plugin
Reference implementation: SAP Joule procurement copilot backed by a CAP AI service and an LLM-agnostic plugin (Anthropic / Ollama / SAP Generative AI Hub).
JavaScript★ 2↓ 4,372/moSep 18, 2026
No licenseSep 18, 2026 · metrics 2.10.0