All tags
Catalogue tag

#data-pipelines

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

24 records
Tagged “data-pipelines”Ranked by health index
PyPI · npm · Go +1
100Exceptionalhealth index
apache/airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Python★ 46.9K↓ 14.3M/moSep 16, 2026
Apache-2.0Sep 16, 2026 · metrics 2.10.0
Maven · npm
99Exceptionalhealth index
apache/dolphinscheduler
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
Java · TypeScript★ 14.4KAug 27, 2026
Apache-2.0Aug 27, 2026 · metrics 2.10.0
PyPI
99Exceptionalhealth index
kedro-org/kedro
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
Python★ 11K↓ 1.2M/moSep 17, 2026
Custom licenseSep 17, 2026 · metrics 2.10.0
PyPI
98Exceptionalhealth index
Unstructured-IO/unstructured
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
HTML★ 15.4K↓ 3.5M/moSep 16, 2026
Apache-2.0Sep 16, 2026 · metrics 2.10.0
PyPI · npm
98Exceptionalhealth index
dagster-io/dagster
An orchestration platform for the development, production, and observation of data assets.
Python · TypeScript★ 16.2K↓ 9M/moSep 16, 2026
Apache-2.0Sep 16, 2026 · metrics 2.10.0
PyPI
98Exceptionalhealth index
elementary-data/elementary
The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.
HTML · Python★ 2,410↓ 1M/moSep 17, 2026
Apache-2.0Sep 17, 2026 · metrics 2.10.0
PyPI · npm
98Exceptionalhealth index
meltano/meltano
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
Python★ 2,626↓ 229.1K/moSep 17, 2026
MITSep 17, 2026 · metrics 2.10.0
Go · npm · PyPI
96Exceptionalhealth index
bruin-data/bruin
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
Go★ 1,691Sep 5, 2026
Apache-2.0Sep 5, 2026 · metrics 2.10.0
PyPI · npm
95Exceptionalhealth index
kedro-org/kedro-viz
Visualise your Kedro data and machine-learning pipelines and track your experiments.
JavaScript · Python★ 760↓ 770K/moSep 13, 2026
Apache-2.0Sep 13, 2026 · metrics 2.10.0
PyPI · crates.io · Maven +1
92Excellenthealth index
feldera/feldera
The Feldera Incremental Computation Engine
Rust · Java · Python★ 2,088↓ 9,229/moSep 18, 2026
Custom licenseSep 18, 2026 · metrics 2.10.0
PyPI · crates.io
90Excellenthealth index
pathwaycom/pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Python · Rust★ 62.3K↓ 7,236/moSep 20, 2026
Custom licenseSep 20, 2026 · metrics 2.10.0
PyPI
89Excellenthealth index
datajoint/datajoint-python
Relational Workflows: where database schemas define executable data pipelines.
Python★ 197Sep 15, 2026
Apache-2.0Sep 15, 2026 · metrics 2.10.0
PyPI
88Excellenthealth index
OpenDCAI/DataFlow
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
Python★ 8,186Sep 19, 2026
Apache-2.0Sep 19, 2026 · metrics 2.10.0
PyPI
88Excellenthealth index
conductor-oss/python-sdk
Conductor OSS SDK for Python programming language
Python★ 104Oct 19, 2026
Apache-2.0Oct 19, 2026 · metrics 2.10.0
PyPI
88Excellenthealth index
xorq-labs/xorq
Git-native executable catalog for agentic data work.
Python★ 554↓ 15.3K/moOct 13, 2026
Apache-2.0Oct 13, 2026 · metrics 2.10.0
PyPI · crates.io · npm
87Excellenthealth index
BauplanLabs/bauplan
The bauplan SDK, CLI, public examples, re-usable code snippets
Rust · Python★ 27↓ 54.3K/moOct 9, 2026
Apache-2.0Oct 9, 2026 · metrics 2.10.0
PyPI
86Excellenthealth index
combust/mleap
MLeap: Deploy ML Pipelines to Production
Scala · Python★ 1,543↓ 2.1M/moAug 27, 2026
Apache-2.0Aug 27, 2026 · metrics 2.10.0
Go · npm
84Excellenthealth index
krenalis/krenalis
Warehouse-native, Identity first Customer Data Platform (CDP) in Go and React, alternative to Segment, RudderStack and Census
Go · TypeScript★ 5Oct 18, 2026
Custom licenseOct 18, 2026 · metrics 2.10.0
Go · npm · PyPI
80Excellenthealth index
carolsimone/continuo
Control Plane For Data Workflow With Built-In Agentic Remediation
Go · TypeScript★ 3Oct 19, 2026
Apache-2.0Oct 19, 2026 · metrics 2.10.0
PyPI
78Goodhealth index
cubert-hyperspectral/cuvis-ai
Cuvis.AI is an open-source, extensible framework for building modular AI pipelines that process, analyze, and deploy hyperspectral video data in real-time applications.
Jupyter Notebook · Python★ 15↓ 2,057/moOct 13, 2026
Apache-2.0Oct 13, 2026 · metrics 2.10.0
Go · npm
73Goodhealth index
goto/optimus
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
Go★ 11Sep 9, 2026
Apache-2.0Sep 9, 2026 · metrics 2.10.0
Maven
71Goodhealth index
eschizoid/kpipe
Composable Kafka consumer library for building modular, testable JVM data pipelines.
Java★ 57Sep 13, 2026
Apache-2.0Sep 13, 2026 · metrics 2.10.0
Go
54Moderatehealth index
nbigot/ministream
Ministream is a small, stand-alone, real-time event messaging streaming server
Go★ 3Sep 11, 2026
MITSep 11, 2026 · metrics 2.10.0
Packagist
53Moderatehealth index
koolreport/core
An Open Source PHP Reporting Framework that helps you to write perfect data reports or to construct awesome dashboards in PHP. Working great with all PHP versions from 5.6 to latest 8.0. Fully compatible with all kinds of MVC frameworks like Laravel, CodeIgniter, Symfony.
PHP★ 176↓ 11.3K/moSep 17, 2026
MITSep 17, 2026 · metrics 2.10.0