PyPI · npm
PrefectHQ/prefect
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Apache-2.0Sep 16, 2026 · metrics 2.10.0
All tags
Catalogue tag
#data-engineering
Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.
102 records
PyPI · npm · Go +1
apache/airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Apache-2.0Sep 16, 2026 · metrics 2.10.0
crates.io · Maven · npm +1
risingwavelabs/risingwave
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Apache-2.0Sep 24, 2026 · metrics 2.10.0
npm · PyPI
apache/superset
Apache Superset is a Data Visualization and Data Exploration Platform
Apache-2.0Sep 16, 2026 · metrics 2.10.0
Go · npm · PyPI
argoproj/argo-workflows
Workflow Engine for Kubernetes
Apache-2.0Sep 17, 2026 · metrics 2.10.0
PyPI
kedro-org/kedro
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
Custom licenseSep 17, 2026 · metrics 2.10.0
PyPI · npm
DataRecce/recce
The data-validation toolkit for enhanced dbt (data build tool) PR review
Apache-2.0Sep 14, 2026 · metrics 2.10.0
PyPI · crates.io
Eventual-Inc/Daft
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
Apache-2.0Aug 28, 2026 · metrics 2.10.0
PyPI · npm
dagster-io/dagster
An orchestration platform for the development, production, and observation of data assets.
Apache-2.0Sep 16, 2026 · metrics 2.10.0
PyPI · npm · Go +1
feast-dev/feast
The Open Source Feature Store for AI/ML
Apache-2.0Aug 28, 2026 · metrics 2.10.0
PyPI
fivetran/great_expectations
Always know what to expect from your data.
Apache-2.0Aug 27, 2026 · metrics 2.10.0
Maven · npm
kestra-io/kestra
Event Driven Orchestration & Scheduling Platform for Mission Critical Applications
Apache-2.0Sep 16, 2026 · metrics 2.10.0
PyPI · npm
meltano/meltano
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
MITSep 17, 2026 · metrics 2.10.0
Go
rudderlabs/rudder-server
Privacy and Security focused Segment-alternative, in Golang and React
Custom licenseAug 28, 2026 · metrics 2.10.0
PyPI · npm
datacontract/datacontract-cli
Enforce Data Contracts
MITSep 10, 2026 · metrics 2.10.0
npm · PyPI
growthbook/growthbook
Open Source Feature Flags, Experimentation, and Product Analytics
Custom licenseSep 15, 2026 · metrics 2.10.0
PyPI
aws/aws-sdk-pandas
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
Apache-2.0Sep 17, 2026 · metrics 2.10.0
PyPI
dlt-hub/dlt
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
Apache-2.0Sep 17, 2026 · metrics 2.10.0
PyPI
mlrun/mlrun
MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.
Apache-2.0Sep 15, 2026 · metrics 2.10.0
PyPI
quixio/quix-streams
Python Streaming DataFrames for Kafka
Apache-2.0Sep 18, 2026 · metrics 2.10.0
PyPI
snowflakedb/snowpark-python
Snowflake Snowpark Python API
Apache-2.0Sep 16, 2026 · metrics 2.10.0
Maven · npm
airbytehq/airbyte
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
Custom licenseAug 26, 2026 · metrics 2.10.0
PyPI · npm
dbt-labs/dbt-mcp
A MCP (Model Context Protocol) server for interacting with dbt.
Apache-2.0Sep 10, 2026 · metrics 2.10.0
PyPI · npm
kedro-org/kedro-viz
Visualise your Kedro data and machine-learning pipelines and track your experiments.
Apache-2.0Sep 13, 2026 · metrics 2.10.0
Go
redpanda-data/connect
Fancy stream processing made operationally mundane
Custom licenseAug 28, 2026 · metrics 2.10.0
Go
cloudquery/cloudquery
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
MPL-2.0Oct 20, 2026 · metrics 2.10.0
PyPI
pyjanitor-devs/pyjanitor
Clean APIs for data cleaning. Python implementation of R package Janitor
MITSep 17, 2026 · metrics 2.10.0
Go · Maven · npm
treeverse/lakeFS
lakeFS - Data version control for your data lake | Git for data
Apache-2.0Sep 17, 2026 · metrics 2.10.0
PyPI
xonsh/xonsh
🐚 Python-powered shell. Full-featured, cross-platform and AI-friendly.
Custom licenseSep 17, 2026 · metrics 2.10.0
Go
ConduitIO/conduit
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
Apache-2.0Sep 10, 2026 · metrics 2.10.0