All tags
Catalogue tag

#data-engineering

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

36 records
Tagged “data-engineering”Ranked by health index
npm · PyPI
97Excellenthealth index
apache/superset
Apache Superset is a Data Visualization and Data Exploration Platform
TypeScript · Python · Jupyter Notebook★ 73.8K↓ 1.1M/moJul 15, 2026
Apache-2.0Jul 15, 2026 · metrics 1.13.0
PyPI · npm · Go +1
93Excellenthealth index
apache/airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Python★ 46.2K↓ 28.9M/moJul 21, 2026
Apache-2.0Jul 21, 2026 · metrics 1.13.0
PyPI · npm
91Excellenthealth index
PrefectHQ/prefect
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Python · TypeScript★ 23.4K↓ 392.6K/moJul 21, 2026
Apache-2.0Jul 21, 2026 · metrics 1.13.0
PyPI · crates.io
88Excellenthealth index
eventual-inc/daft
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
Rust · Python · Jupyter Notebook★ 5,635↓ 916.1K/moJul 17, 2026
Apache-2.0Jul 17, 2026 · metrics 1.13.0
PyPI · npm · Go +1
87Excellenthealth index
feast-dev/feast
The Open Source Feature Store for AI/ML
Python · Go★ 7,137↓ 615K/moJul 18, 2026
Apache-2.0Jul 18, 2026 · metrics 1.13.0
Maven · npm
87Excellenthealth index
kestra-io/kestra
Event Driven Orchestration & Scheduling Platform for Mission Critical Applications
Java · TypeScript · Vue★ 27.4KJul 18, 2026
Apache-2.0Jul 18, 2026 · metrics 1.13.0
Go
87Excellenthealth index
rudderlabs/rudder-server
Privacy and Security focused Segment-alternative, in Golang and React
Go★ 4,459Jul 18, 2026
Custom licenseJul 18, 2026 · metrics 1.13.0
PyPI · npm
84Goodhealth index
DataRecce/recce
The data-validation toolkit for enhanced dbt (data build tool) PR review
TypeScript · Python★ 463↓ 0/moJul 14, 2026
Apache-2.0Jul 14, 2026 · metrics 1.13.0
PyPI · npm
83Goodhealth index
dagster-io/dagster
An orchestration platform for the development, production, and observation of data assets.
Python · TypeScript★ 15.9K↓ 8.6M/moJul 21, 2026
Apache-2.0Jul 21, 2026 · metrics 1.13.0
PyPI
83Goodhealth index
snowflakedb/snowpark-python
Snowflake Snowpark Python API
Python★ 339↓ 98.6M/moJul 21, 2026
Apache-2.0Jul 21, 2026 · metrics 1.13.0
Go
80Goodhealth index
redpanda-data/connect
Fancy stream processing made operationally mundane
Go★ 8,711Jul 23, 2026
Custom licenseJul 23, 2026 · metrics 1.13.0
PyPI · npm
79Goodhealth index
dbt-labs/dbt-mcp
A MCP (Model Context Protocol) server for interacting with dbt.
Python★ 594↓ 98.4K/moJul 17, 2026
Apache-2.0Jul 17, 2026 · metrics 1.13.0
Go
78Goodhealth index
cloudquery/cloudquery
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
Go★ 6,458↓ 0/moJul 13, 2026
MPL-2.0Jul 13, 2026 · metrics 1.13.0
RubyGems · npm
78Goodhealth index
multiwoven/multiwoven
🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.
Ruby · TypeScript★ 1,663Jul 17, 2026
AGPL-3.0Jul 17, 2026 · metrics 1.13.0
Go
76Goodhealth index
ConduitIO/conduit
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
Go★ 604Jul 17, 2026
Apache-2.0Jul 17, 2026 · metrics 1.13.0
Go · crates.io · npm +1
74Goodhealth index
estuary/flow
🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊
Rust · C++★ 948Jul 17, 2026
Custom licenseJul 17, 2026 · metrics 1.13.0
PyPI
72Goodhealth index
SuperCowPowers/workbench
Workbench: An easy to use Python API for creating and deploying AWS SageMaker Models
Python★ 51↓ 10.1K/moJul 18, 2026
MITJul 18, 2026 · metrics 1.13.0
npm · PyPI
72Goodhealth index
benseverndev-oss/goldenmatch
Zero-config entity resolution & record linkage. The zero-tuning Fellegi-Sunter path beats hand-tuned Splink head-to-head and scales from a CSV to a verified 100M-row dedupe in 9.2 min. Fuzzy/exact/probabilistic + PPRL + LLM + identity graph. Python + edge-safe TypeScript (WASM), SQL-native in Postgres & DuckDB, MCP/REST + dbt/Airflow.
Python · TypeScript★ 122Jul 15, 2026
MITJul 15, 2026 · metrics 1.13.0
npm · PyPI
69Moderatehealth index
AltimateAI/altimate-code
Open-source agentic data engineering harness for dbt, SQL, and cloud warehouses. 100+ tools, 10 warehouses, AI-powered.
TypeScript★ 751Jul 18, 2026
MITJul 18, 2026 · metrics 1.13.0
Go · npm
69Moderatehealth index
datazip-inc/olake-ui
Frontend & BFF (Backend for frontend) for Olake. This includes the UI code and backend code for storing the configuration of sync and orchestrating it.
TypeScript · Go★ 32Jul 17, 2026
Apache-2.0Jul 17, 2026 · metrics 1.13.0
PyPI · crates.io
64Moderatehealth index
BirchKwok/ApexBase
A High-performance HTAP embedded database. A reliable work partner.
Rust · Python★ 3↓ 5,330/moJul 17, 2026
Apache-2.0Jul 17, 2026 · metrics 1.13.0
63Moderatehealth index
exmergo/dex
Dex is the agent-native analytics engineering toolkit. Point it at your warehouse and your dbt project. It learns the landscape, authors your transformations, and tells you exactly what to fix when the schema drifts. Built for analytics engineers and data engineers who want more out of their coding agent.
Python★ 12Jul 18, 2026
Apache-2.0Jul 18, 2026 · metrics 1.13.0
PyPI
63Moderatehealth index
russalo/file-observer
Deterministic file observation for pipelines — one read-only pass over a directory emits a reproducible JSON manifest of every file's type, metadata, structure, and provenance.
Python★ 2Jul 17, 2026
Custom licenseJul 17, 2026 · metrics 1.13.0
PyPI
62Moderatehealth index
PaulKov/dpone
Declarative ETL framework for YAML-driven data pipelines
Python★ 2↓ 25.1K/moJul 22, 2026
Apache-2.0Jul 22, 2026 · metrics 1.13.0
PyPI
61Moderatehealth index
PFund-Software-Ltd/pfeed
Data Engine for AI/Algo Trading: Download/Stream -> Clean -> Store. Supports Data Lakehouse Architecture. Clean Once and Forget.
Python★ 35↓ 1,064/moJul 20, 2026
Apache-2.0Jul 20, 2026 · metrics 1.13.0
crates.io · PyPI
57Moderatehealth index
pmgraham/datagrunt
Datagrunt is a Python library designed to simplify the way you work with CSV, Excel, and PDF files. It provides a streamlined approach to reading, processing, and transforming your data into various formats, making data manipulation efficient and intuitive.
Python★ 12↓ 20.3K/moJul 13, 2026
MITJul 13, 2026 · metrics 1.13.0
PyPI
56Moderatehealth index
Query-farm/vgi-lint-check
Lint the documentation & metadata quality of VGI (Vector Gateway Interface) data workers — descriptions, column comments, tags, and example queries — with a quality score, per-version baselines, and agent-friendly output.
Python★ 0↓ 11.8K/moJul 19, 2026
Custom licenseJul 19, 2026 · metrics 1.13.0
crates.io · PyPI
56Moderatehealth index
mag1cfrog/delta-funnel
Fast, lightweight Delta Lake to SQL Server loads without Spark or ODBC.
Rust★ 0Jul 16, 2026
Apache-2.0Jul 16, 2026 · metrics 1.13.0