PyPI
airbytehq/PyAirbyte
PyAirbyte brings the power of Airbyte to every Python developer. Powers the Airbyte Cloud Replication MCP.
Custom licenseAug 12, 2026 · metrics 2.10.0
All tags
Catalogue tag
#data-engineering
Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.
71 records
npm · PyPI
benseverndev-oss/goldenmatch
Zero-config entity resolution feeding a durable identity layer: messy records from any source become stable golden entities, a Customer 360 with provenance, merge/split and audit. Fellegi-Sunter beats hand-tuned Splink. Arrow-native/Rust, 250M rows in 11.2 min. Python + edge TypeScript (WASM), SQL-native in Postgres & DuckDB, 97 MCP tools + REST.
MITSep 6, 2026 · metrics 2.10.0
PyPI
dbt-msft/dbt-sqlserver
dbt adapter for SQL Server and Azure SQL
MITJul 27, 2026 · metrics 2.10.0
PyPI · crates.io
pmgraham/datagrunt
Datagrunt is a Python library designed to simplify the way you work with CSV, Excel, Parquet, and PDF files. It provides a streamlined approach to reading, processing, and transforming your data into various formats, making data manipulation efficient and intuitive.
MITAug 22, 2026 · metrics 2.10.0
PyPI
SuperCowPowers/workbench
Workbench: An easy to use Python API for creating and deploying AWS SageMaker Models
MITJul 18, 2026 · metrics 2.10.0
npm · PyPI
AltimateAI/altimate-code
Open-source agentic data engineering harness for dbt, SQL, and cloud warehouses. 100+ tools, 10 warehouses, AI-powered.
MITJul 18, 2026 · metrics 2.10.0
PyPI
Glitni/dlt-saga
Config-driven data ingestion and SCD2 historization framework built on dlt
Apache-2.0Aug 3, 2026 · metrics 2.10.0
Go · npm
datazip-inc/olake-ui
Frontend & BFF (Backend for frontend) for Olake. This includes the UI code and backend code for storing the configuration of sync and orchestrating it.
Apache-2.0Jul 17, 2026 · metrics 2.10.0
Go
stergiotis/boxer
Data Engineering Toolbelt - DB-to-Glass
MITSep 5, 2026 · metrics 2.10.0
PyPI
maltzsama/dagster-authkit
Community Auth System for self-hosted Dagster OSS - simple RBAC, Audit-log, and Session Management
Apache-2.0Aug 22, 2026 · metrics 2.10.0
—
exmergo/dex
Dex is the agent-native analytics engineering toolkit. Point it at your warehouse and your dbt project. It learns the landscape, authors your transformations, and tells you exactly what to fix when the schema drifts. Built for analytics engineers and data engineers who want more out of their coding agent.
Apache-2.0Jul 18, 2026 · metrics 2.10.0
PyPI
leonardovida/duckdb-sqlalchemy
Production-ready SQLAlchemy dialect for DuckDB and MotherDuck with operational defaults and migration support from duckdb_engine.
MITJul 31, 2026 · metrics 2.10.0
PyPI · crates.io
BirchKwok/ApexBase
A High-performance HTAP embedded database. A reliable work partner.
Apache-2.0Jul 17, 2026 · metrics 2.10.0
PyPI
fmind/mlops-python-package
A comprehensive Python package template to kickstart and standardize your MLOps initiatives and data pipelines.
MITAug 29, 2026 · metrics 2.10.0
PyPI
russalo/file-observer
Deterministic file observation for pipelines — one read-only pass over a directory emits a reproducible JSON manifest of every file's type, metadata, structure, and provenance.
Custom licenseJul 17, 2026 · metrics 2.10.0
PyPI
PFund-Software-Ltd/pfeed
Data Engine for AI/Algo Trading: Download/Stream -> Clean -> Store. Supports Data Lakehouse Architecture. Clean Once and Forget.
Apache-2.0Jul 20, 2026 · metrics 2.10.0
PyPI
PaulKov/dpone
Declarative ETL framework for YAML-driven data pipelines
Apache-2.0Jul 22, 2026 · metrics 2.10.0
PyPI
Query-farm/vgi-python
Python SDK for the VGI (Vector Gateway Interface) protocol — host DuckDB scalar, table, aggregate, and table-in-out functions in an external worker over Arrow IPC.
Custom licenseJul 23, 2026 · metrics 2.10.0
npm · PyPI
dataengineeringformachinelearning/dataengineeringformachinelearning
DEML — High Throughput Event Platform for Real-Time Detection and Response
Apache-2.0Jul 21, 2026 · metrics 2.10.0
PyPI
rasinmuhammed/misata
Synthetic test data that hits the numbers you declare, exactly. Multi-table with verified foreign-key integrity, deterministic, no model in the data path. Python + MCP server.
MITAug 19, 2026 · metrics 2.10.0
Go
realdatadriven/etlx
ETL / ELT / Reverse ETL Framework powered by DuckDB, designed to seamlessly integrate and process data from diverse sources. It leverages Markdown as a configuration medium, where YAML blocks define metadata for each data source, and embedded SQL blocks specify the extraction, transformation, and loading logic.
MITSep 5, 2026 · metrics 2.10.0
npm
Query-farm/vgi-typescript
TypeScript SDK for the VGI (Vector Gateway Interface) protocol — host DuckDB scalar, table, aggregate, and table-in-out functions in an external worker over Arrow IPC.
Custom licenseAug 2, 2026 · metrics 2.10.0
PyPI
Query-farm/vgi-lint-check
Lint the documentation & metadata quality of VGI (Vector Gateway Interface) data workers — descriptions, column comments, tags, and example queries — with a quality score, per-version baselines, and agent-friendly output.
Custom licenseJul 19, 2026 · metrics 2.10.0
PyPI
adidas/lakehouse-engine
The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for several lakehouse algorithms, data flows and utilities for Data Products.
Apache-2.0Aug 18, 2026 · metrics 2.10.0
PyPI · crates.io
apitap/apitap-lib
Move whole tables between databases fast — Postgres, MySQL, ClickHouse, BigQuery. Rust engine, one-line Python API, bounded memory.
MITAug 18, 2026 · metrics 2.10.0
crates.io · PyPI
mag1cfrog/delta-funnel
Fast, lightweight Delta Lake to SQL Server loads without Spark or ODBC.
Apache-2.0Jul 16, 2026 · metrics 2.10.0
PyPI
eric-thomas-dagster/dagster-community-components-cli
No repository description published.
MITAug 22, 2026 · metrics 2.10.0
PyPI · npm
datacharter/datacharter
Your data, explored locally — and your AI agents kept on a leash. A federated data explorer with governed agentic access.
Apache-2.0Aug 1, 2026 · metrics 2.10.0
PyPI
ebiquity/crystalia-collector
No repository description published.
Custom licenseJul 17, 2026 · metrics 2.10.0
Go
query-farm/vgi-go
Go SDK for the VGI (Vector Gateway Interface) protocol — host DuckDB scalar, table, aggregate, and table-in-out functions in an external worker over Arrow IPC.
Custom licenseJul 15, 2026 · metrics 2.10.0