PyPI
airbytehq/PyAirbyte
PyAirbyte brings the power of Airbyte to every Python developer. Powers the Airbyte Cloud Replication MCP.
Eigene Lizenz12. Aug. 2026 · Metriken 2.10.0
Alle Tags
Katalog-Tag
#data-engineering
Alle Repositories im öffentlichen Register, die dieses Tag tragen — aus ihren GitHub-Topics oder den von ihren Paket-Registries veröffentlichten Schlagwörtern. Die Gesundheit wird nach derselben versionierten Methodik gemessen wie im übrigen Register.
71 Einträge
npm · PyPI
benseverndev-oss/goldenmatch
Zero-config entity resolution feeding a durable identity layer: messy records from any source become stable golden entities, a Customer 360 with provenance, merge/split and audit. Fellegi-Sunter beats hand-tuned Splink. Arrow-native/Rust, 250M rows in 11.2 min. Python + edge TypeScript (WASM), SQL-native in Postgres & DuckDB, 97 MCP tools + REST.
MIT6. Sept. 2026 · Metriken 2.10.0
PyPI
dbt-msft/dbt-sqlserver
dbt adapter for SQL Server and Azure SQL
MIT27. Juli 2026 · Metriken 2.10.0
PyPI · crates.io
pmgraham/datagrunt
Datagrunt is a Python library designed to simplify the way you work with CSV, Excel, Parquet, and PDF files. It provides a streamlined approach to reading, processing, and transforming your data into various formats, making data manipulation efficient and intuitive.
MIT22. Aug. 2026 · Metriken 2.10.0
PyPI
SuperCowPowers/workbench
Workbench: An easy to use Python API for creating and deploying AWS SageMaker Models
MIT18. Juli 2026 · Metriken 2.10.0
npm · PyPI
AltimateAI/altimate-code
Open-source agentic data engineering harness for dbt, SQL, and cloud warehouses. 100+ tools, 10 warehouses, AI-powered.
MIT18. Juli 2026 · Metriken 2.10.0
PyPI
Glitni/dlt-saga
Config-driven data ingestion and SCD2 historization framework built on dlt
Apache-2.03. Aug. 2026 · Metriken 2.10.0
Go · npm
datazip-inc/olake-ui
Frontend & BFF (Backend for frontend) for Olake. This includes the UI code and backend code for storing the configuration of sync and orchestrating it.
Apache-2.017. Juli 2026 · Metriken 2.10.0
Go
stergiotis/boxer
Data Engineering Toolbelt - DB-to-Glass
MIT5. Sept. 2026 · Metriken 2.10.0
PyPI
maltzsama/dagster-authkit
Community Auth System for self-hosted Dagster OSS - simple RBAC, Audit-log, and Session Management
Apache-2.022. Aug. 2026 · Metriken 2.10.0
—
exmergo/dex
Dex is the agent-native analytics engineering toolkit. Point it at your warehouse and your dbt project. It learns the landscape, authors your transformations, and tells you exactly what to fix when the schema drifts. Built for analytics engineers and data engineers who want more out of their coding agent.
Apache-2.018. Juli 2026 · Metriken 2.10.0
PyPI
leonardovida/duckdb-sqlalchemy
Production-ready SQLAlchemy dialect for DuckDB and MotherDuck with operational defaults and migration support from duckdb_engine.
MIT31. Juli 2026 · Metriken 2.10.0
PyPI · crates.io
BirchKwok/ApexBase
A High-performance HTAP embedded database. A reliable work partner.
Apache-2.017. Juli 2026 · Metriken 2.10.0
PyPI
fmind/mlops-python-package
A comprehensive Python package template to kickstart and standardize your MLOps initiatives and data pipelines.
MIT29. Aug. 2026 · Metriken 2.10.0
PyPI
russalo/file-observer
Deterministic file observation for pipelines — one read-only pass over a directory emits a reproducible JSON manifest of every file's type, metadata, structure, and provenance.
Eigene Lizenz17. Juli 2026 · Metriken 2.10.0
PyPI
PFund-Software-Ltd/pfeed
Data Engine for AI/Algo Trading: Download/Stream -> Clean -> Store. Supports Data Lakehouse Architecture. Clean Once and Forget.
Apache-2.020. Juli 2026 · Metriken 2.10.0
PyPI
PaulKov/dpone
Declarative ETL framework for YAML-driven data pipelines
Apache-2.022. Juli 2026 · Metriken 2.10.0
PyPI
Query-farm/vgi-python
Python SDK for the VGI (Vector Gateway Interface) protocol — host DuckDB scalar, table, aggregate, and table-in-out functions in an external worker over Arrow IPC.
Eigene Lizenz23. Juli 2026 · Metriken 2.10.0
npm · PyPI
dataengineeringformachinelearning/dataengineeringformachinelearning
DEML — High Throughput Event Platform for Real-Time Detection and Response
Apache-2.021. Juli 2026 · Metriken 2.10.0
PyPI
rasinmuhammed/misata
Synthetic test data that hits the numbers you declare, exactly. Multi-table with verified foreign-key integrity, deterministic, no model in the data path. Python + MCP server.
MIT19. Aug. 2026 · Metriken 2.10.0
Go
realdatadriven/etlx
ETL / ELT / Reverse ETL Framework powered by DuckDB, designed to seamlessly integrate and process data from diverse sources. It leverages Markdown as a configuration medium, where YAML blocks define metadata for each data source, and embedded SQL blocks specify the extraction, transformation, and loading logic.
MIT5. Sept. 2026 · Metriken 2.10.0
npm
Query-farm/vgi-typescript
TypeScript SDK for the VGI (Vector Gateway Interface) protocol — host DuckDB scalar, table, aggregate, and table-in-out functions in an external worker over Arrow IPC.
Eigene Lizenz2. Aug. 2026 · Metriken 2.10.0
PyPI
Query-farm/vgi-lint-check
Lint the documentation & metadata quality of VGI (Vector Gateway Interface) data workers — descriptions, column comments, tags, and example queries — with a quality score, per-version baselines, and agent-friendly output.
Eigene Lizenz19. Juli 2026 · Metriken 2.10.0
PyPI
adidas/lakehouse-engine
The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for several lakehouse algorithms, data flows and utilities for Data Products.
Apache-2.018. Aug. 2026 · Metriken 2.10.0
PyPI · crates.io
apitap/apitap-lib
Move whole tables between databases fast — Postgres, MySQL, ClickHouse, BigQuery. Rust engine, one-line Python API, bounded memory.
MIT18. Aug. 2026 · Metriken 2.10.0
crates.io · PyPI
mag1cfrog/delta-funnel
Fast, lightweight Delta Lake to SQL Server loads without Spark or ODBC.
Apache-2.016. Juli 2026 · Metriken 2.10.0
PyPI
eric-thomas-dagster/dagster-community-components-cli
Keine Repository-Beschreibung veröffentlicht.
MIT22. Aug. 2026 · Metriken 2.10.0
PyPI · npm
datacharter/datacharter
Your data, explored locally — and your AI agents kept on a leash. A federated data explorer with governed agentic access.
Apache-2.01. Aug. 2026 · Metriken 2.10.0
PyPI
ebiquity/crystalia-collector
Keine Repository-Beschreibung veröffentlicht.
Eigene Lizenz17. Juli 2026 · Metriken 2.10.0
Go
query-farm/vgi-go
Go SDK for the VGI (Vector Gateway Interface) protocol — host DuckDB scalar, table, aggregate, and table-in-out functions in an external worker over Arrow IPC.
Eigene Lizenz15. Juli 2026 · Metriken 2.10.0