Todas las etiquetas
Etiqueta del catálogo

#data-engineering

Todos los repositorios del registro público que llevan esta etiqueta, procedente de sus topics de GitHub o de las palabras clave que publican sus registros de paquetes. La salud se mide con la misma metodología versionada que el resto del registro.

71 registros
Con la etiqueta «data-engineering»Ordenado por índice de salud
PyPI
88Excelenteíndice de salud
airbytehq/PyAirbyte
PyAirbyte brings the power of Airbyte to every Python developer. Powers the Airbyte Cloud Replication MCP.
Python★ 34312 ago 2026
Licencia propia12 ago 2026 · métricas 2.10.0
npm · PyPI
88Excelenteíndice de salud
benseverndev-oss/goldenmatch
Zero-config entity resolution feeding a durable identity layer: messy records from any source become stable golden entities, a Customer 360 with provenance, merge/split and audit. Fellegi-Sunter beats hand-tuned Splink. Arrow-native/Rust, 250M rows in 11.2 min. Python + edge TypeScript (WASM), SQL-native in Postgres & DuckDB, 97 MCP tools + REST.
Python · TypeScript★ 1316 sept 2026
MIT6 sept 2026 · métricas 2.10.0
PyPI
88Excelenteíndice de salud
dbt-msft/dbt-sqlserver
dbt adapter for SQL Server and Azure SQL
Python★ 252↓ 172.4K/mes27 jul 2026
MIT27 jul 2026 · métricas 2.10.0
PyPI · crates.io
87Excelenteíndice de salud
pmgraham/datagrunt
Datagrunt is a Python library designed to simplify the way you work with CSV, Excel, Parquet, and PDF files. It provides a streamlined approach to reading, processing, and transforming your data into various formats, making data manipulation efficient and intuitive.
Python · Rust★ 13↓ 2998/mes22 ago 2026
MIT22 ago 2026 · métricas 2.10.0
PyPI
86Excelenteíndice de salud
SuperCowPowers/workbench
Workbench: An easy to use Python API for creating and deploying AWS SageMaker Models
Python★ 51↓ 10.1K/mes18 jul 2026
MIT18 jul 2026 · métricas 2.10.0
npm · PyPI
84Excelenteíndice de salud
AltimateAI/altimate-code
Open-source agentic data engineering harness for dbt, SQL, and cloud warehouses. 100+ tools, 10 warehouses, AI-powered.
TypeScript★ 75118 jul 2026
MIT18 jul 2026 · métricas 2.10.0
PyPI
83Excelenteíndice de salud
Glitni/dlt-saga
Config-driven data ingestion and SCD2 historization framework built on dlt
Python★ 63 ago 2026
Apache-2.03 ago 2026 · métricas 2.10.0
Go · npm
81Excelenteíndice de salud
datazip-inc/olake-ui
Frontend & BFF (Backend for frontend) for Olake. This includes the UI code and backend code for storing the configuration of sync and orchestrating it.
TypeScript · Go★ 3217 jul 2026
Apache-2.017 jul 2026 · métricas 2.10.0
Go
81Excelenteíndice de salud
stergiotis/boxer
Data Engineering Toolbelt - DB-to-Glass
Go★ 105 sept 2026
MIT5 sept 2026 · métricas 2.10.0
PyPI
77Buenoíndice de salud
maltzsama/dagster-authkit
Community Auth System for self-hosted Dagster OSS - simple RBAC, Audit-log, and Session Management
Python★ 63↓ 7705/mes22 ago 2026
Apache-2.022 ago 2026 · métricas 2.10.0
73Buenoíndice de salud
exmergo/dex
Dex is the agent-native analytics engineering toolkit. Point it at your warehouse and your dbt project. It learns the landscape, authors your transformations, and tells you exactly what to fix when the schema drifts. Built for analytics engineers and data engineers who want more out of their coding agent.
Python★ 1218 jul 2026
Apache-2.018 jul 2026 · métricas 2.10.0
PyPI
73Buenoíndice de salud
leonardovida/duckdb-sqlalchemy
Production-ready SQLAlchemy dialect for DuckDB and MotherDuck with operational defaults and migration support from duckdb_engine.
Python★ 1631 jul 2026
MIT31 jul 2026 · métricas 2.10.0
PyPI · crates.io
71Buenoíndice de salud
BirchKwok/ApexBase
A High-performance HTAP embedded database. A reliable work partner.
Rust · Python★ 3↓ 5330/mes17 jul 2026
Apache-2.017 jul 2026 · métricas 2.10.0
PyPI
71Buenoíndice de salud
fmind/mlops-python-package
A comprehensive Python package template to kickstart and standardize your MLOps initiatives and data pipelines.
Jupyter Notebook★ 141629 ago 2026
MIT29 ago 2026 · métricas 2.10.0
PyPI
71Buenoíndice de salud
russalo/file-observer
Deterministic file observation for pipelines — one read-only pass over a directory emits a reproducible JSON manifest of every file's type, metadata, structure, and provenance.
Python★ 217 jul 2026
Licencia propia17 jul 2026 · métricas 2.10.0
PyPI
69Buenoíndice de salud
PFund-Software-Ltd/pfeed
Data Engine for AI/Algo Trading: Download/Stream -> Clean -> Store. Supports Data Lakehouse Architecture. Clean Once and Forget.
Python★ 35↓ 1064/mes20 jul 2026
Apache-2.020 jul 2026 · métricas 2.10.0
PyPI
69Buenoíndice de salud
PaulKov/dpone
Declarative ETL framework for YAML-driven data pipelines
Python★ 2↓ 25.1K/mes22 jul 2026
Apache-2.022 jul 2026 · métricas 2.10.0
PyPI
69Buenoíndice de salud
Query-farm/vgi-python
Python SDK for the VGI (Vector Gateway Interface) protocol — host DuckDB scalar, table, aggregate, and table-in-out functions in an external worker over Arrow IPC.
Python★ 223 jul 2026
Licencia propia23 jul 2026 · métricas 2.10.0
PyPI
69Buenoíndice de salud
rasinmuhammed/misata
Synthetic test data that hits the numbers you declare, exactly. Multi-table with verified foreign-key integrity, deterministic, no model in the data path. Python + MCP server.
Python★ 66↓ 4697/mes19 ago 2026
MIT19 ago 2026 · métricas 2.10.0
Go
67Buenoíndice de salud
realdatadriven/etlx
ETL / ELT / Reverse ETL Framework powered by DuckDB, designed to seamlessly integrate and process data from diverse sources. It leverages Markdown as a configuration medium, where YAML blocks define metadata for each data source, and embedded SQL blocks specify the extraction, transformation, and loading logic.
Go★ 535 sept 2026
MIT5 sept 2026 · métricas 2.10.0
npm
63Moderadoíndice de salud
Query-farm/vgi-typescript
TypeScript SDK for the VGI (Vector Gateway Interface) protocol — host DuckDB scalar, table, aggregate, and table-in-out functions in an external worker over Arrow IPC.
TypeScript★ 0↓ 4041/mes2 ago 2026
Licencia propia2 ago 2026 · métricas 2.10.0
PyPI
60Moderadoíndice de salud
Query-farm/vgi-lint-check
Lint the documentation & metadata quality of VGI (Vector Gateway Interface) data workers — descriptions, column comments, tags, and example queries — with a quality score, per-version baselines, and agent-friendly output.
Python★ 0↓ 11.8K/mes19 jul 2026
Licencia propia19 jul 2026 · métricas 2.10.0
PyPI
60Moderadoíndice de salud
adidas/lakehouse-engine
The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for several lakehouse algorithms, data flows and utilities for Data Products.
Python★ 294↓ 3910/mes18 ago 2026
Apache-2.018 ago 2026 · métricas 2.10.0
PyPI · crates.io
59Moderadoíndice de salud
apitap/apitap-lib
Move whole tables between databases fast — Postgres, MySQL, ClickHouse, BigQuery. Rust engine, one-line Python API, bounded memory.
Rust · Python★ 5018 ago 2026
MIT18 ago 2026 · métricas 2.10.0
crates.io · PyPI
59Moderadoíndice de salud
mag1cfrog/delta-funnel
Fast, lightweight Delta Lake to SQL Server loads without Spark or ODBC.
Rust★ 016 jul 2026
Apache-2.016 jul 2026 · métricas 2.10.0
PyPI · npm
56Moderadoíndice de salud
datacharter/datacharter
Your data, explored locally — and your AI agents kept on a leash. A federated data explorer with governed agentic access.
Python · TypeScript★ 1↓ 2634/mes1 ago 2026
Apache-2.01 ago 2026 · métricas 2.10.0
PyPI
56Moderadoíndice de salud
ebiquity/crystalia-collector
El repositorio no publica descripción.
HTML★ 0↓ 317/mes17 jul 2026
Licencia propia17 jul 2026 · métricas 2.10.0
Go
56Moderadoíndice de salud
query-farm/vgi-go
Go SDK for the VGI (Vector Gateway Interface) protocol — host DuckDB scalar, table, aggregate, and table-in-out functions in an external worker over Arrow IPC.
Go · HTML★ 015 jul 2026
Licencia propia15 jul 2026 · métricas 2.10.0