Todas las etiquetas
Etiqueta del catálogo

#data-engineering

Todos los repositorios del registro público que llevan esta etiqueta, procedente de sus topics de GitHub o de las palabras clave que publican sus registros de paquetes. La salud se mide con la misma metodología versionada que el resto del registro.

102 registros
Con la etiqueta «data-engineering»Ordenado por índice de salud
PyPI
75Buenoíndice de salud
Query-farm/vgi-python
Python SDK for the VGI (Vector Gateway Interface) protocol — host DuckDB scalar, table, aggregate, and table-in-out functions in an external worker over Arrow IPC.
Python★ 4↓ 3130/mes13 sept 2026
Licencia propia13 sept 2026 · métricas 2.10.0
PyPI · crates.io · npm
73Buenoíndice de salud
glyf-data/glyf
Open Source Visualization build tool to data pipeline
Python · Rust★ 12↓ 3492/mes19 oct 2026
Apache-2.019 oct 2026 · métricas 2.10.0
PyPI
73Buenoíndice de salud
leonardovida/duckdb-sqlalchemy
Production-ready SQLAlchemy dialect for DuckDB and MotherDuck with operational defaults and migration support from duckdb_engine.
Python★ 1715 sept 2026
MIT15 sept 2026 · métricas 2.10.0
Go
73Buenoíndice de salud
okfcli/okf
Vendor-neutral Go CLI for the Open Knowledge Format. Create, validate, lint, index, search, and graph OKF bundles. Built to be driven by AI agents.
Go★ 2518 sept 2026
Apache-2.018 sept 2026 · métricas 2.10.0
PyPI
71Buenoíndice de salud
PFund-Software-Ltd/pfeed
Data Engine for AI/Algo Trading: Download/Stream -> Clean -> Store. Supports Data Lakehouse Architecture. Clean Once and Forget.
Python★ 34↓ 1064/mes12 sept 2026
Apache-2.012 sept 2026 · métricas 2.10.0
Go · npm
71Buenoíndice de salud
flidai/leapview
Open-source BI for governed analytics, without the lock-in.
Go · TypeScript★ 1220 sept 2026
Apache-2.020 sept 2026 · métricas 2.10.0
PyPI
69Buenoíndice de salud
JB-Analytica/model2data
model2data turns data models into analytics-ready datasets.
Python★ 12↓ 2011/mes2 oct 2026
MIT2 oct 2026 · métricas 2.10.0
PyPI
69Buenoíndice de salud
PaulKov/dpone
Declarative ETL framework for YAML-driven data pipelines
Python★ 0↓ 18.3K/mes13 sept 2026
Apache-2.013 sept 2026 · métricas 2.10.0
PyPI
69Buenoíndice de salud
Query-farm/vgi-lint-check
Lint the documentation & metadata quality of VGI (Vector Gateway Interface) data workers — descriptions, column comments, tags, and example queries — with a quality score, per-version baselines, and agent-friendly output.
Python★ 0↓ 1081/mes11 sept 2026
Licencia propia11 sept 2026 · métricas 2.10.0
crates.io · PyPI
69Buenoíndice de salud
mag1cfrog/delta-funnel
Fast, lightweight Delta Lake to SQL Server loads without Spark or ODBC.
Rust★ 1↓ 180/mes9 sept 2026
Apache-2.09 sept 2026 · métricas 2.10.0
NuGet
69Buenoíndice de salud
npipeline/NPipeline
High-performance, streaming data pipelines for .NET
C#★ 515 sept 2026
Licencia propia15 sept 2026 · métricas 2.10.0
PyPI
67Buenoíndice de salud
Jackxiaozhiren/datasentry
Find, explain, and safely fix bad data. Local-first data quality for files, databases, CI pipelines, and AI agents.
Python★ 2↓ 2303/mes18 sept 2026
Apache-2.018 sept 2026 · métricas 2.10.0
npm
65Buenoíndice de salud
Query-farm/vgi-typescript
TypeScript SDK for the VGI (Vector Gateway Interface) protocol — host DuckDB scalar, table, aggregate, and table-in-out functions in an external worker over Arrow IPC.
TypeScript★ 1↓ 1562/mes16 sept 2026
Licencia propia16 sept 2026 · métricas 2.10.0
Go · npm
65Buenoíndice de salud
Tnsor-Labs/brokoli
Brokoli — self-hosted data pipeline orchestration
Go · Svelte★ 613 sept 2026
Apache-2.013 sept 2026 · métricas 2.10.0
PyPI · npm
65Buenoíndice de salud
datacharter/datacharter
Your data, explored locally — and your AI agents kept on a leash. A federated data explorer with governed agentic access.
Python · TypeScript★ 12↓ 1584/mes15 sept 2026
Apache-2.015 sept 2026 · métricas 2.10.0
PyPI · crates.io
63Moderadoíndice de salud
BirchKwok/apexbase
A High-performance HTAP embedded database. A reliable work partner.
Rust · Python★ 3↓ 6423/mes9 sept 2026
Apache-2.09 sept 2026 · métricas 2.10.0
Go
63Moderadoíndice de salud
realdatadriven/etlx
ETL / ELT / Reverse ETL Framework powered by DuckDB, designed to seamlessly integrate and process data from diverse sources. It leverages Markdown as a configuration medium, where YAML blocks define metadata for each data source, and embedded SQL blocks specify the extraction, transformation, and loading logic.
Go★ 5521 oct 2026
MIT21 oct 2026 · métricas 2.10.0
PyPI · crates.io
62Moderadoíndice de salud
apitap/apitap-lib
Move whole tables between databases fast — Postgres, MySQL, ClickHouse, BigQuery. Rust engine, one-line Python API, bounded memory.
Rust · Python · Shell★ 53↓ 762/mes19 oct 2026
MIT19 oct 2026 · métricas 2.10.0
PyPI
62Moderadoíndice de salud
sidequery/dlt-iceberg
An Iceberg destination for DLT that supports REST catalogs
Python★ 14↓ 4803/mes12 oct 2026
MIT12 oct 2026 · métricas 2.10.0
PyPI
60Moderadoíndice de salud
1cadumagalhaes/airsql
A decorator-based SQL execution framework for Airflow that provides clean, Python-like syntax for data operations.
Python★ 0↓ 497/mes19 sept 2026
MIT19 sept 2026 · métricas 2.10.0
Go
60Moderadoíndice de salud
Query-farm/vgi-go
Go SDK for the VGI (Vector Gateway Interface) protocol — host DuckDB scalar, table, aggregate, and table-in-out functions in an external worker over Arrow IPC.
Go · HTML★ 18 sept 2026
Licencia propia8 sept 2026 · métricas 2.10.0
PyPI
60Moderadoíndice de salud
adidas/lakehouse-engine
The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for several lakehouse algorithms, data flows and utilities for Data Products.
Python★ 293↓ 3910/mes19 oct 2026
Apache-2.019 oct 2026 · métricas 2.10.0
PyPI
59Moderadoíndice de salud
LakeLogic/open-lakehouse-contract
Open Lakehouse Contract (OLC) is an open YAML specification for declaring a data product's schema, quality rules, transformations, lineage, ownership, service levels (SLAs and SLOs) and materialisation.
Python★ 0↓ 2210/mes1 oct 2026
Apache-2.01 oct 2026 · métricas 2.10.0
PyPI
59Moderadoíndice de salud
larsyencken/alcove
A personal ETL and data lake.
Python★ 0↓ 191/mes20 oct 2026
MIT20 oct 2026 · métricas 2.10.0
PyPI
57Moderadoíndice de salud
Ebiquity/crystalia-collector
El repositorio no publica descripción.
HTML★ 0↓ 25/mes9 sept 2026
Licencia propia9 sept 2026 · métricas 2.10.0
PyPI
57Moderadoíndice de salud
ashishsinha1602/schemagate
Identity-scoped schema selection for text-to-SQL: give the model only the tables this caller may read, and 75% fewer prompt tokens.
HTML · Python★ 318 sept 2026
Licencia propia18 sept 2026 · métricas 2.10.0
PyPI · crates.io · npm
57Moderadoíndice de salud
sercanatalik/cereyan
Orchestration for Python data pipelines, without the platform. A fast Rust core drives flows, schedules, backfills, retries, and a live UI. Agentic-ready: MCP tools, agent-attributed runs, human-in-the-loop approvals. One wheel, no runtime dependencies.
Rust · Python · TypeScript★ 1↓ 5908/mes2 oct 2026
Licencia propia2 oct 2026 · métricas 2.10.0
Go · npm
56Moderadoíndice de salud
arinbalyan/scrappy
Bulk job-board scraper with 100+ sites, email enrichment, deterministic quality scoring, and multi-format exports (CSV/JSONL/XLSX/Parquet). Designed for scheduled bulk-first operations with per-site rate limiting, proxy pools, and resume support.
Go★ 619 sept 2026
Licencia propia19 sept 2026 · métricas 2.10.0
PyPI · crates.io
56Moderadoíndice de salud
mmirzafahmi/quickhouse
Fast PostgreSQL / MySQL / BigQuery → ClickHouse or BigQuery ETL: a native Rust engine driven from a small, typed Python API.
Rust · Python★ 0↓ 2782/mes14 sept 2026
MIT14 sept 2026 · métricas 2.10.0