PyPI
airbytehq/PyAirbyte
PyAirbyte brings the power of Airbyte to every Python developer. Powers the Airbyte Cloud Replication MCP.
自定义许可证2026年8月12日 · 指标 2.10.0
全部标签
目录标签
#data-engineering
公开记录中带有此标签的全部仓库——标签来自其 GitHub 主题或软件包注册表发布的关键词。健康度量遵循与记录其余部分相同的版本化方法论。
71 条记录
npm · PyPI
benseverndev-oss/goldenmatch
Zero-config entity resolution feeding a durable identity layer: messy records from any source become stable golden entities, a Customer 360 with provenance, merge/split and audit. Fellegi-Sunter beats hand-tuned Splink. Arrow-native/Rust, 250M rows in 11.2 min. Python + edge TypeScript (WASM), SQL-native in Postgres & DuckDB, 97 MCP tools + REST.
MIT2026年9月6日 · 指标 2.10.0
PyPI
dbt-msft/dbt-sqlserver
dbt adapter for SQL Server and Azure SQL
MIT2026年7月27日 · 指标 2.10.0
PyPI · crates.io
pmgraham/datagrunt
Datagrunt is a Python library designed to simplify the way you work with CSV, Excel, Parquet, and PDF files. It provides a streamlined approach to reading, processing, and transforming your data into various formats, making data manipulation efficient and intuitive.
MIT2026年8月22日 · 指标 2.10.0
PyPI
SuperCowPowers/workbench
Workbench: An easy to use Python API for creating and deploying AWS SageMaker Models
MIT2026年7月18日 · 指标 2.10.0
npm · PyPI
AltimateAI/altimate-code
Open-source agentic data engineering harness for dbt, SQL, and cloud warehouses. 100+ tools, 10 warehouses, AI-powered.
MIT2026年7月18日 · 指标 2.10.0
PyPI
Glitni/dlt-saga
Config-driven data ingestion and SCD2 historization framework built on dlt
Apache-2.02026年8月3日 · 指标 2.10.0
Go · npm
datazip-inc/olake-ui
Frontend & BFF (Backend for frontend) for Olake. This includes the UI code and backend code for storing the configuration of sync and orchestrating it.
Apache-2.02026年7月17日 · 指标 2.10.0
Go
stergiotis/boxer
Data Engineering Toolbelt - DB-to-Glass
MIT2026年9月5日 · 指标 2.10.0
PyPI
maltzsama/dagster-authkit
Community Auth System for self-hosted Dagster OSS - simple RBAC, Audit-log, and Session Management
Apache-2.02026年8月22日 · 指标 2.10.0
—
exmergo/dex
Dex is the agent-native analytics engineering toolkit. Point it at your warehouse and your dbt project. It learns the landscape, authors your transformations, and tells you exactly what to fix when the schema drifts. Built for analytics engineers and data engineers who want more out of their coding agent.
Apache-2.02026年7月18日 · 指标 2.10.0
PyPI
leonardovida/duckdb-sqlalchemy
Production-ready SQLAlchemy dialect for DuckDB and MotherDuck with operational defaults and migration support from duckdb_engine.
MIT2026年7月31日 · 指标 2.10.0
PyPI · crates.io
BirchKwok/ApexBase
A High-performance HTAP embedded database. A reliable work partner.
Apache-2.02026年7月17日 · 指标 2.10.0
PyPI
fmind/mlops-python-package
A comprehensive Python package template to kickstart and standardize your MLOps initiatives and data pipelines.
MIT2026年8月29日 · 指标 2.10.0
PyPI
russalo/file-observer
Deterministic file observation for pipelines — one read-only pass over a directory emits a reproducible JSON manifest of every file's type, metadata, structure, and provenance.
自定义许可证2026年7月17日 · 指标 2.10.0
PyPI
PFund-Software-Ltd/pfeed
Data Engine for AI/Algo Trading: Download/Stream -> Clean -> Store. Supports Data Lakehouse Architecture. Clean Once and Forget.
Apache-2.02026年7月20日 · 指标 2.10.0
PyPI
PaulKov/dpone
Declarative ETL framework for YAML-driven data pipelines
Apache-2.02026年7月22日 · 指标 2.10.0
PyPI
Query-farm/vgi-python
Python SDK for the VGI (Vector Gateway Interface) protocol — host DuckDB scalar, table, aggregate, and table-in-out functions in an external worker over Arrow IPC.
自定义许可证2026年7月23日 · 指标 2.10.0
npm · PyPI
dataengineeringformachinelearning/dataengineeringformachinelearning
DEML — High Throughput Event Platform for Real-Time Detection and Response
Apache-2.02026年7月21日 · 指标 2.10.0
PyPI
rasinmuhammed/misata
Synthetic test data that hits the numbers you declare, exactly. Multi-table with verified foreign-key integrity, deterministic, no model in the data path. Python + MCP server.
MIT2026年8月19日 · 指标 2.10.0
Go
realdatadriven/etlx
ETL / ELT / Reverse ETL Framework powered by DuckDB, designed to seamlessly integrate and process data from diverse sources. It leverages Markdown as a configuration medium, where YAML blocks define metadata for each data source, and embedded SQL blocks specify the extraction, transformation, and loading logic.
MIT2026年9月5日 · 指标 2.10.0
npm
Query-farm/vgi-typescript
TypeScript SDK for the VGI (Vector Gateway Interface) protocol — host DuckDB scalar, table, aggregate, and table-in-out functions in an external worker over Arrow IPC.
自定义许可证2026年8月2日 · 指标 2.10.0
PyPI
Query-farm/vgi-lint-check
Lint the documentation & metadata quality of VGI (Vector Gateway Interface) data workers — descriptions, column comments, tags, and example queries — with a quality score, per-version baselines, and agent-friendly output.
自定义许可证2026年7月19日 · 指标 2.10.0
PyPI
adidas/lakehouse-engine
The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for several lakehouse algorithms, data flows and utilities for Data Products.
Apache-2.02026年8月18日 · 指标 2.10.0
PyPI · crates.io
apitap/apitap-lib
Move whole tables between databases fast — Postgres, MySQL, ClickHouse, BigQuery. Rust engine, one-line Python API, bounded memory.
MIT2026年8月18日 · 指标 2.10.0
crates.io · PyPI
mag1cfrog/delta-funnel
Fast, lightweight Delta Lake to SQL Server loads without Spark or ODBC.
Apache-2.02026年7月16日 · 指标 2.10.0
PyPI
MIT2026年8月22日 · 指标 2.10.0
PyPI · npm
datacharter/datacharter
Your data, explored locally — and your AI agents kept on a leash. A federated data explorer with governed agentic access.
Apache-2.02026年8月1日 · 指标 2.10.0
PyPI
ebiquity/crystalia-collector
该仓库未发布描述。
自定义许可证2026年7月17日 · 指标 2.10.0
Go
query-farm/vgi-go
Go SDK for the VGI (Vector Gateway Interface) protocol — host DuckDB scalar, table, aggregate, and table-in-out functions in an external worker over Arrow IPC.
自定义许可证2026年7月15日 · 指标 2.10.0