Maven
apache/shardingsphere
Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.
Apache-2.05. Aug. 2026 · Metriken 2.10.0
Alle Tags
Katalog-Tag
#data-pipeline
Alle Repositories im öffentlichen Register, die dieses Tag tragen — aus ihren GitHub-Topics oder den von ihren Paket-Registries veröffentlichten Schlagwörtern. Die Gesundheit wird nach derselben versionierten Methodik gemessen wie im übrigen Register.
28 Einträge
Go
rudderlabs/rudder-server
Privacy and Security focused Segment-alternative, in Golang and React
Eigene Lizenz28. Aug. 2026 · Metriken 2.10.0
PyPI
elementary-data/elementary
The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.
Apache-2.013. Aug. 2026 · Metriken 2.10.0
Maven · npm
airbytehq/airbyte
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
Eigene Lizenz26. Aug. 2026 · Metriken 2.10.0
PyPI · Go · npm
bruin-data/ingestr
ingestr is a CLI tool to copy data between any databases with a single command seamlessly.
Eigene Lizenz17. Juli 2026 · Metriken 2.10.0
PyPI
datajuicer/data-juicer
Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
Apache-2.03. Aug. 2026 · Metriken 2.10.0
Go
datazip-inc/olake
OLake - Fastest Databases, Kafka & S3 Replication to Apache Iceberg with Table optimization (Called OLake Fusion). ⚡ Efficient, quick and scalable data ingestion for real-time analytics. Supported sources : Postgres, MongoDB, MySQL, Oracle, MSSql, DB2, Kafka, S3.
Apache-2.031. Aug. 2026 · Metriken 2.10.0
Go
ConduitIO/conduit
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
Apache-2.017. Juli 2026 · Metriken 2.10.0
Maven
debezium/debezium
Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.
Apache-2.027. Aug. 2026 · Metriken 2.10.0
RubyGems · npm
multiwoven/multiwoven
🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.
AGPL-3.017. Juli 2026 · Metriken 2.10.0
Go · crates.io · npm +1
estuary/flow
🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊
Eigene Lizenz17. Juli 2026 · Metriken 2.10.0
PyPI
Glitni/dlt-saga
Config-driven data ingestion and SCD2 historization framework built on dlt
Apache-2.03. Aug. 2026 · Metriken 2.10.0
Go
chalk-ai/chalk-go
Go client for Chalk
Apache-2.016. Juli 2026 · Metriken 2.10.0
PyPI
maltzsama/dagster-authkit
Community Auth System for self-hosted Dagster OSS - simple RBAC, Audit-log, and Session Management
Apache-2.022. Aug. 2026 · Metriken 2.10.0
PyPI
olirice/flupy
Fluent data pipelines for python and your shell
Eigene Lizenz27. Juli 2026 · Metriken 2.10.0
PyPI
russalo/file-observer
Deterministic file observation for pipelines — one read-only pass over a directory emits a reproducible JSON manifest of every file's type, metadata, structure, and provenance.
Eigene Lizenz17. Juli 2026 · Metriken 2.10.0
PyPI
PFund-Software-Ltd/pfeed
Data Engine for AI/Algo Trading: Download/Stream -> Clean -> Store. Supports Data Lakehouse Architecture. Clean Once and Forget.
Apache-2.020. Juli 2026 · Metriken 2.10.0
PyPI
ebarti/jobstreaming
Concurrent, resumable job collection for Python with typed events, durable checkpoints, normalized models, and a DataFrame API.
MIT29. Aug. 2026 · Metriken 2.10.0
PyPI · crates.io
apitap/apitap-lib
Move whole tables between databases fast — Postgres, MySQL, ClickHouse, BigQuery. Rust engine, one-line Python API, bounded memory.
MIT18. Aug. 2026 · Metriken 2.10.0
PyPI · Go · Maven
liam0205/pineapple
Multi-runtime DAG pipeline engine — declare in Python, execute in Go / Java / Python, decouple with JSON.
Apache-2.017. Juli 2026 · Metriken 2.10.0
PyPI
Jackxiaozhiren/datasentry
Local-first AI copilot for data quality: 39 detectors, six-dimension scoring, AI repair with human approval, drift engine, cron scheduling with distributed worker pool (failover + parallel), MCP/REST/CLI/Web UI. Apache-2.0.
Apache-2.016. Aug. 2026 · Metriken 2.10.0
Go · npm
Tnsor-Labs/brokoli
Brokoli — self-hosted data pipeline orchestration
Apache-2.025. Juli 2026 · Metriken 2.10.0
PyPI · npm
N283T/pdb-mine-builder
Build a Mine-schema database from PDB data. Load PDBj structural biology data into PostgreSQL with RDKit chemical search support.
MIT15. Juli 2026 · Metriken 2.10.0
PyPI
pydoit/doit
CLI task management & automation tool
MIT13. Aug. 2026 · Metriken 2.10.0
Go
derickschaefer/reserve
A modern command-line interface (CLI) for interfacing with the Federal Reserve Bank of St. Louis FRED API.
Eigene Lizenz20. Aug. 2026 · Metriken 2.10.0
PyPI
mr3od/bgate-unix
High-performance, hardware-aware Layer 0 deduplication engine. Uses 4-tier short-circuit logic (Size → Fringe → Full Hash) with xxHash128 to eliminate exact duplicates before they enter your processing pipeline. Python 3.11+, uv, SQLite.
MIT14. Aug. 2026 · Metriken 2.10.0
Go · PyPI
zoyluoblue/cronova
Lightweight self-hosted workflow scheduler in a single Go binary — an open-source Airflow/Azkaban alternative. Embedded SQLite, DAGs (cron + dependencies + backfill), polyglot tasks (shell/Python/SQL/JAR/HTTP), web console, REST API, and a built-in MCP server for AI agents. Linux & macOS.
MIT23. Juli 2026 · Metriken 2.10.0
Maven · PyPI
whylabs/whylogs
An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collection, ensuring safety & robustness. 📈
Apache-2.021. Juli 2026 · Metriken 2.10.0