#data-pipeline

Python framework for building efficient data pipelines. It promotes modularity and collaboration, enabling the creation of complex pipelines from simple, reusable components.

Self-hostable workflow orchestrator for teams whose main work isn't orchestration. Declarative YAML over your scripts, SSH commands, containers, etc; keep workflows separate from business logic. One binary, no database, runs on limited H/W resources. Alternative to Airflow / Cron / Job Scheduler.

Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.

🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊

DataMate is an enterprise-level data processing platform designed for model fine-tuning and RAG retrieval.

Brain of Bolster, Be Ware

Config-driven data ingestion and SCD2 historization framework built on dlt

🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.

Go client for Chalk

An intuitive and flexible RDF pipeline solution designed to simplify and automate ETL processes for efficient data management.

A high-performance rules engine for IFTTT-style automation in Rust with zero-overhead JSONLogic evaluation

The Data Control Plane for AI Agents — acquire, validate, and land data over MCP with scoped keys, approval gates, and an audit log. Self-hosted, open source.