#data-engineering

Local-first AI copilot for data quality: 39 detectors, six-dimension scoring, AI repair with human approval, drift engine, cron scheduling with distributed worker pool (failover + parallel), MCP/REST/CLI/Web UI. Apache-2.0.

Brokoli — self-hosted data pipeline orchestration

Fast PostgreSQL / MySQL / BigQuery → ClickHouse or BigQuery ETL: a native Rust engine driven from a small, typed Python API.

Free, local-first data catalog that auto-drafts your EU compliance evidence — a GDPR Art. 30 RoPA and a DORA register. One command, ~5 minutes, no Docker. Reads names and types, never the values: raw data never leaves your machine. AGPL-3.0; the paid portal adds only the signed official record — price on the page.

Big-file data prep that never runs out of memory - an interactive shell and CLI, powered by DuckDB.