#etl

TAK Compatible, browser based Common Operation Picture & Situational Awareness tool

A Python stream processing engine modeled after Yahoo! Pipes

ApeCloud's Data Transfer Suite, written in Rust. Provides ultra-fast data replication between MySQL, PostgreSQL, Redis, MongoDB, Kafka and ClickHouse, ideal for disaster recovery (DR) and migration scenarios.

Describe a labeled property graph once in a YAML manifest; GraFlo builds the schema and ingests records from CSV, JSON, Parquet, SQL, RDF/SPARQL, REST APIs or Kafka into ArangoDB, Neo4j, TigerGraph, FalkorDB, Memgraph, NebulaGraph, PostgreSQL or a directory on disk.

Apache Airflow-compatible workflow orchestrator, re-engineered in Go — the drop-in Airflow UI + REST API, but on a single-binary control plane (no Python GIL), with pod-per-task isolation and GitOps-native DAGs. Self-host on one machine (Lite) or Kubernetes (Pro).

Use SQL to instantly query Azure resources across regions and subscriptions. Open source CLI. No DB required.

Actively maintained successor to Alibaba DataX — a fast, versatile, open-source ETL tool for 30+ RDBMS and NoSQL data sources.

Config-driven data ingestion and SCD2 historization framework built on dlt

🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.

A high-level machine learning and deep learning library for the PHP language.

Pull and standardize data on cloud compute resources.

Sling is a CLI tool that extracts data from a source storage/database and loads it in a target storage/database.

A COBOL parser and Mainframe/EBCDIC data source for Apache Spark

Interfaces and base classes for creating ETLs

This bundle allows to configure series of tasks to be performed on a certain order. Basically, it will greatly ease the configuration of import and exports but can do much more.

Fetchez is a robust, highly modular, and extendable Python framework designed to orchestrate geospatial data engineering workflows.

Frontend & BFF (Backend for frontend) for Olake. This includes the UI code and backend code for storing the configuration of sync and orchestrating it.

PHP - ETL (Extract Transform Load) data processing library

An intuitive and flexible RDF pipeline solution designed to simplify and automate ETL processes for efficient data management.

The Data Control Plane for AI Agents — acquire, validate, and land data over MCP with scoped keys, approval gates, and an audit log. Self-hosted, open source.

Async Rust library to route messages between Kafka, NATS, MQTT, AMQP, databases and HTTP, with Python and Node bindings

convtools is a specialized Python library for dynamic, declarative data transformations with automatic code generation