#etl

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

Scalable and efficient data transformation framework - backwards compatible with dbt.

An orchestration platform for the development, production, and observation of data assets.

Event Driven Orchestration & Scheduling Platform for Mission Critical Applications

Privacy and Security focused Segment-alternative, in Golang and React

A high-performance observability data pipeline.

A dbt adapter for Databricks.

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

Fancy stream processing made operationally mundane

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

The Public Utility Data Liberation Project provides analysis-ready energy system data to climate advocates, researchers, policymakers, and journalists.

Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

Docling core data types and transformations

Conduit streams data between data stores. Kafka Connect replacement. No JVM required.