#etl

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

Scalable and efficient data transformation framework - backwards compatible with dbt.

An orchestration platform for the development, production, and observation of data assets.

Event Driven Orchestration & Scheduling Platform for Mission Critical Applications

Privacy and Security focused Segment-alternative, in Golang and React

A dbt adapter for Databricks.

A high-performance observability data pipeline.

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

The Public Utility Data Liberation Project provides analysis-ready energy system data to climate advocates, researchers, policymakers, and journalists.

Fancy stream processing made operationally mundane

Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

Docling core data types and transformations

High-performance, time-indexed object storage for robotics and industrial IoT