PyPI
olirice/flupy
Fluent data pipelines for python and your shell
Custom licenseSep 14, 2026 · metrics 2.10.0
All tags
Catalogue tag
#data-pipeline
Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.
45 records
PyPI · npm
kestra-io/libs
libraries used in Kestra Flows
No licenseOct 16, 2026 · metrics 2.10.0
Go · npm
Tnsor-Labs/brokoli
Brokoli — self-hosted data pipeline orchestration
Apache-2.0Sep 13, 2026 · metrics 2.10.0
PyPI
XiaokaiCui/MLPipelineHolder
MLPipelineHolder is a straightforward framework for reproducible machine-learning experimentation in Jupyter notebooks.
MITSep 18, 2026 · metrics 2.10.0
PyPI · crates.io
apitap/apitap-lib
Move whole tables between databases fast — Postgres, MySQL, ClickHouse, BigQuery. Rust engine, one-line Python API, bounded memory.
MITOct 19, 2026 · metrics 2.10.0
PyPI
sidequery/dlt-iceberg
An Iceberg destination for DLT that supports REST catalogs
MITOct 12, 2026 · metrics 2.10.0
PyPI
epoch8/tkati
No repository description published.
No licenseSep 26, 2026 · metrics 2.10.0
PyPI · crates.io · npm
sercanatalik/cereyan
Orchestration for Python data pipelines, without the platform. A fast Rust core drives flows, schedules, backfills, retries, and a live UI. Agentic-ready: MCP tools, agent-attributed runs, human-in-the-loop approvals. One wheel, no runtime dependencies.
Custom licenseOct 2, 2026 · metrics 2.10.0
PyPI · npm
N283T/pdb-mine-builder
Build a Mine-schema database from PDB data. Load PDBj structural biology data into PostgreSQL with RDKit chemical search support.
MITSep 8, 2026 · metrics 2.10.0
PyPI
pydoit/doit
CLI task management & automation tool
MITSep 17, 2026 · metrics 2.10.0
PyPI
mr3od/bgate-unix
High-performance, hardware-aware Layer 0 deduplication engine. Uses 4-tier short-circuit logic (Size → Fringe → Full Hash) with xxHash128 to eliminate exact duplicates before they enter your processing pipeline. Python 3.11+, uv, SQLite.
MITSep 18, 2026 · metrics 2.10.0
Go · PyPI
zoyluoblue/cronova
Lightweight self-hosted workflow scheduler in a single Go binary — an open-source Airflow/Azkaban alternative. Embedded SQLite, DAGs (cron + dependencies + backfill), polyglot tasks (shell/Python/SQL/JAR/HTTP), web console, REST API, and a built-in MCP server for AI agents. Linux & macOS.
MITSep 13, 2026 · metrics 2.10.0
Go
derickschaefer/reserve
A modern command-line interface (CLI) for interfacing with the Federal Reserve Bank of St. Louis FRED API.
Custom licenseOct 19, 2026 · metrics 2.10.0
Go
cuprite-io/assay
Go library for real-time data profiling, dynamic JSON schema inference, type probability estimation, and field optionality tracking.
Apache-2.0Oct 18, 2026 · metrics 2.10.0
Maven · PyPI
whylabs/whylogs
An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collection, ensuring safety & robustness. 📈
Apache-2.0Sep 12, 2026 · metrics 2.10.0