#parquet

Work with XBRL filings above Arelle: one parse, portable models

PHP ETL Adapter: Parquet

An opinionated config-driven Rust server that publishes Parquet and Delta datasets as fast, typed HTTP APIs from local disk or object storage, with interchangeable DuckDB or Arrow+DataFusion backends, JSON and Arrow IPC output, and production-ready features like auth, metrics, and hot reloads.

An embedded analytical database written in Rust, compatible with DuckDB. Its own columnar format with global dictionaries and multi-column compression, and operators that run directly on the encoded data. The bar is 10x DuckDB on ClickBench at a tenth of the disk.

Token-efficient data serialization for LLM/AI. 50% fewer tokens than JSON, 93% better value/token. Rust, schema validation, LSP.

Data Engineering infrastructure that controls inbound tabular data file feeds and validates data contracts

PHP ETL - parquet library

Bulk job-board scraper with 100+ sites, email enrichment, deterministic quality scoring, and multi-format exports (CSV/JSONL/XLSX/Parquet). Designed for scheduled bulk-first operations with per-site rate limiting, proxy pools, and resume support.

Big-file data prep that never runs out of memory - an interactive shell and CLI, powered by DuckDB.

Export PostgreSQL table or query into Parquet file

CLI for fast, flexbile concatenation of tabular data using polars

Keine Repository-Beschreibung veröffentlicht.

Python client, CLI and local node for WITAN, the agent-to-agent knowledge market. pip install witan-sdk, or run the node as a container: ghcr.io/kor-jongwon/witan-node

Fully asynchronous, pure JavaScript implementation of the Parquet file format with additional features