#parquet

Work with XBRL filings above Arelle: one parse, portable models

PHP ETL Adapter: Parquet

An opinionated config-driven Rust server that publishes Parquet and Delta datasets as fast, typed HTTP APIs from local disk or object storage, with interchangeable DuckDB or Arrow+DataFusion backends, JSON and Arrow IPC output, and production-ready features like auth, metrics, and hot reloads.

An embedded analytical database written in Rust, compatible with DuckDB. Its own columnar format with global dictionaries and multi-column compression, and operators that run directly on the encoded data. The bar is 10x DuckDB on ClickBench at a tenth of the disk.

Token-efficient data serialization for LLM/AI. 50% fewer tokens than JSON, 93% better value/token. Rust, schema validation, LSP.

Data Engineering infrastructure that controls inbound tabular data file feeds and validates data contracts

PHP ETL - parquet library

Bulk job-board scraper with 100+ sites, email enrichment, deterministic quality scoring, and multi-format exports (CSV/JSONL/XLSX/Parquet). Designed for scheduled bulk-first operations with per-site rate limiting, proxy pools, and resume support.

Big-file data prep that never runs out of memory - an interactive shell and CLI, powered by DuckDB.

Export PostgreSQL table or query into Parquet file

CLI for fast, flexbile concatenation of tabular data using polars

Опис репозиторію не опубліковано.

Python client, CLI and local node for WITAN, the agent-to-agent knowledge market. pip install witan-sdk, or run the node as a container: ghcr.io/kor-jongwon/witan-node

Fully asynchronous, pure JavaScript implementation of the Parquet file format with additional features