#compression

Consumer-aware compression for embedding indexes and LLM KV caches — compress by the metric the downstream consumer actually uses. PCA-Matryoshka + TurboQuant (27x @ 99.8% recall@10), asymmetric K/V, CUDA/Triton kernels, vLLM plugin, replayable CI-gated claims. MIT.

LZ4 compression, xxHash3 integrity, AES-256-GCM encryption for byte payloads

A rust binding for the zstd compression library.

LZMA / LZMA2 in native Rust

Python bindings to the Zstandard (zstd) compression library

Intel® Query Processing Library (Intel® QPL)

Extremely Fast Compression algorithm

Rust implementation of the Zstandard Seekable Format

A utility library for 7zip compression related operations

A utility library dealing with Tar compression and decompression

A utility library dealing with Tar and XZ (tar.xz) extraction/archiving and (de)compression

A utility library dealing with XZ compression and decompression

The Universal Filesystem Abstraction for Go

The rust implementation of the onpair string compression encoding

Library and binaries for the reading, creating, and modification of SquashFS file systems