#deduplication

Zero-config entity resolution feeding a durable identity layer: messy records from any source become stable golden entities, a Customer 360 with provenance, merge/split and audit. Fellegi-Sunter beats hand-tuned Splink. Arrow-native/Rust, 250M rows in 11.2 min. Python + edge TypeScript (WASM), SQL-native in Postgres & DuckDB, 97 MCP tools + REST.

rustic_core - library for fast, encrypted, deduplicated backups that powers rustic-rs

Designed for speed, scalability, and optimized performance, nextjs-turbo-redis-cache is your go-to solution Next.js cache handler for demanding production environments. If you use the app router and self-host, you will probably need this. Development sponsored by https://TRWK.de

Hardened, rootless container for fclones that dedupes your folders on a schedule

Parse bank statements — CAMT/ISO 20022, PAIN.001, CSV (EN/DE/FR/ES), OFX/QFX, MT940, PDFs (digital + scanned) — into unified Transactions. Deterministic parsers, LLM/vision fallback, Golden Rule + multi-currency + continuity verification, page provenance, dedupe, review, accuracy evals, CLI + REST API. 100% test coverage.

Self-encrypting, content-addressed storage - convergent encryption that splits data into obfuscated chunks. The peer-reviewed core of Autonomi.

Coldkeep is a correctness-first, content-addressed cold-storage engine with deterministic restore, integrity verification, safe garbage collection, deduplication, transform-aware packed storage, and a reusable engine/catalog core. v1.x is complete and frozen; v2.x is planned for local-first productization.