Catalogue tag

#deduplication

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

34 records

Tagged “deduplication”Ranked by health index

PyPI

47Weakhealth index

mr3od/bgate-unix

High-performance, hardware-aware Layer 0 deduplication engine. Uses 4-tier short-circuit logic (Size → Fringe → Full Hash) with xxHash128 to eliminate exact duplicates before they enter your processing pipeline. Python 3.11+, uv, SQLite.

Python★ 1↓ 18/moSep 18, 2026

MITSep 18, 2026 · metrics 2.10.0

npm

41Weakhealth index