Todas las etiquetas
Etiqueta del catálogo

#deduplication

Todos los repositorios del registro público que llevan esta etiqueta, procedente de sus topics de GitHub o de las palabras clave que publican sus registros de paquetes. La salud se mide con la misma metodología versionada que el resto del registro.

24 registros
Con la etiqueta «deduplication»Ordenado por índice de salud
Go · npm
98Excepcionalíndice de salud
prometheus/alertmanager
Prometheus Alertmanager
Go · Elm★ 859728 ago 2026
Apache-2.028 ago 2026 · métricas 2.10.0
PyPI
97Excepcionalíndice de salud
borgbackup/borg
Deduplicating archiver with compression and authenticated encryption.
Python★ 13.7K↓ 70.8K/mes27 ago 2026
Licencia propia27 ago 2026 · métricas 2.10.0
PyPI
96Excepcionalíndice de salud
moj-analytical-services/splink
Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends
Python · JavaScript★ 233613 ago 2026
MIT13 ago 2026 · métricas 2.10.0
Go
94Excepcionalíndice de salud
PlakarKorp/plakar
plakar is a backup solution powered by Kloset and ptar
Go★ 203022 ago 2026
ISC22 ago 2026 · métricas 2.10.0
PyPI · crates.io
94Excepcionalíndice de salud
huggingface/xet-core
xet client tech, used in huggingface_hub
Rust★ 548↓ 257M/mes4 ago 2026
Apache-2.04 ago 2026 · métricas 2.10.0
PyPI
93Excepcionalíndice de salud
opensanctions/nomenklatura
Framework and command-line tools for integrating FollowTheMoney data streams from multiple sources
Python★ 260↓ 34.7K/mes19 ago 2026
MIT19 ago 2026 · métricas 2.10.0
crates.io
89Excelenteíndice de salud
rustic-rs/rustic_core
rustic_core - library for fast, encrypted, deduplicated backups that powers rustic-rs
Rust★ 85↓ 16.4K/mes18 ago 2026
Apache-2.018 ago 2026 · métricas 2.10.0
npm · PyPI
88Excelenteíndice de salud
benseverndev-oss/goldenmatch
Zero-config entity resolution feeding a durable identity layer: messy records from any source become stable golden entities, a Customer 360 with provenance, merge/split and audit. Fellegi-Sunter beats hand-tuned Splink. Arrow-native/Rust, 250M rows in 11.2 min. Python + edge TypeScript (WASM), SQL-native in Postgres & DuckDB, 97 MCP tools + REST.
Python · TypeScript★ 1316 sept 2026
MIT6 sept 2026 · métricas 2.10.0
PyPI
84Excelenteíndice de salud
sebastienrousseau/bankstatementparser
Parse bank statements — CAMT/ISO 20022, PAIN.001, CSV (EN/DE/FR/ES), OFX/QFX, MT940, PDFs (digital + scanned) — into unified Transactions. Deterministic parsers, LLM/vision fallback, Golden Rule + multi-currency + continuity verification, page provenance, dedupe, review, accuracy evals, CLI + REST API. 100% test coverage.
Python★ 3831 jul 2026
Apache-2.031 jul 2026 · métricas 2.10.0
Go
81Excelenteíndice de salud
cplieger/docker-fclones-scheduler
Find and deduplicate files on a schedule — reclaim wasted disk space automatically
Go★ 05 sept 2026
Apache-2.05 sept 2026 · métricas 2.10.0
npm
80Excelenteíndice de salud
git-stunts/git-cas
Git, freebased: pure CAS that’ll knock your SHAs off. LFS hates this repo!
JavaScript★ 0↓ 2858/mes25 jul 2026
Apache-2.025 jul 2026 · métricas 2.10.0
Go
78Buenoíndice de salud
franchoy/coldkeep
Coldkeep is a correctness-first, content-addressed cold-storage engine with deterministic restore, staged integrity verification, safe garbage collection, deduplication, transform-aware packed storage, stable storage semantics, and a reusable engine/catalog core. v1.x is complete; v2.x focuses on local-first productization.
Go★ 016 ago 2026
Apache-2.016 ago 2026 · métricas 2.10.0
npm
73Buenoíndice de salud
mikkelscheike/email-provider-links
Email Provider Links automatically detects which email service (Gmail, Outlook, Yahoo, etc.) someone uses and provides a direct link to their login page, making password reset flows and email-related UX seamless.
TypeScript★ 3↓ 19K/mes19 jul 2026
MIT19 jul 2026 · métricas 2.10.0
71Buenoíndice de salud
mhx/dwarfs
A fast high-compression read-only file system for Linux, FreeBSD, macOS and Windows
C++ · C★ 258217 jul 2026
Licencia propia17 jul 2026 · métricas 2.10.0
crates.io
71Buenoíndice de salud
nlfiedler/fastcdc-rs
FastCDC implementation in Rust
Rust★ 202↓ 312K/mes28 ago 2026
MIT28 ago 2026 · métricas 2.10.0
Go · npm
60Moderadoíndice de salud
alexander-kolodka/crestic
Crestic simplifies working with restic. Restic is fast and secure, but managing multiple folders and backup destinations via its CLI can get repetitive. Crestic lets you define repositories and jobs in a single YAML config and run them with simple commands — no magic, just a cleaner way to use restic.
Go★ 218 jul 2026
MIT18 jul 2026 · métricas 2.10.0
PyPI
59Moderadoíndice de salud
beshu-tech/deltaglider
Store 4TB in 5GB: S3-compatible storage with 99.9% compression for versioned files
Python★ 33↓ 99/mes17 ago 2026
MIT17 ago 2026 · métricas 2.10.0
crates.io
59Moderadoíndice de salud
revidiumhq/biblib
Parse, manage, and deduplicate academic citations
Rust★ 8↓ 25.6K/mes21 jul 2026
Apache-2.021 jul 2026 · métricas 2.10.0
Go
57Moderadoíndice de salud
samekind/codexfold
Local-first deduplication and transparent storage for Codex sessions
Go★ 019 ago 2026
Apache-2.019 ago 2026 · métricas 2.10.0
PyPI
53Moderadoíndice de salud
Fallen-Breath/pyfastcdc
A high-performance FastCDC 2020 implementation written in Python + Cython
Python · Cython★ 2↓ 6109/mes5 sept 2026
MIT5 sept 2026 · métricas 2.10.0
PyPI
44Débilíndice de salud
mr3od/bgate-unix
High-performance, hardware-aware Layer 0 deduplication engine. Uses 4-tier short-circuit logic (Size → Fringe → Full Hash) with xxHash128 to eliminate exact duplicates before they enter your processing pipeline. Python 3.11+, uv, SQLite.
Python★ 1↓ 32/mes14 ago 2026
MIT14 ago 2026 · métricas 2.10.0
npm
41Débilíndice de salud
electrovir/fuzzy-vir
El repositorio no publica descripción.
TypeScript★ 0↓ 3678/mes6 sept 2026
CC0-1.06 sept 2026 · métricas 2.10.0
PyPI
25En riesgoíndice de salud
elemental-lf/benji
Benji Backup: A block based deduplicating backup software for Ceph RBD images, iSCSI targets, image files and block devices
Python★ 15014 ago 2026
Licencia propia14 ago 2026 · métricas 2.10.0