Fast, secure, efficient backup program
-
Updated
Sep 17, 2021 - Go
#
dedupe
Here are 67 public repositories matching this topic...
python
clustering
dedupe
record-linkage
python-library
entity-resolution
datamade
dedupe-library
de-duplicating
-
Updated
Sep 3, 2021 - Python
Deduplication tool for yarn.lock files
-
Updated
Aug 11, 2021 - JavaScript
A powerful duplicate file finder and an enhanced fork of 'fdupes'.
c
windows
macos
linux
fast
dedupe
duplicate-files
bsd
macosx
btrfs
mit-license
win32
symlinks
deduplication
fdupes
symlink-files
delete-files
hard-links
hardlinking
deduplication-command
-
Updated
Jun 4, 2021 - C
Make CSS easier and more maintainable by using JavaScript
-
Updated
Aug 10, 2021 - TypeScript
A toolkit for record linkage and duplicate detection in Python
python
machine-learning
privacy
dedupe
record-linkage
python-library
entity-resolution
similarity
string-distance
deduplication
data-matching
-
Updated
Apr 28, 2021 - Python
Remove duplicates from MASSIVE wordlist, without sorting it (for dictionary-based password cracking)
c
dictionary
dedupe
password
wordlist
remove-duplicates
uniq
hashes
cracking
wordlist-generator
hashcat
unique
duplicate-detection
password-cracking
wordlists
-
Updated
Aug 23, 2021 - C
-
Updated
Mar 31, 2020 - Python
-
Updated
Jun 17, 2021 - Python
Finding and deleting near-duplicate images based on perceptual hash.
-
Updated
Sep 7, 2021 - Python
Scalable fuzzy matching for data mastering, deduplication and entity resolution.
data-science
identity-resolution
spark
etl
dedupe
entity-resolution
data-transformation
ml
fuzzy-matching
deduplication
masterdata
dataengineering
fuzzymatch
datapreparation
analytics-engineering
data-transformations
-
Updated
Sep 14, 2021 - Java
A fast file deduplicator
-
Updated
Jul 14, 2021 - Rust
Lakshmipathi
commented
Aug 24, 2020
Right dduper has minimal test script to check basic functionality See ci/gitlab/*.sh . Enhance it add RAID tests.
A simple command line interface to the datamade/dedupe library.
-
Updated
Jun 9, 2021 - Jupyter Notebook
Self-contained C# library for data deduplication using Sqlite
compression
storage
nuget
dedupe
sqlite-database
data-deduplication
chunk
compress
deduplication
chunk-data
duplicate-data
chunk-key
-
Updated
Nov 15, 2020 - C#
Duplicate code finder for Elixir
-
Updated
Apr 12, 2021 - Elixir
Yet Another Dupes Finder
-
Updated
Aug 26, 2021 - Rust
-
Updated
Mar 31, 2020 - Python
A command-line tool for deduplicating entries in a file or stream with constant memory usage
-
Updated
Apr 19, 2021 - C
Improve this page
Add a description, image, and links to the dedupe topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the dedupe topic, visit your repo's landing page and select "manage topics."
Considering issues like #5954 are bad to solve / debug without this information, borg should debug log full paths of all caches / indexes it uses.