duplicates

Star

Here are 130 public repositories matching this topic...

kucherenko / jscpd

Star

Copy/paste detector for programming source code.

quality duplicates detector code-quality cpd copy-paste duplications clones-detection detect-duplications

Updated Aug 13, 2020
TypeScript

sahib / rmlint

Star

Extremely fast tool to remove duplicates and other lint from your filesystem

lint python c filesystem duplicates deduplication fdupes

Updated Jul 26, 2020
C

atlassian / yarn-deduplicate

Star

Deduplication tool for yarn.lock files

yarn dedupe duplicates lock-file yarn-lock duplicated-packages

Updated Aug 14, 2020
JavaScript

sean-public / python-hashes

Star

Interesting (non-cryptographic) hashes implemented in pure Python.

python bloom-filter python3 hash-functions hash hashes-implemented nilsimsa geohashes simhash duplicates

Updated Mar 8, 2018
Python

F483 / dejavu

Star

Quickly detect already witnessed data.

go golang command-line memory history duplicates command-line-tool duplicate-values probabilistic deduplication

Updated Jul 16, 2017
Go

kouhin / redux-dataloader

Star

Loads async data for Redux apps focusing on preventing duplicated requests and dealing with async dependencies.

react redux async duplicates action thunk

Updated Nov 14, 2017
JavaScript

matteodelabre / mongoose-beautiful-unique-validation

Star

Plugin for Mongoose that turns duplicate errors into regular Mongoose validation errors

plugin schema validation errors mongoose fill plug duplicates turns-duplicate-errors

Updated Jan 18, 2019
JavaScript

jvirkki / dupd

Star

CLI utility to find duplicate files

c duplicate-files duplicates deduplication duplicatefilefinder

Updated Aug 9, 2020
C

src-d / apollo

Star

Advanced similarity and duplicate source code proof of concept for our research efforts.

python similarity duplicates source-code similarity-search duplicate-detection

Updated Jun 3, 2019
Python

nil0x42 / duplicut

Star

Quickly remove duplicates, without changing the order, and without getting OOM on huge wordlists.

c wordlist duplicates remove-duplicates text-processing uniq duplicates-removed john hashes cracking wordlist-generator unique uniqueness duplicate-detection password-cracking password-wordlist wordlist-technique uniquifier uniq-replacement wordlist-processing

Updated Dec 22, 2019
C

src-d / gemini

Star

Advanced similarity and duplicate source code at scale.

spark hash duplicates duplicate-detection source-code-analysis

Updated Jun 6, 2019
Scala

microsoft / near-duplicate-code-detector

Star

A simple tool for detecting near-duplicate source code

duplicates detect-duplicates

Updated Jun 8, 2020
C#

deric / es-dedupe

Star

Tool for removing duplicate documents from Elasticsearch

elasticsearch duplicates duplicity

Updated Apr 2, 2020
Python

deplicate / deplicate

Star

Advanced Duplicate File Finder for Python

python windows unix pypi duplicate-files finder duplicates macosx duplicates-removed scanning duplicatefilefinder duplicate duplicate-detection duplication-finder purge-duplicate-files multi-filtering deplicate

Updated Apr 17, 2020
Python

Bartozzz / potential-duplicates-bot

Star

A configurable GitHub App which checks for potential issue duplicates using Damerau–Levenshtein distance algorithm.

github bot probot issues duplicates probot-plugin probot-app

Updated May 21, 2019
JavaScript

kristiankoskimaki / vidupe

Star

Vidupe is a program that can find duplicate and similar video files. V1.211 released on 2019-09-18, Windows exe here:

duplicates videos duplicate-detection duplicate-videos

Updated Sep 27, 2019
C++

guicamest / GDuplicate-Finder

Star

GDuplicate Finder - A Groovy way to find duplicates among your computer and network shares!

ssh groovy s3 finder duplicates duplicate gpars network-share

Updated Jul 12, 2018
Groovy

caluml / finddups

Star

Find duplicate files on your computer

java command-line simple duplicate-files duplicates command-line-tool

Updated Jun 6, 2020
Java

mkearney / funique

Star

⌚️ A faster unique() function

r data-frame posix duplicates posixct rstats data-wrangling date-time r-package unique mkearney-r-package

Updated Dec 28, 2018
R

rustomax / ndf

Star

Duplicate file finder written in Nim

utility nim filesystem duplicate-files duplicates duplicate-detection ndf

Updated Nov 28, 2019
Nim

vladsmirnov / url-rewrites

Star

Magento 1.x module to target the URL Rewrite issue

composer magento entities duplicates reindex modman magento-installation

Updated Nov 30, 2017
PHP

rmdm / nodups

Star

No dups, no doubts

duplicates uniq unique nodups

Updated Jun 1, 2020
JavaScript

lmammino / indexed-string-variation

Star

Experimental JavaScript module to generate all possible variations of strings over an alphabet using an n-ary virtual tree

nodejs javascript library tree node algorithm string strings duplicates javascript-library alphabet variations virtual characters

Updated Jan 4, 2018
JavaScript

rasheedsulayman / DuplicateContactsRemover

Star

📒A simple app to optimize your address book and remove duplicate contacts.

kotlin material-design dependency-injection mvvm duplicates contacts-manager architecture-components androidx

Updated Jun 17, 2020
Kotlin

danielpclark / dfm

Star

Duplicate File Manager

file-indexing duplicates md5 recursively-search

Updated Jan 25, 2017
Ruby

shevchenkoartem / lastfm-smart-deduper

Star

JS script that allows you to remove duplicates from your Last.fm scrobbles library.

last-fm lastfm duplicates remove-duplicates scrobbling deduplicate

Updated Feb 15, 2020
JavaScript

NicolasBizzozzero / dupe_eraser

Star

A command-line tool which automate the deletion of duplicate files based on their hash or perceptual-hash.

cli duplicate-files duplicates file-management duplicate-detection

Updated Oct 21, 2019
Python

zx8754 / StackOverflowNotes

Star

SO [r] tag list of dupes, help, links, etc.

r stackoverflow duplicates target questions-and-answers

Updated Apr 18, 2019

Dmitriy-Vas / go-file-copies

Star

A Go program to get duplicates from specified paths.

golang duplicates copies

Updated Jan 21, 2020
Go

redonkulus / dump-deps

Star

Dump NPM package dependencies to display packages with multiple versions.

npm duplicates deps dump-deps

Updated Jun 1, 2020
JavaScript

Improve this page

Add a description, image, and links to the duplicates topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the duplicates topic, visit your repo's landing page and select "manage topics."

Learn more