search

adrianlopezroche / fdupes

FDUPES is a program for identifying or deleting duplicate files residing within specified directories.
2.43k stars 187 forks source link

Use XXH64 instead of MD5 #108

Open adamfur opened 6 years ago

adamfur commented 6 years ago

Switching to a more CPU friendly hash algorithm that is 100x faster than MD5. Both XXH64 and MD5 have quality index of 10 in SMHasher.

Also confirmmatch() is run prior to erasure.

ErwanAliasr1 commented 5 years ago

I'm running on an ARM based system where cpu counts. Can you rebase this PR ?

adamfur commented 5 years ago

Didn't seem like a whole lot of interest to have it merged. Perhaps just use the master branch from my repo?

ErwanAliasr1 commented 5 years ago

Rebasing would be better so it if works fine we can ask for a merge ;)