search

hpc / mpifileutils

File utilities designed for scalability and performance.
https://hpc.github.io/mpifileutils
BSD 3-Clause "New" or "Revised" License
162 stars 64 forks source link

ddup size limit filter? #571

Open markmoe19 opened 2 months ago

markmoe19 commented 2 months ago

Hi,

It would be create if ddup had a size limit filter? For example --min-size=10G could have ddup run much faster by only looking at files of 10GB in size or larger.

A report with 1000s of small duplicate files isn't as useful to sort through.

Thank you!