markfasheh / duperemove

Tools for deduping file systems
GNU General Public License v2.0
795 stars 80 forks source link

A bunch of optimisations #240

Closed lorddoskias closed 4 years ago

lorddoskias commented 4 years ago

Just a bunch of optimisations - ranging from using cached values where applicable to batching up memory and read operations which should reduce the overall runtime in certain scenarios - i.e files with a lot of extents and large files.