sahib / rmlint

Extremely fast tool to remove duplicates and other lint from your filesystem
http://rmlint.rtfd.org
GNU General Public License v3.0
1.85k stars 128 forks source link

handler=clone very slow with btrfs #648

Open vb0 opened 4 months ago

vb0 commented 4 months ago

I think something changed over the last months (I'm using github version which I rarely update so I'm not sure how recent the change is, if any) when doing the "clone" on btrfs - now rmlint.sh is SLOW, as in takes hundreds of seconds or more per file. The files are from tens of MBs to 1-2GBs. Seems to be bogging down in btrfs itself somewhere, which keeps the disk completely busy with very low total MB/s use.

I don't need handler=clone, anyway handler=reflink is fine and IT FLIES when reflinking files, I'm just putting it out there as it's weird.

Might still be a change on my side, although this is on much faster storage, with a subset of the same data, and on a disk that isn't live at all for now - so it kind of shocked me when it got stuck the first files it tried to clone.