markfasheh / duperemove

Tools for deduping file systems
GNU General Public License v2.0
797 stars 80 forks source link

"Infinity loop" when dedupe #192

Closed jackycxh closed 11 months ago

jackycxh commented 6 years ago

some times the program goes to a "infinity loop" during dedupe. showing same extents messages continues until cancelled by "Ctrl-C". below for example. i kept it running for two hours, in this two hours, it did not release any spaces, but occupied 2G spaces (not sure where this 2G was used).

[0x55bd4b59c4f0] Dedupe 119 extents (id: e47862ea) with target: (200278016, 131072), "/var/lib/mldonkey/temp/urn_ed2k_ED0D0F5D188FB3B8274019126A633B93" [0x55bd4b59c4a0] Dedupe 119 extents (id: e47862ea) with target: (5373952, 131072), "/var/cache/bind/core" [0x55bd4b59c4a0] Dedupe 119 extents (id: e47862ea) with target: (5373952, 131072), "/var/cache/bind/core" [0x55bd4b59c4f0] Dedupe 119 extents (id: e47862ea) with target: (200278016, 131072), "/var/lib/mldonkey/temp/urn_ed2k_ED0D0F5D188FB3B8274019126A633B93" [0x55bd4b59c4a0] Dedupe 119 extents (id: e47862ea) with target: (5373952, 131072), "/var/cache/bind/core" [0x55bd4b59c4f0] Dedupe 119 extents (id: e47862ea) with target: (200278016, 131072), "/var/lib/mldonkey/temp/urn_ed2k_ED0D0F5D188FB3B8274019126A633B93" [0x55bd4b59c4a0] Dedupe 119 extents (id: e47862ea) with target: (5373952, 131072), "/var/cache/bind/core" [0x55bd4b59c4f0] Dedupe 119 extents (id: e47862ea) with target: (200278016, 131072), "/var/lib/mldonkey/temp/urn_ed2k_ED0D0F5D188FB3B8274019126A633B93" [0x55bd4b59c4a0] Dedupe 119 extents (id: e47862ea) with target: (5373952, 131072), "/var/cache/bind/core" [0x55bd4b59c4a0] Dedupe 119 extents (id: e47862ea) with target: (5373952, 131072), "/var/cache/bind/core" [0x55bd4b59c4f0] Dedupe 119 extents (id: e47862ea) with target: (200278016, 131072), "/var/lib/mldonkey/temp/urn_ed2k_ED0D0F5D188FB3B8274019126A633B93" [0x55bd4b59c4a0] Dedupe 119 extents (id: e47862ea) with target: (5373952, 131072), "/var/cache/bind/core" [0x55bd4b59c4f0] Dedupe 119 extents (id: e47862ea) with target: (200278016, 131072), "/var/lib/mldonkey/temp/urn_ed2k_ED0D0F5D188FB3B8274019126A633B93" [0x55bd4b59c4a0] Dedupe 119 extents (id: e47862ea) with target: (5373952, 131072), "/var/cache/bind/core" [0x55bd4b59c4f0] Dedupe 119 extents (id: e47862ea) with target: (200278016, 131072), "/var/lib/mldonkey/temp/urn_ed2k_ED0D0F5D188FB3B8274019126A633B93" [0x55bd4b59c4a0] Dedupe 119 extents (id: e47862ea) with target: (5373952, 131072), "/var/cache/bind/core" [0x55bd4b59c4a0] Dedupe 119 extents (id: e47862ea) with target: (5373952, 131072), "/var/cache/bind/core" [0x55bd4b59c4f0] Dedupe 119 extents (id: e47862ea) with target: (200278016, 131072), "/var/lib/mldonkey/temp/urn_ed2k_ED0D0F5D188FB3B8274019126A633B93" [0x55bd4b59c4a0] Dedupe 119 extents (id: e47862ea) with target: (5373952, 131072), "/var/cache/bind/core" [0x55bd4b59c4f0] Dedupe 119 extents (id: e47862ea) with target: (200278016, 131072), "/var/lib/mldonkey/temp/urn_ed2k_ED0D0F5D188FB3B8274019126A633B93" [0x55bd4b59c4a0] Dedupe 119 extents (id: e47862ea) with target: (5373952, 131072), "/var/cache/bind/core" [0x55bd4b59c4f0] Dedupe 119 extents (id: e47862ea) with target: (200278016, 131072), "/var/lib/mldonkey/temp/urn_ed2k_ED0D0F5D188FB3B8274019126A633B93" [0x55bd4b59c4a0] Dedupe 119 extents (id: e47862ea) with target: (5373952, 131072), "/var/cache/bind/core" [0x55bd4b59c4f0] Dedupe 119 extents (id: e47862ea) with target: (200278016, 131072), "/var/lib/mldonkey/temp/urn_ed2k_ED0D0F5D188FB3B8274019126A633B93" [0x55bd4b59c4a0] Dedupe 119 extents (id: e47862ea) with target: (5373952, 131072), "/var/cache/bind/core" [0x55bd4b59c4f0] Dedupe 119 extents (id: e47862ea) with target: (200278016, 131072), "/var/lib/mldonkey/temp/urn_ed2k_ED0D0F5D188FB3B8274019126A633B93" [0x55bd4b59c4a0] Dedupe 119 extents (id: e47862ea) with target: (5373952, 131072), "/var/cache/bind/core" [0x55bd4b59c4f0] Dedupe 119 extents (id: e47862ea) with target: (200278016, 131072), "/var/lib/mldonkey/temp/urn_ed2k_ED0D0F5D188FB3B8274019126A633B93" [0x55bd4b59c4f0] Dedupe 119 extents (id: e47862ea) with target: (200278016, 131072), "/var/lib/mldonkey/temp/urn_ed2k_ED0D0F5D188FB3B8274019126A633B93" [0x55bd4b59c4a0] Dedupe 119 extents (id: e47862ea) with target: (5373952, 131072), "/var/cache/bind/core" [0x55bd4b59c4f0] Dedupe 119 extents (id: e47862ea) with target: (200278016, 131072), "/var/lib/mldonkey/temp/urn_ed2k_ED0D0F5D188FB3B8274019126A633B93" [0x55bd4b59c4a0] Dedupe 119 extents (id: e47862ea) with target: (5373952, 131072), "/var/cache/bind/core" [0x55bd4b59c4f0] Dedupe 119 extents (id: e47862ea) with target: (200278016, 131072), "/var/lib/mldonkey/temp/urn_ed2k_ED0D0F5D188FB3B8274019126A633B93" [0x55bd4b59c4a0] Dedupe 119 extents (id: e47862ea) with target: (5373952, 131072), "/var/cache/bind/core" [0x55bd4b59c4f0] Dedupe 119 extents (id: e47862ea) with target: (200278016, 131072), "/var/lib/mldonkey/temp/urn_ed2k_ED0D0F5D188FB3B8274019126A633B93" [0x55bd4b59c4f0] Dedupe 119 extents (id: e47862ea) with target: (200278016, 131072), "/var/lib/mldonkey/temp/urn_ed2k_ED0D0F5D188FB3B8274019126A633B93" [0x55bd4b59c4a0] Dedupe 119 extents (id: e47862ea) with target: (5373952, 131072), "/var/cache/bind/core" [0x55bd4b59c4f0] Dedupe 119 extents (id: e47862ea) with target: (200278016, 131072), "/var/lib/mldonkey/temp/urn_ed2k_ED0D0F5D188FB3B8274019126A633B93" [0x55bd4b59c4a0] Dedupe 119 extents (id: e47862ea) with target: (5373952, 131072), "/var/cache/bind/core"

markfasheh commented 6 years ago

Hi, I know it's been a while but do you still hit this and if you do, what versions of duperemove and the linux kernel are you running?

JackSlateur commented 11 months ago

Hello @jackycxh Lots of code has changed since your report Could you please check the latest version and reopen this if you still have the issue ?