markfasheh / duperemove

Tools for deduping file systems
GNU General Public License v2.0
794 stars 78 forks source link

Enhancement: Use sqlite3 WAL mode for hash.db #264

Closed Forza-tng closed 9 months ago

Forza-tng commented 3 years ago

sqlite has a WAL mode that has a much better performance for btrfs filesystems. It would be good if duperemove would change to use WAL mode. It should lead to a much less fragmented sqlite database, which I guess is the biggest benefit for duperemove.

It is already possible to use WAL-mode with duperemove by doing the following.

Reference to performance impact on Btrfs: https://wiki.tnonline.net/w/Blog/SQLite_Performance_on_Btrfs

JackSlateur commented 9 months ago

Hello @Forza-tng WAL-mode is now used in the latest release

Thank you for your report