search

Zygo / bees

Best-Effort Extent-Same, a btrfs dedupe agent
GNU General Public License v3.0
669 stars 55 forks source link

Using bees will reduce the read and write performance of btrfs? #129

Open daiaji opened 5 years ago

daiaji commented 5 years ago

If it only consumes CPU performance, I don't care, my R9 3900X performance is quite strong.

kakra commented 5 years ago

It works in the background with no perceivable impact on performance (at least when using the systemd service). I can even play Steam games while it is running in the background with an old 3rd gen Intel CPU. So this should probably not be your concern.

However, in the long run, bees may increase fragmentation because it tends to break big extents into smaller ones to increase deduplication rate and storage efficiency. But I think, this effect is barely visible, it shouldn't make any performance difference reading and writing data. There're plans, tho, to let bees also recombine small extents into bigger ones and thus make it an adaptive defragmenter.

During the first pass (when bees completely scans your storage for the first time), you'll see a lot of reads going on which may have an impact on perceived performance but that effect is temporary.

daiaji commented 5 years ago

I have a 3.84T pm983, I don't care about fragmented files, but in the bees development plan, the future will let the deduplication and defragmentation together, I am looking forward to it, this may be very helpful for me to set up NAS in the future.