deajan / backup-bench

Quick and dirty backup tool benchmark with reproducible results
BSD 3-Clause "New" or "Revised" License
112 stars 10 forks source link

Default vs "best" settings #17

Open basldfalksjdf opened 1 year ago

basldfalksjdf commented 1 year ago

Just throwing an idea out there, not sure how viable this is. Is it worth running the benchmarks two ways: (1) using default settings and (2) using settings optimized for this workload?

I ask because almost all these software have tweaks that can improve performance in certain aspects. For example, with Kopia you can use smaller chunks to enhance deduplication and thus reduce backup repository size. Kopia uses 4M chunks by default, because this is most efficient when the number of files gets large. But in a scenario where there are fewer files, changing it to 1M chunks may reduce in smaller backup repository size. I am sure the other programs have similar settings that can be tweaked.

deajan commented 1 year ago

The idea ain't bad, but there are already some choices made.

I think I'll just optimize the backup arguments until I can squeeze the most out of each program, which I will also document. Once I'm done with that, I may redo a vanilla benchmark for comparaison.