Compressed Repo: Parallel Compression

workflo / shaback

A hash digest based backup tool

GNU General Public License v3.0

4 stars 0 forks source link

Open raimi opened 8 years ago

raimi commented 8 years ago

Fun fact: "Deflate" (the fastest compression algorithm we have) can compress about 40MB/s on current hardware. 10 MB/s on older hardware.

Feature Request: When split-compressing big files (VM disk imagtes), do the compression in several threads, reading the source file in parallel.

raimi commented 8 years ago

PS: An alternative would be to use "snappy" https://github.com/google/snappy - a compression algorithm designed for speed, not ratio.