facebook / zstd

Zstandard - Fast real-time compression algorithm
http://www.zstd.net
Other
23.82k stars 2.11k forks source link

Add fastest block-splitter variant #4178

Closed Cyan4973 closed 4 weeks ago

Cyan4973 commented 1 month ago

Following #4176, this is the last and fastest variant. It is less precise but its speed is suitable for fast strategy: it remains within noise level (<2%) even at negative compression levels (tested up to -7).

silesia.tar : level dev this PR savings
1 73,422,067 73,193,855 -228,212
2 69,503,582 69,309,934 -193,648

The compression ratio impact for negative compression levels is negligible, likely due to the disabling of the huffman literal compression stage, but nonetheless remains generally positive by a small margin.