Closed Sanmayce closed 8 years ago
Thanks for sharing your results @Sanmayce . They are insightful.
Some quick feedback for v1.1.2:
brotli24 0.5.2 -11 0.69 MB/s 597 MB/s 767724 9.12 Jordan_Radichkov_-_short-stories_(Bulgarian).tar
zstd 1.1.1 -22 2.59 MB/s 987 MB/s 776105 9.22 Jordan_Radichkov_-_short-stories_(Bulgarian).tar
lzham 1.0 -d26 -4 1.16 MB/s 396 MB/s 776265 9.22 Jordan_Radichkov_-_short-stories_(Bulgarian).tar
csc 2016-10-13 -5 2.83 MB/s 169 MB/s 779402 9.26 Jordan_Radichkov_-_short-stories_(Bulgarian).tar
tornado 0.6a -16 2.88 MB/s 379 MB/s 783289 9.30 Jordan_Radichkov_-_short-stories_(Bulgarian).tar
lz5 2.0 RC2 -49 2.27 MB/s 1694 MB/s 899350 10.68 Jordan_Radichkov_-_short-stories_(Bulgarian).tar
lzham 1.0 -d26 -1 2.41 MB/s 312 MB/s 934998 11.11 Jordan_Radichkov_-_short-stories_(Bulgarian).tar
lz5 2.0 RC2 -29 2.24 MB/s 2310 MB/s 1040939 12.36 Jordan_Radichkov_-_short-stories_(Bulgarian).tar
zstd 1.1.1 -12 13 MB/s 898 MB/s 1137807 13.51 Jordan_Radichkov_-_short-stories_(Bulgarian).tar
zling 2016-01-10 -4 41 MB/s 211 MB/s 1296138 15.39 Jordan_Radichkov_-_short-stories_(Bulgarian).tar
crush 1.0 -2 0.11 MB/s 457 MB/s 1324163 15.73 Jordan_Radichkov_-_short-stories_(Bulgarian).tar
yalz77 2015-09-19 -12 51 MB/s 458 MB/s 1562197 18.55 Jordan_Radichkov_-_short-stories_(Bulgarian).tar
brieflz 1.1.0 148 MB/s 187 MB/s 1785471 21.21 Jordan_Radichkov_-_short-stories_(Bulgarian).tar
xpack 2016-06-02 -9 5.44 MB/s 662 MB/s 1911270 22.70 Jordan_Radichkov_-_short-stories_(Bulgarian).tar
lz5 2.0 RC2 -39 3.06 MB/s 1524 MB/s 1945363 23.11 Jordan_Radichkov_-_short-stories_(Bulgarian).tar
...
775841 9.2 2.20 1320.68 lzturbo 39 Jordan_Radichkov_-_short-stories_(Bulgarian).tar.tbb
775925 9.2 1.27 394.79 lzham 4 Jordan_Radichkov_-_short-stories_(Bulgarian).tar.tbb
776271 9.2 2.72 1016.83 zstd 22 Jordan_Radichkov_-_short-stories_(Bulgarian).tar.tbb
944115 11.2 3.41 1145.80 xpack 9 Jordan_Radichkov_-_short-stories_(Bulgarian).tar.tbb
947070 11.2 4.87 99.05 zpaq 2 Jordan_Radichkov_-_short-stories_(Bulgarian).tar.tbb
1051376 12.5 2.30 1675.82 lzturbo 29 Jordan_Radichkov_-_short-stories_(Bulgarian).tar.tbb
...
D:\Textual_Decompression_Showdown_24-files>zstd-v1.1.2-win64.exe -b3 Jordan_Radichkov_-_short-stories_(Bulgarian).tar
3#s_(Bulgarian).tar : 8419328 -> 1830748 (4.599), 180.0 MB/s , 556.6 MB/s
D:\Textual_Decompression_Showdown_24-files>zstd-v1.1.2-win64.exe -b12 Jordan_Radichkov_-_short-stories_(Bulgarian).tar
12#s_(Bulgarian).tar : 8419328 -> 1137807 (7.400), 13.5 MB/s , 860.4 MB/s
D:\Textual_Decompression_Showdown_24-files>zstd-v1.1.2-win64.exe -b22 --ultra Jordan_Radichkov_-_short-stories_(Bulgarian).tar
22#s_(Bulgarian).tar : 8419328 -> 776041 (10.849), 2.4 MB/s , 926.8 MB/s
A more thorough side-by-side results are needed, to be done. Hate that cannot gather all the testfiles into one roster at once - no compute power, for now, this is what I got:
Very good English texts test 150MB - 2466 html files tarred, downloadable at: https://bookshelf.theanarchistlibrary.org/library/librarian-previous-announcements-en
The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt (4,445,260):
--------------------------------------------------------------------------
| Decompressor | Compressed Size | Decompression Speed |
--------------------------------------------------------------------------
| bzip2 | 999,248 | 22.92 MB/s |
| brotli24 0.5.2 -11 | 1,056,498 | 298 MB/s |
| zstd-v1.1.2-win64 -b22 --ultra | 1,074,683 | 451.9 MB/s |
| zstd 1.1.1 -22 | 1,074,949 | 480 MB/s |
| lzturbo 39 | 1,079,347 | 678.56 MB/s |
| lz5 2.0 RC2 -49 | 1,246,110 | 865 MB/s |
| Eye-of-the-Lonewolf | 1,390,843 | 965 MB/s |
| lzsse2 17 | 1,390,898 | 2369.54 MB/s |
--------------------------------------------------------------------------
enwik8 (100,000,000):
--------------------------------------------------------------------------
| Decompressor | Compressed Size | Decompression Speed |
--------------------------------------------------------------------------
| zstd-v1.1.2-win64 -b22 --ultra | 25,380,049 | 365.9 MB/s |
| zstd 1.1.1 -22 | 25,382,609 | 228 MB/s |
| lzturbo 39 | 25,403,540 | 300.73 MB/s |
| brotli24 0.5.2 -11 | 25,743,409 | 187 MB/s |
| bzip2 | 29,008,762 | 21.03 MB/s |
| lz5 2.0 RC2 -49 | 31,688,480 | 581 MB/s |
| Eye-of-the-Lonewolf | 32,806,690 | 502 MB/s |
| lzsse2 17 | 38,0631,86 | 1986.37 MB/s |
--------------------------------------------------------------------------
Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl (106,966,306):
--------------------------------------------------------------------------
| Decompressor | Compressed Size | Decompression Speed |
--------------------------------------------------------------------------
| lzturbo 39 | 10,360,403 | 702.08 MB/s |
| zstd-v1.1.2-win64 -b22 --ultra | 10,719,622 | 639.8 MB/s |
| zstd 1.1.1 -22 | 10,741,011 | 554.02 MB/s |
| bzip2 | 10,941,416 | 31.27 MB/s |
| brotli24 0.5.2 -11 | 11,021,053 | 438 MB/s |
| lz5 2.0 RC2 -49 | 12,599,321 | 1072 MB/s |
| Eye-of-the-Lonewolf | 14,539,303 | 1216 MB/s |
| lzsse2 17 | 17,856,466 | 3478.35 MB/s |
--------------------------------------------------------------------------
the-anarchist-library-2016-01-18-en_html.tar (153,703,936):
--------------------------------------------------------------------------
| Decompressor | Compressed Size | Decompression Speed |
--------------------------------------------------------------------------
| lzturbo 39 | 31,799,880 | 348.20 MB/s |
| zstd-v1.1.2-win64 -b22 --ultra | 31,960,090 | 426.6 MB/s |
| zstd 1.1.1 -22 | 31,962,302 | 264 MB/s |
| brotli24 0.5.2 -11 | 33,325,207 | 233 MB/s |
| bzip2 | 35,346,909 | 22.85 MB/s |
| lz5 2.0 RC2 -49 | 39,384,382 | 669 MB/s |
| Eye-of-the-Lonewolf | 41,732,169 | 603 MB/s |
| lzsse2 17 | 49,079,017 | 2306.00 MB/s |
--------------------------------------------------------------------------
And the console logs:
D:\Textual_Decompression_Showdown_24-files>_BENCH_a_file.BAT The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
D:\Textual_Decompression_Showdown_24-files>Nakamichi_Okamigan_XMM_PREFETCH_4096_Intel_15.0_64bit_SSE41.exe The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.Nakamichi /bench
Nakamichi 'Okamigan/Lonewolfeye', written by Kaze, based on Nobuo Ito's LZSS source, babealicious suggestion by m^2 enforced, muffinesque suggestion by Jim Dempsey enforced.
Note0: It is dedicated to Shintaro Katsu's brother Tomisaburo Wakayama animating 'Okami/Lonewolf'.
Note1: Nakamichi 'Eye-of-the-Lonewolf' is 100% FREE, licenseless that is.
Note2: Conor Stokes' LZSSE2 (FASTEST Textual Decompressor, Level 17) is embedded, all credits along with many thanks go to him.
Note3: 'Okamiko' predecessors are 'Zato', 'Tsubame', 'Tengu-Tsuyo' and 'Tengu'.
Note4: This compile can handle files up to 5120MB.
Note5: The matchfinder/memmem() is 'Railgun_BawBaw_reverse'.
Note6: Instead of '_mm_loadu_si128' '_mm_lddqu_si128' is used.
Note7: The lookahead 'Tsuyo' heuristic which looks one char ahead is applied thrice, still not strengthened, though.
Note8: The compile made 2016-Dec-14, the decompression time measuring is done in 16x8 passes choosing the top score from 64 back-to-back runs - the goal - to enter [maximal] Turbo Mode.
Note9: Please send me (at sanmayce@sanmayce.com) decompression results obtained on machines with fast CPU-RAM subsytems.
Current priority class is REALTIME_PRIORITY_CLASS.
Allocating Source-Buffer 1 MB ...
Allocating Target-Buffer 5,120 MB ...
Decompressing 1,390,843 bytes (being the compressed stream) ...
Warming up ...
RAM-to-RAM performance:
962 MB/s; 965 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 965 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 965 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 962 MB/s
965 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 965 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 965 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 965 MB/s
962 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 965 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 965 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 965 MB/s; 962 MB/s
962 MB/s; 962 MB/s; 962 MB/s; 965 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 965 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 965 MB/s; 962 MB/s; 962 MB/s
962 MB/s; 962 MB/s; 965 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 965 MB/s; 962 MB/s; 962 MB/s; 913 MB/s; 962 MB/s; 962 MB/s; 965 MB/s; 962 MB/s; 962 MB/s
962 MB/s; 962 MB/s; 965 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 965 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 965 MB/s; 962 MB/s; 962 MB/s; 962 MB/s
962 MB/s; 965 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 965 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 965 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 962 MB/s
965 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 965 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 962 MB/s; 965 MB/s; 866 MB/s; 965 MB/s; 962 MB/s; 962 MB/s; 962 MB/s
This CPU seems to be working at 2,394 MHz.
RAM-to-RAM (peak) performance: 965 MB/s.
Source-file-Hash(FNV1A_YoshimitsuTRIAD) = 0x2d0d,650e
Target-file-Hash(FNV1A_YoshimitsuTRIAD) = 0x21cb,d0be
Allocating Source-Buffer 1 MB ...
Allocating Target-Buffer 5,120 MB ...
Decompressing 'The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.L17.LZSSE2' (1,390,894 bytes, being the compressed stream) ...
Warming up ...
RAM-to-RAM performance:
2466 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2444 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2444 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2444 MB/s; 2466 MB/s
2466 MB/s; 2466 MB/s; 2466 MB/s; 2444 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2444 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2444 MB/s; 2466 MB/s; 2466 MB/s
2466 MB/s; 2466 MB/s; 2444 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2444 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2444 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s
2466 MB/s; 2444 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2444 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2444 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s
2444 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2444 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2444 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2444 MB/s
2466 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2444 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2444 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2444 MB/s; 2466 MB/s
2466 MB/s; 2466 MB/s; 2466 MB/s; 2444 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2444 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2444 MB/s; 2466 MB/s; 2466 MB/s
2466 MB/s; 2466 MB/s; 2444 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2444 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s; 2444 MB/s; 2466 MB/s; 2466 MB/s; 2466 MB/s
This CPU seems to be working at 2,394 MHz.
RAM-to-RAM (peak) performance: 2466 MB/s.
D:\Textual_Decompression_Showdown_24-files>lzbench.exe -c4 -ebrotli24,11/tornado,16/blosclz,9/brieflz/crush,2/csc,5/density,3/fastlz,2/gipfeli/zstd,12,22/lzo1b,999/lzham,4/libdeflate,12/lz4hc,16/lz5,19,29,39,49/lzf,1/lzfse/lzg,8/lzham,1/lzjb/lzlib,9/lzma,9/lzrw,5/lzsse2,17/lzsse4,17/lzsse8,17/lzvn/pithy,9/quicklz,3/snappy/slz_zlib,3/ucl_nrv2b,9/ucl_nrv2d,9/ucl_nrv2e,9/xpack,9/xz,9/yalz77,12/yappy,10000/zlib,9/zling,4/shrinker/wflz/lzmat The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzbench 1.5 (64-bit Windows) Assembled by P.Skibinski
Compressor name Compress. Decompress. Compr. size Ratio Filename
memcpy 7511 MB/s 7769 MB/s 4445260 100.00 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
The results sorted by column number 4:
Compressor name Compress. Decompress. Compr. size Ratio Filename
csc 2016-10-13 -5 2.90 MB/s 50 MB/s 1018530 22.91 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzlib 1.7 -9 1.43 MB/s 48 MB/s 1055781 23.75 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
brotli24 0.5.2 -11 0.38 MB/s 298 MB/s 1056498 23.77 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzma 9.38 -9 1.46 MB/s 71 MB/s 1057446 23.79 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
xz 5.2.2 -9 1.46 MB/s 62 MB/s 1057636 23.79 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
zstd 1.1.1 -22 1.67 MB/s 480 MB/s 1074949 24.18 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
tornado 0.6a -16 1.72 MB/s 169 MB/s 1076310 24.21 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzham 1.0 -d26 -4 1.15 MB/s 159 MB/s 1077978 24.25 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzham 1.0 -d26 -1 1.87 MB/s 145 MB/s 1164061 26.19 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
zling 2016-01-10 -4 27 MB/s 131 MB/s 1177552 26.49 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
zstd 1.1.1 -12 6.14 MB/s 505 MB/s 1211792 27.26 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
crush 1.0 -2 0.16 MB/s 258 MB/s 1245176 28.01 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lz5 2.0 RC2 -49 1.71 MB/s 865 MB/s 1246110 28.03 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
xpack 2016-06-02 -9 7.06 MB/s 544 MB/s 1297344 29.18 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
libdeflate 16-08-29 -12 4.52 MB/s 518 MB/s 1318620 29.66 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lz5 2.0 RC2 -39 4.72 MB/s 1304 MB/s 1361566 30.63 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzsse2 2016-05-14 -17 5.36 MB/s 2409 MB/s 1390894 31.29 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
zlib 1.2.8 -9 8.26 MB/s 245 MB/s 1392038 31.32 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzsse4 2016-05-14 -17 6.02 MB/s 2404 MB/s 1398971 31.47 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzfse 2016-08-16 39 MB/s 390 MB/s 1422806 32.01 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzsse8 2016-05-14 -17 5.83 MB/s 2227 MB/s 1423249 32.02 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lz5 2.0 RC2 -29 1.72 MB/s 1379 MB/s 1468773 33.04 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
ucl_nrv2e 1.03 -9 0.66 MB/s 225 MB/s 1494978 33.63 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
ucl_nrv2d 1.03 -9 0.68 MB/s 230 MB/s 1512032 34.01 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzo1b 2.09 -999 6.74 MB/s 500 MB/s 1531566 34.45 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
ucl_nrv2b 1.03 -9 0.74 MB/s 227 MB/s 1542414 34.70 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lz5 2.0 RC2 -19 4.71 MB/s 1966 MB/s 1574995 35.43 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzmat 1.01 14 MB/s 225 MB/s 1592582 35.83 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lz4hc 1.7.3 -16 12 MB/s 1998 MB/s 1598095 35.95 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
brieflz 1.1.0 88 MB/s 123 MB/s 1727013 38.85 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzvn 2016-08-16 34 MB/s 588 MB/s 1786500 40.19 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
quicklz 1.5.0 -3 35 MB/s 556 MB/s 1793134 40.34 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzg 1.0.8 -8 4.61 MB/s 439 MB/s 1811659 40.75 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzrw 15-Jul-1991 -5 94 MB/s 379 MB/s 1834261 41.26 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
gipfeli 2016-07-13 180 MB/s 310 MB/s 1840556 41.40 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
yalz77 2015-09-19 -12 22 MB/s 240 MB/s 1845753 41.52 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
pithy 2011-12-24 -9 224 MB/s 1035 MB/s 1958473 44.06 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
density 0.12.5 beta -3 250 MB/s 216 MB/s 1969082 44.30 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
yappy 2014-03-22 -10000 53 MB/s 1476 MB/s 2054743 46.22 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
shrinker 0.1 225 MB/s 549 MB/s 2185903 49.17 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzf 3.6 -1 192 MB/s 365 MB/s 2209914 49.71 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
fastlz 0.1 -2 196 MB/s 318 MB/s 2240029 50.39 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
slz_zlib 1.0.0 -3 135 MB/s 175 MB/s 2251376 50.65 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
blosclz 2015-11-10 -9 159 MB/s 511 MB/s 2278725 51.26 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
snappy 1.1.3 197 MB/s 656 MB/s 2294833 51.62 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
wflz 2015-09-16 162 MB/s 462 MB/s 2792378 62.82 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
lzjb 2010 150 MB/s 278 MB/s 2891920 65.06 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
D:\Textual_Decompression_Showdown_24-files>call turbobench_singlefile_noNakamichi_2G.bat The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
D:\Textual_Decompression_Showdown_24-files>turbobenchs.exe The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt -ezlib,9/libdeflate,12/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,17/bsc_st,6/shrinker/rans_static16 -g -k0 -J13 -B2G
TurboBench: - Thu Dec 22 15:49:09 2016
C Size ratio% C MB/s D MB/s Name File
765368 17.2 0.32 0.32 zpaq 5 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
868656 19.5 10.21 7.74 bsc_st 6 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
999248 22.5 10.51 22.92 bzip2 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
1056502 23.8 0.38 296.02 brotli 11 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
1057343 23.8 1.43 72.28 lzma 9 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
1075296 24.2 1.70 493.48 zstd 22 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
1079347 24.3 1.32 678.56 lzturbo 39 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
1080189 24.3 1.21 158.27 lzham 4 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
1211796 27.3 5.97 524.89 zstd 12 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
1218124 27.4 1.03 516.71 xpack 9 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
1245180 28.0 0.16 258.96 crush 2 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
1283852 28.9 4.06 63.35 zpaq 2 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
1318630 29.7 4.44 486.25 libdeflate 12 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
1390898 31.3 5.18 2369.54 lzsse2 17 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
1392042 31.3 8.27 244.57 zlib 9 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
1394933 31.4 1.65 598.69 lz5 15 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
1395951 31.4 1.35 851.26 lzturbo 29 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
1574373 35.4 1.60 2650.72 lzturbo 19 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
1598099 36.0 12.74 1859.16 lz4 16 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
1727017 38.9 89.51 157.92 brieflz The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
1969056 44.3 248.05 226.95 density 3 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
2073877 46.7 61.51 1438.60 yappy The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
2185907 49.2 223.26 508.26 shrinker The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
2210547 49.7 191.15 371.80 lzf The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
2240033 50.4 191.13 316.43 fastlz 2 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
2294837 51.6 265.23 697.51 snappy_c The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
2515006 56.6 1041.04 2027.02 chameleon 2 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
2559608 57.6 214.67 404.67 rans_static16 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
4445075 100.0 148.48 1312.84 trle The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
4445264 100.0 6377.70 5461.01 memcpy The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt.tbb
D:\Textual_Decompression_Showdown_24-files>zstd-v1.1.2-win64.exe -b3 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
3#s_Bible_kjv10.txt : 4445260 -> 1392881 (3.191), 115.0 MB/s , 406.9 MB/s
D:\Textual_Decompression_Showdown_24-files>zstd-v1.1.2-win64.exe -b12 The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
12#s_Bible_kjv10.txt : 4445260 -> 1211792 (3.668), 6.4 MB/s , 468.2 MB/s
D:\Textual_Decompression_Showdown_24-files>zstd-v1.1.2-win64.exe -b22 --ultra The_Project_Gutenberg_EBook_of_The_King_James_Bible_kjv10.txt
22#s_Bible_kjv10.txt : 4445260 -> 1074683 (4.136), 1.5 MB/s , 451.9 MB/s
Done. To copy the conslole content into clipboard: 1] Right Click 2] Select All 3] Enter
D:\Textual_Decompression_Showdown_24-files>Nakamichi_Okamigan_XMM_PREFETCH_4096_Intel_15.0_64bit_SSE41.exe enwik8.Nakamichi /bench
Nakamichi 'Okamigan/Lonewolfeye', written by Kaze, based on Nobuo Ito's LZSS source, babealicious suggestion by m^2 enforced, muffinesque suggestion by Jim Dempsey enforced.
Note0: It is dedicated to Shintaro Katsu's brother Tomisaburo Wakayama animating 'Okami/Lonewolf'.
Note1: Nakamichi 'Eye-of-the-Lonewolf' is 100% FREE, licenseless that is.
Note2: Conor Stokes' LZSSE2 (FASTEST Textual Decompressor, Level 17) is embedded, all credits along with many thanks go to him.
Note3: 'Okamiko' predecessors are 'Zato', 'Tsubame', 'Tengu-Tsuyo' and 'Tengu'.
Note4: This compile can handle files up to 5120MB.
Note5: The matchfinder/memmem() is 'Railgun_BawBaw_reverse'.
Note6: Instead of '_mm_loadu_si128' '_mm_lddqu_si128' is used.
Note7: The lookahead 'Tsuyo' heuristic which looks one char ahead is applied thrice, still not strengthened, though.
Note8: The compile made 2016-Dec-14, the decompression time measuring is done in 16x8 passes choosing the top score from 64 back-to-back runs - the goal - to enter [maximal] Turbo Mode.
Note9: Please send me (at sanmayce@sanmayce.com) decompression results obtained on machines with fast CPU-RAM subsytems.
Current priority class is REALTIME_PRIORITY_CLASS.
Allocating Source-Buffer 31 MB ...
Allocating Target-Buffer 5,120 MB ...
Decompressing 32,806,690 bytes (being the compressed stream) ...
Warming up ...
RAM-to-RAM performance:
502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s
502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 500 MB/s; 502 MB/s; 467 MB/s; 467 MB/s; 497 MB/s
502 MB/s; 502 MB/s; 467 MB/s; 467 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 467 MB/s; 467 MB/s; 501 MB/s; 466 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s
502 MB/s; 502 MB/s; 467 MB/s; 467 MB/s; 501 MB/s; 502 MB/s; 502 MB/s; 467 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s
502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 465 MB/s; 467 MB/s; 500 MB/s
499 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s
502 MB/s; 502 MB/s; 502 MB/s; 501 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 501 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s
502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 467 MB/s; 467 MB/s; 500 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 502 MB/s; 464 MB/s; 502 MB/s; 502 MB/s
This CPU seems to be working at 2,394 MHz.
RAM-to-RAM (peak) performance: 502 MB/s.
Source-file-Hash(FNV1A_YoshimitsuTRIAD) = 0x1fba,8e6e
Target-file-Hash(FNV1A_YoshimitsuTRIAD) = 0xd9b6,d17a
Allocating Source-Buffer 36 MB ...
Allocating Target-Buffer 5,120 MB ...
Decompressing 'enwik8.L17.LZSSE2' (38,063,182 bytes, being the compressed stream) ...
Warming up ...
RAM-to-RAM performance:
1917 MB/s; 1946 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1945 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s
1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s
1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s
1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s
1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s
1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s
1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1862 MB/s; 1945 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s
1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s; 1965 MB/s
This CPU seems to be working at 2,394 MHz.
RAM-to-RAM (peak) performance: 1965 MB/s.
D:\Textual_Decompression_Showdown_24-files>lzbench.exe -c4 -ebrotli24,11/tornado,16/blosclz,9/brieflz/crush,2/csc,5/density,3/fastlz,2/gipfeli/zstd,12,22/lzo1b,999/lzham,4/libdeflate,12/lz4hc,16/lz5,19,29,39,49/lzf,1/lzfse/lzg,8/lzham,1/lzjb/lzlib,9/lzma,9/lzrw,5/lzsse2,17/lzsse4,17/lzsse8,17/lzvn/pithy,9/quicklz,3/snappy/slz_zlib,3/ucl_nrv2b,9/ucl_nrv2d,9/ucl_nrv2e,9/xpack,9/xz,9/yalz77,12/yappy,10000/zlib,9/zling,4/shrinker/wflz/lzmat enwik8
lzbench 1.5 (64-bit Windows) Assembled by P.Skibinski
Compressor name Compress. Decompress. Compr. size Ratio Filename
memcpy 6275 MB/s 6152 MB/s 100000000 100.00 enwik8
The results sorted by column number 4:
Compressor name Compress. Decompress. Compr. size Ratio Filename
csc 2016-10-13 -5 2.00 MB/s 47 MB/s 24593395 24.59 enwik8
lzma 9.38 -9 0.89 MB/s 64 MB/s 24861224 24.86 enwik8
xz 5.2.2 -9 0.93 MB/s 58 MB/s 24861357 24.86 enwik8
lzham 1.0 -d26 -4 0.68 MB/s 132 MB/s 25087787 25.09 enwik8
lzlib 1.7 -9 0.91 MB/s 43 MB/s 25152310 25.15 enwik8
zstd 1.1.1 -22 0.93 MB/s 228 MB/s 25382609 25.38 enwik8
brotli24 0.5.2 -11 0.31 MB/s 187 MB/s 25743409 25.74 enwik8
tornado 0.6a -16 1.03 MB/s 131 MB/s 25768761 25.77 enwik8
lzham 1.0 -d26 -1 1.59 MB/s 131 MB/s 29545382 29.55 enwik8
zling 2016-01-10 -4 20 MB/s 110 MB/s 29718662 29.72 enwik8
zstd 1.1.1 -12 5.93 MB/s 416 MB/s 31056439 31.06 enwik8
lz5 2.0 RC2 -49 1.17 MB/s 581 MB/s 31688480 31.69 enwik8
crush 1.0 -2 0.27 MB/s 223 MB/s 31699549 31.70 enwik8
xpack 2016-06-02 -9 9.68 MB/s 446 MB/s 34183028 34.18 enwik8
libdeflate 16-08-29 -12 5.49 MB/s 388 MB/s 35100568 35.10 enwik8
lzfse 2016-08-16 38 MB/s 387 MB/s 36157828 36.16 enwik8
zlib 1.2.8 -9 14 MB/s 213 MB/s 36475792 36.48 enwik8
lz5 2.0 RC2 -29 1.20 MB/s 920 MB/s 36959135 36.96 enwik8
lz5 2.0 RC2 -39 5.41 MB/s 1229 MB/s 37505492 37.51 enwik8
ucl_nrv2e 1.03 -9 1.16 MB/s 197 MB/s 37764198 37.76 enwik8
lzsse2 2016-05-14 -17 6.15 MB/s 1982 MB/s 38063182 38.06 enwik8
ucl_nrv2d 1.03 -9 1.15 MB/s 202 MB/s 38153919 38.15 enwik8
lzsse4 2016-05-14 -17 6.99 MB/s 2063 MB/s 38469822 38.47 enwik8
lzsse8 2016-05-14 -17 6.58 MB/s 1998 MB/s 38716643 38.72 enwik8
ucl_nrv2b 1.03 -9 1.21 MB/s 200 MB/s 38868369 38.87 enwik8
lzo1b 2.09 -999 10 MB/s 422 MB/s 40814011 40.81 enwik8
lzmat 1.01 23 MB/s 204 MB/s 41270839 41.27 enwik8
lz5 2.0 RC2 -19 5.47 MB/s 1891 MB/s 41953190 41.95 enwik8
lz4hc 1.7.3 -16 22 MB/s 1912 MB/s 42196873 42.20 enwik8
brieflz 1.1.0 75 MB/s 116 MB/s 43196165 43.20 enwik8
lzvn 2016-08-16 32 MB/s 575 MB/s 44488288 44.49 enwik8
quicklz 1.5.0 -3 34 MB/s 524 MB/s 44789793 44.79 enwik8
yalz77 2015-09-19 -12 11 MB/s 193 MB/s 44959032 44.96 enwik8
gipfeli 2016-07-13 159 MB/s 253 MB/s 45873643 45.87 enwik8
lzg 1.0.8 -8 4.51 MB/s 361 MB/s 46199002 46.20 enwik8
density 0.12.5 beta -3 214 MB/s 198 MB/s 47818076 47.82 enwik8
lzrw 15-Jul-1991 -5 89 MB/s 312 MB/s 47874203 47.87 enwik8
pithy 2011-12-24 -9 180 MB/s 908 MB/s 49128625 49.13 enwik8
shrinker 0.1 206 MB/s 578 MB/s 51493020 51.49 enwik8
yappy 2014-03-22 -10000 57 MB/s 1455 MB/s 53653533 53.65 enwik8
slz_zlib 1.0.0 -3 132 MB/s 175 MB/s 53689454 53.69 enwik8
lzf 3.6 -1 178 MB/s 352 MB/s 53945381 53.95 enwik8
fastlz 0.1 -2 177 MB/s 315 MB/s 54163013 54.16 enwik8
blosclz 2015-11-10 -9 149 MB/s 492 MB/s 55123815 55.12 enwik8
snappy 1.1.3 198 MB/s 634 MB/s 56539845 56.54 enwik8
wflz 2015-09-16 142 MB/s 506 MB/s 63521814 63.52 enwik8
lzjb 2010 159 MB/s 299 MB/s 68711273 68.71 enwik8
D:\Textual_Decompression_Showdown_24-files>call turbobench_singlefile_noNakamichi_2G.bat enwik8
D:\Textual_Decompression_Showdown_24-files>turbobenchs.exe enwik8 -ezlib,9/libdeflate,12/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,17/bsc_st,6/shrinker/rans_static16 -g -k0 -J13 -B2G
TurboBench: - Thu Dec 22 01:33:12 2016
C Size ratio% C MB/s D MB/s Name File
20596996 20.6 0.30 0.30 zpaq 5 enwik8.tbb
21982088 22.0 8.92 5.33 bsc_st 6 enwik8.tbb
24763998 24.8 0.85 65.03 lzma 9 enwik8.tbb
25021508 25.0 0.71 132.16 lzham 4 enwik8.tbb
25390181 25.4 1.00 230.48 zstd 22 enwik8.tbb
25403540 25.4 0.79 300.73 lzturbo 39 enwik8.tbb
25743413 25.7 0.31 187.37 brotli 11 enwik8.tbb
29008762 29.0 10.30 21.03 bzip2 enwik8.tbb
30520879 30.5 0.46 243.78 xpack 9 enwik8.tbb
31056443 31.1 5.97 427.92 zstd 12 enwik8.tbb
31373273 31.4 0.81 549.43 lzturbo 29 enwik8.tbb
31699553 31.7 0.26 222.32 crush 2 enwik8.tbb
32073935 32.1 2.84 54.67 zpaq 2 enwik8.tbb
34427078 34.4 1.52 398.12 lz5 15 enwik8.tbb
35100578 35.1 5.36 373.63 libdeflate 12 enwik8.tbb
36475796 36.5 14.59 212.78 zlib 9 enwik8.tbb
38063186 38.1 5.97 1986.37 lzsse2 17 enwik8.tbb
41924195 41.9 0.93 2441.76 lzturbo 19 enwik8.tbb
42196877 42.2 23.96 1798.33 lz4 16 enwik8.tbb
43196169 43.2 76.81 152.59 brieflz enwik8.tbb
47817696 47.8 218.37 205.30 density 3 enwik8.tbb
51495146 51.5 205.25 541.35 shrinker enwik8.tbb
53844730 53.8 65.94 1449.59 yappy enwik8.tbb
53915996 53.9 177.99 358.14 lzf enwik8.tbb
54163017 54.2 174.24 311.57 fastlz 2 enwik8.tbb
56539849 56.5 250.94 662.48 snappy_c enwik8.tbb
61528422 61.5 1086.72 1661.68 chameleon 2 enwik8.tbb
63287917 63.3 216.84 398.81 rans_static16 enwik8.tbb
99138398 99.1 147.53 1277.86 trle enwik8.tbb
100000004 100.0 6121.07 5729.67 memcpy enwik8.tbb
D:\Textual_Decompression_Showdown_24-files>zstd-v1.1.2-win64.exe -b3 enwik8
3#enwik8 : 100000000 -> 35687378 (2.802), 103.2 MB/s , 391.3 MB/s
D:\Textual_Decompression_Showdown_24-files>zstd-v1.1.2-win64.exe -b12 enwik8
12#enwik8 : 100000000 -> 31056439 (3.220), 6.3 MB/s , 383.0 MB/s
D:\Textual_Decompression_Showdown_24-files>zstd-v1.1.2-win64.exe -b22 --ultra enwik8
22#enwik8 : 100000000 -> 25380049 (3.940), 1.0 MB/s , 365.9 MB/s
Done. To copy the conslole content into clipboard: 1] Right Click 2] Select All 3] Enter
D:\Textual_Decompression_Showdown_24-files>_BENCH_a_file.BAT "Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl"
D:\Textual_Decompression_Showdown_24-files>Nakamichi_Okamigan_XMM_PREFETCH_4096_Intel_15.0_64bit_SSE41.exe "Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl".Nakamichi /bench
Nakamichi 'Okamigan/Lonewolfeye', written by Kaze, based on Nobuo Ito's LZSS source, babealicious suggestion by m^2 enforced, muffinesque suggestion by Jim Dempsey enforced.
Note0: It is dedicated to Shintaro Katsu's brother Tomisaburo Wakayama animating 'Okami/Lonewolf'.
Note1: Nakamichi 'Eye-of-the-Lonewolf' is 100% FREE, licenseless that is.
Note2: Conor Stokes' LZSSE2 (FASTEST Textual Decompressor, Level 17) is embedded, all credits along with many thanks go to him.
Note3: 'Okamiko' predecessors are 'Zato', 'Tsubame', 'Tengu-Tsuyo' and 'Tengu'.
Note4: This compile can handle files up to 5120MB.
Note5: The matchfinder/memmem() is 'Railgun_BawBaw_reverse'.
Note6: Instead of '_mm_loadu_si128' '_mm_lddqu_si128' is used.
Note7: The lookahead 'Tsuyo' heuristic which looks one char ahead is applied thrice, still not strengthened, though.
Note8: The compile made 2016-Dec-14, the decompression time measuring is done in 16x8 passes choosing the top score from 64 back-to-back runs - the goal - to enter [maximal] Turbo Mode.
Note9: Please send me (at sanmayce@sanmayce.com) decompression results obtained on machines with fast CPU-RAM subsytems.
Current priority class is REALTIME_PRIORITY_CLASS.
Allocating Source-Buffer 13 MB ...
Allocating Target-Buffer 5,120 MB ...
Decompressing 14,539,303 bytes (being the compressed stream) ...
Warming up ...
RAM-to-RAM performance:
1137 MB/s; 1209 MB/s; 1098 MB/s; 1134 MB/s; 1134 MB/s; 1134 MB/s; 1134 MB/s; 1137 MB/s; 1133 MB/s; 1133 MB/s; 1137 MB/s; 1137 MB/s; 1092 MB/s; 1137 MB/s; 1137 MB/s; 1137 MB/s
1137 MB/s; 1137 MB/s; 1212 MB/s; 1137 MB/s; 1137 MB/s; 1137 MB/s; 1118 MB/s; 1109 MB/s; 1137 MB/s; 1168 MB/s; 1137 MB/s; 1137 MB/s; 1137 MB/s; 1137 MB/s; 1137 MB/s; 1137 MB/s
1137 MB/s; 1092 MB/s; 1137 MB/s; 1134 MB/s; 1137 MB/s; 1137 MB/s; 1137 MB/s; 1137 MB/s; 1137 MB/s; 1202 MB/s; 1137 MB/s; 1106 MB/s; 1118 MB/s; 1137 MB/s; 1133 MB/s; 1137 MB/s
1137 MB/s; 1212 MB/s; 1216 MB/s; 1216 MB/s; 1137 MB/s; 1212 MB/s; 1092 MB/s; 1137 MB/s; 1137 MB/s; 1134 MB/s; 1137 MB/s; 1137 MB/s; 1137 MB/s; 1133 MB/s; 1216 MB/s; 1155 MB/s
1112 MB/s; 1133 MB/s; 1212 MB/s; 1137 MB/s; 1212 MB/s; 1137 MB/s; 1137 MB/s; 1137 MB/s; 1216 MB/s; 1137 MB/s; 1212 MB/s; 1092 MB/s; 1137 MB/s; 1134 MB/s; 1137 MB/s; 1134 MB/s
1137 MB/s; 1133 MB/s; 1133 MB/s; 1216 MB/s; 1212 MB/s; 1124 MB/s; 1212 MB/s; 1137 MB/s; 1134 MB/s; 1134 MB/s; 1134 MB/s; 1212 MB/s; 1137 MB/s; 1137 MB/s; 1133 MB/s; 1137 MB/s
1095 MB/s; 1212 MB/s; 1137 MB/s; 1195 MB/s; 1137 MB/s; 1133 MB/s; 1137 MB/s; 1205 MB/s; 1137 MB/s; 1134 MB/s; 1127 MB/s; 1098 MB/s; 1137 MB/s; 1137 MB/s; 1134 MB/s; 1134 MB/s
1134 MB/s; 1137 MB/s; 1137 MB/s; 1134 MB/s; 1134 MB/s; 1092 MB/s; 1212 MB/s; 1137 MB/s; 1202 MB/s; 1137 MB/s; 1133 MB/s; 1133 MB/s; 1133 MB/s; 1133 MB/s; 1137 MB/s; 1118 MB/s
This CPU seems to be working at 2,394 MHz.
RAM-to-RAM (peak) performance: 1216 MB/s.
Source-file-Hash(FNV1A_YoshimitsuTRIAD) = 0x10d1,87b1
Target-file-Hash(FNV1A_YoshimitsuTRIAD) = 0xdb08,8fac
Allocating Source-Buffer 17 MB ...
Allocating Target-Buffer 5,120 MB ...
Decompressing 'Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.L17.LZSSE2' (17,856,462 bytes, being the compressed stream) ...
Warming up ...
RAM-to-RAM performance:
3456 MB/s; 3456 MB/s; 3458 MB/s; 3458 MB/s; 3456 MB/s; 3456 MB/s; 3456 MB/s; 3458 MB/s; 3458 MB/s; 3456 MB/s; 3456 MB/s; 3456 MB/s; 3458 MB/s; 3458 MB/s; 3456 MB/s; 3456 MB/s
3456 MB/s; 3458 MB/s; 3456 MB/s; 3456 MB/s; 3456 MB/s; 3458 MB/s; 3458 MB/s; 3456 MB/s; 3456 MB/s; 3456 MB/s; 3374 MB/s; 3458 MB/s; 3320 MB/s; 3456 MB/s; 3456 MB/s; 3456 MB/s
3458 MB/s; 3458 MB/s; 3456 MB/s; 3456 MB/s; 3456 MB/s; 3458 MB/s; 3458 MB/s; 3456 MB/s; 3456 MB/s; 3456 MB/s; 3458 MB/s; 3458 MB/s; 3456 MB/s; 3456 MB/s; 3456 MB/s; 3458 MB/s
3458 MB/s; 3456 MB/s; 3456 MB/s; 3456 MB/s; 3458 MB/s; 3458 MB/s; 3456 MB/s; 3456 MB/s; 3456 MB/s; 3458 MB/s; 3428 MB/s; 3293 MB/s; 3427 MB/s; 3456 MB/s; 3456 MB/s; 3458 MB/s
3458 MB/s; 3456 MB/s; 3456 MB/s; 3456 MB/s; 3458 MB/s; 3458 MB/s; 3456 MB/s; 3456 MB/s; 3456 MB/s; 3458 MB/s; 3458 MB/s; 3456 MB/s; 3456 MB/s; 3456 MB/s; 3458 MB/s; 3456 MB/s
3456 MB/s; 3456 MB/s; 3458 MB/s; 3458 MB/s; 3456 MB/s; 3456 MB/s; 3456 MB/s; 3458 MB/s; 3458 MB/s; 3346 MB/s; 3293 MB/s; 3319 MB/s; 3458 MB/s; 3458 MB/s; 3456 MB/s; 3456 MB/s
3456 MB/s; 3458 MB/s; 3458 MB/s; 3456 MB/s; 3456 MB/s; 3456 MB/s; 3458 MB/s; 3458 MB/s; 3456 MB/s; 3456 MB/s; 3456 MB/s; 3458 MB/s; 3458 MB/s; 3456 MB/s; 3456 MB/s; 3456 MB/s
3458 MB/s; 3458 MB/s; 3456 MB/s; 3456 MB/s; 3456 MB/s; 3458 MB/s; 3458 MB/s; 3456 MB/s; 3456 MB/s; 3217 MB/s; 3293 MB/s; 3293 MB/s; 3320 MB/s; 3458 MB/s; 3456 MB/s; 3400 MB/s
This CPU seems to be working at 2,394 MHz.
RAM-to-RAM (peak) performance: 3458 MB/s.
D:\Textual_Decompression_Showdown_24-files>lzbench.exe -c4 -ebrotli24,11/tornado,16/blosclz,9/brieflz/crush,2/csc,5/density,3/fastlz,2/gipfeli/zstd,12,22/lzo1b,999/lzham,4/libdeflate,12/lz4hc,16/lz5,19,29,39,49/lzf,1/lzfse/lzg,8/lzham,1/lzjb/lzlib,9/lzma,9/lzrw,5/lzsse2,17/lzsse4,17/lzsse8,17/lzvn/pithy,9/quicklz,3/snappy/slz_zlib,3/ucl_nrv2b,9/ucl_nrv2d,9/ucl_nrv2e,9/xpack,9/xz,9/yalz77,12/yappy,10000/zlib,9/zling,4/shrinker/wflz/lzmat "Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl"
lzbench 1.5 (64-bit Windows) Assembled by P.Skibinski
Compressor name Compress. Decompress. Compr. size Ratio Filename
memcpy 6418 MB/s 6425 MB/s 106966306 100.00 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
The results sorted by column number 4:
Compressor name Compress. Decompress. Compr. size Ratio Filename
lzlib 1.7 -9 0.94 MB/s 90 MB/s 9986374 9.34 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
xz 5.2.2 -9 1.46 MB/s 138 MB/s 10501150 9.82 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
lzma 9.38 -9 1.32 MB/s 151 MB/s 10501368 9.82 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
lzham 1.0 -d26 -4 0.80 MB/s 314 MB/s 10669572 9.97 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
zstd 1.1.1 -22 1.06 MB/s 520 MB/s 10725354 10.03 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
tornado 0.6a -16 1.03 MB/s 291 MB/s 10909602 10.20 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
brotli24 0.5.2 -11 0.37 MB/s 438 MB/s 11021053 10.30 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
csc 2016-10-13 -5 1.89 MB/s 133 MB/s 11773656 11.01 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
lz5 2.0 RC2 -49 0.95 MB/s 1072 MB/s 12599321 11.78 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
lzham 1.0 -d26 -1 2.38 MB/s 260 MB/s 14066165 13.15 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
zstd 1.1.1 -12 13 MB/s 797 MB/s 14642979 13.69 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
lz5 2.0 RC2 -29 0.96 MB/s 1428 MB/s 14798364 13.83 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
crush 1.0 -2 0.10 MB/s 464 MB/s 14930811 13.96 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
zling 2016-01-10 -4 46 MB/s 256 MB/s 15401557 14.40 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
xpack 2016-06-02 -9 8.85 MB/s 723 MB/s 15425113 14.42 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
libdeflate 16-08-29 -12 2.80 MB/s 953 MB/s 16245023 15.19 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
lz5 2.0 RC2 -39 2.83 MB/s 1757 MB/s 16614577 15.53 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
zlib 1.2.8 -9 4.11 MB/s 381 MB/s 17592519 16.45 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
lzsse2 2016-05-14 -17 3.62 MB/s 3478 MB/s 17856462 16.69 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
lzsse4 2016-05-14 -17 4.11 MB/s 3417 MB/s 17951450 16.78 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
ucl_nrv2e 1.03 -9 0.77 MB/s 364 MB/s 18418390 17.22 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
lzsse8 2016-05-14 -17 4.06 MB/s 3101 MB/s 18506275 17.30 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
ucl_nrv2d 1.03 -9 0.78 MB/s 383 MB/s 18709175 17.49 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
ucl_nrv2b 1.03 -9 0.82 MB/s 381 MB/s 19020592 17.78 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
lz5 2.0 RC2 -19 2.78 MB/s 2394 MB/s 19512429 18.24 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
lzo1b 2.09 -999 12 MB/s 962 MB/s 19518561 18.25 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
lz4hc 1.7.3 -16 10 MB/s 2208 MB/s 19954076 18.65 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
lzfse 2016-08-16 53 MB/s 558 MB/s 20238156 18.92 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
lzmat 1.01 28 MB/s 328 MB/s 20754433 19.40 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
yalz77 2015-09-19 -12 34 MB/s 390 MB/s 22816575 21.33 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
lzg 1.0.8 -8 6.92 MB/s 685 MB/s 23284779 21.77 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
quicklz 1.5.0 -3 57 MB/s 843 MB/s 24588423 22.99 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
yappy 2014-03-22 -10000 57 MB/s 2141 MB/s 25707958 24.03 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
lzrw 15-Jul-1991 -5 154 MB/s 605 MB/s 26359072 24.64 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
lzvn 2016-08-16 48 MB/s 758 MB/s 26477554 24.75 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
brieflz 1.1.0 143 MB/s 166 MB/s 28795662 26.92 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
gipfeli 2016-07-13 280 MB/s 480 MB/s 30041385 28.08 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
density 0.12.5 beta -3 313 MB/s 265 MB/s 31789908 29.72 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
pithy 2011-12-24 -9 338 MB/s 1237 MB/s 32027474 29.94 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
lzf 3.6 -1 346 MB/s 597 MB/s 32841102 30.70 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
fastlz 0.1 -2 342 MB/s 526 MB/s 33213336 31.05 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
blosclz 2015-11-10 -9 290 MB/s 731 MB/s 34144289 31.92 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
snappy 1.1.3 315 MB/s 848 MB/s 35078748 32.79 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
slz_zlib 1.0.0 -3 200 MB/s 236 MB/s 36438149 34.07 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
shrinker 0.1 377 MB/s 674 MB/s 38401054 35.90 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
wflz 2015-09-16 345 MB/s 748 MB/s 45413902 42.46 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
lzjb 2010 241 MB/s 413 MB/s 47017328 43.96 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl
D:\Textual_Decompression_Showdown_24-files>call turbobench_singlefile_noNakamichi_2G.bat "Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl"
D:\Textual_Decompression_Showdown_24-files>turbobenchs.exe "Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl" -ezlib,9/libdeflate,12/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,17/bsc_st,6/shrinker/rans_static16 -g -k0 -J13 -B2G
TurboBench: - Thu Dec 22 03:46:47 2016
C Size ratio% C MB/s D MB/s Name File
8734441 8.2 0.38 0.37 zpaq 5 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
9805894 9.2 0.92 161.82 lzma 9 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
10360403 9.7 0.75 702.08 lzturbo 39 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
10602655 9.9 0.84 315.92 lzham 4 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
10654564 10.0 19.00 11.56 bsc_st 6 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
10741011 10.0 1.10 554.02 zstd 22 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
10941416 10.2 7.15 31.27 bzip2 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
11021057 10.3 0.38 456.52 brotli 11 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
13722026 12.8 0.82 1190.64 lzturbo 29 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
14150908 13.2 3.80 87.95 zpaq 2 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
14281197 13.4 2.33 676.22 xpack 9 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
14642983 13.7 14.10 834.37 zstd 12 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
14930815 14.0 0.10 472.10 crush 2 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
15352707 14.4 1.19 919.17 lz5 15 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
16245033 15.2 2.80 849.67 libdeflate 12 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
17592523 16.4 4.25 381.40 zlib 9 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
17856466 16.7 3.59 3478.35 lzsse2 17 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
19475694 18.2 0.98 3037.09 lzturbo 19 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
19954080 18.7 11.21 2049.75 lz4 16 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
26471353 24.7 80.15 2033.85 yappy Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
28795666 26.9 142.69 217.05 brieflz Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
31789504 29.7 328.31 278.48 density 3 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
32882230 30.7 348.06 599.17 lzf Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
33213340 31.1 338.21 507.78 fastlz 2 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
35078752 32.8 408.44 938.79 snappy_c Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
38401541 35.9 371.97 639.67 shrinker Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
47411373 44.3 266.11 404.89 rans_static16 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
56839043 53.1 1200.33 3262.26 chameleon 2 Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
106966310 100.0 146.73 5909.09 trle Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
106966310 100.0 6358.72 5894.43 memcpy Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl.tbb
D:\Textual_Decompression_Showdown_24-files>zstd-v1.1.2-win64.exe -b3 "Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl"
3#onary_(En-En).dsl : 106966306 -> 19209357 (5.568), 224.0 MB/s , 592.4 MB/s
D:\Textual_Decompression_Showdown_24-files>zstd-v1.1.2-win64.exe -b12 "Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl"
12#onary_(En-En).dsl : 106966306 -> 14642979 (7.305), 14.0 MB/s , 765.7 MB/s
D:\Textual_Decompression_Showdown_24-files>zstd-v1.1.2-win64.exe -b22 --ultra "Random_House_Webster's_Unabridged_Dictionary_(En-En).dsl"
22#onary_(En-En).dsl : 106966306 -> 10719622 (9.979), 1.1 MB/s , 639.8 MB/s
Done. To copy the conslole content into clipboard: 1] Right Click 2] Select All 3] Enter
D:\Textual_Decompression_Showdown_24-files>Nakamichi_Okamigan_XMM_PREFETCH_4096_Intel_15.0_64bit_SSE41.exe the-anarchist-library-2016-01-18-en_html.tar.Nakamichi /bench
Nakamichi 'Okamigan/Lonewolfeye', written by Kaze, based on Nobuo Ito's LZSS source, babealicious suggestion by m^2 enforced, muffinesque suggestion by Jim Dempsey enforced.
Note0: It is dedicated to Shintaro Katsu's brother Tomisaburo Wakayama animating 'Okami/Lonewolf'.
Note1: Nakamichi 'Eye-of-the-Lonewolf' is 100% FREE, licenseless that is.
Note2: Conor Stokes' LZSSE2 (FASTEST Textual Decompressor, Level 17) is embedded, all credits along with many thanks go to him.
Note3: 'Okamiko' predecessors are 'Zato', 'Tsubame', 'Tengu-Tsuyo' and 'Tengu'.
Note4: This compile can handle files up to 5120MB.
Note5: The matchfinder/memmem() is 'Railgun_BawBaw_reverse'.
Note6: Instead of '_mm_loadu_si128' '_mm_lddqu_si128' is used.
Note7: The lookahead 'Tsuyo' heuristic which looks one char ahead is applied thrice, still not strengthened, though.
Note8: The compile made 2016-Dec-14, the decompression time measuring is done in 16x8 passes choosing the top score from 64 back-to-back runs - the goal - to enter [maximal] Turbo Mode.
Note9: Please send me (at sanmayce@sanmayce.com) decompression results obtained on machines with fast CPU-RAM subsytems.
Current priority class is REALTIME_PRIORITY_CLASS.
Allocating Source-Buffer 39 MB ...
Allocating Target-Buffer 5,120 MB ...
Decompressing 41,732,169 bytes (being the compressed stream) ...
Warming up ...
RAM-to-RAM performance:
601 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 601 MB/s; 602 MB/s; 602 MB/s; 574 MB/s; 602 MB/s
603 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 601 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 603 MB/s; 602 MB/s; 602 MB/s
602 MB/s; 603 MB/s; 597 MB/s; 603 MB/s; 602 MB/s; 603 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s
602 MB/s; 602 MB/s; 601 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 603 MB/s; 603 MB/s; 603 MB/s; 602 MB/s; 603 MB/s; 602 MB/s
602 MB/s; 602 MB/s; 603 MB/s; 603 MB/s; 602 MB/s; 601 MB/s; 602 MB/s; 602 MB/s; 597 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 603 MB/s; 602 MB/s; 603 MB/s; 602 MB/s
602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 603 MB/s; 602 MB/s; 592 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 602 MB/s
601 MB/s; 602 MB/s; 602 MB/s; 603 MB/s; 602 MB/s; 603 MB/s; 603 MB/s; 602 MB/s; 602 MB/s; 603 MB/s; 602 MB/s; 602 MB/s; 603 MB/s; 603 MB/s; 603 MB/s; 597 MB/s
603 MB/s; 603 MB/s; 602 MB/s; 602 MB/s; 603 MB/s; 603 MB/s; 603 MB/s; 602 MB/s; 603 MB/s; 602 MB/s; 602 MB/s; 602 MB/s; 603 MB/s; 602 MB/s; 603 MB/s; 602 MB/s
This CPU seems to be working at 2,394 MHz.
RAM-to-RAM (peak) performance: 603 MB/s.
Source-file-Hash(FNV1A_YoshimitsuTRIAD) = 0xb748,fa52
Target-file-Hash(FNV1A_YoshimitsuTRIAD) = 0x9356,818e
Allocating Source-Buffer 46 MB ...
Allocating Target-Buffer 5,120 MB ...
Decompressing 'the-anarchist-library-2016-01-18-en_html.tar.L17.LZSSE2' (49,079,013 bytes, being the compressed stream) ...
Warming up ...
RAM-to-RAM performance:
2294 MB/s; 2277 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2268 MB/s; 2294 MB/s; 2286 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s
2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2285 MB/s; 2260 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s
2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2286 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s
2294 MB/s; 2294 MB/s; 2294 MB/s; 2285 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s
2294 MB/s; 2285 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2226 MB/s
2285 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2285 MB/s; 2286 MB/s
2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2286 MB/s; 2294 MB/s; 2294 MB/s
2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s; 2285 MB/s; 2294 MB/s; 2294 MB/s; 2294 MB/s
This CPU seems to be working at 2,394 MHz.
RAM-to-RAM (peak) performance: 2294 MB/s.
D:\Textual_Decompression_Showdown_24-files>lzbench.exe -c4 -ebrotli24,11/tornado,16/blosclz,9/brieflz/crush,2/csc,5/density,3/fastlz,2/gipfeli/zstd,12,22/lzo1b,999/lzham,4/libdeflate,12/lz4hc,16/lz5,19,29,39,49/lzf,1/lzfse/lzg,8/lzham,1/lzjb/lzlib,9/lzma,9/lzrw,5/lzsse2,17/lzsse4,17/lzsse8,17/lzvn/pithy,9/quicklz,3/snappy/slz_zlib,3/ucl_nrv2b,9/ucl_nrv2d,9/ucl_nrv2e,9/xpack,9/xz,9/yalz77,12/yappy,10000/zlib,9/zling,4/shrinker/wflz/lzmat the-anarchist-library-2016-01-18-en_html.tar
lzbench 1.5 (64-bit Windows) Assembled by P.Skibinski
Compressor name Compress. Decompress. Compr. size Ratio Filename
memcpy 6355 MB/s 6232 MB/s 153703936 100.00 the-anarchist-library-2016-01-18-en_html.tar
The results sorted by column number 4:
Compressor name Compress. Decompress. Compr. size Ratio Filename
csc 2016-10-13 -5 2.02 MB/s 56 MB/s 31600820 20.56 the-anarchist-library-2016-01-18-en_html.tar
zstd 1.1.1 -22 0.90 MB/s 264 MB/s 31962302 20.79 the-anarchist-library-2016-01-18-en_html.tar
xz 5.2.2 -9 0.98 MB/s 73 MB/s 31970806 20.80 the-anarchist-library-2016-01-18-en_html.tar
lzma 9.38 -9 0.93 MB/s 80 MB/s 31971012 20.80 the-anarchist-library-2016-01-18-en_html.tar
lzham 1.0 -d26 -4 0.70 MB/s 158 MB/s 32140431 20.91 the-anarchist-library-2016-01-18-en_html.tar
lzlib 1.7 -9 0.92 MB/s 51 MB/s 32406832 21.08 the-anarchist-library-2016-01-18-en_html.tar
tornado 0.6a -16 0.93 MB/s 156 MB/s 32549152 21.18 the-anarchist-library-2016-01-18-en_html.tar
brotli24 0.5.2 -11 0.35 MB/s 233 MB/s 33325207 21.68 the-anarchist-library-2016-01-18-en_html.tar
zling 2016-01-10 -4 28 MB/s 144 MB/s 38209723 24.86 the-anarchist-library-2016-01-18-en_html.tar
lzham 1.0 -d26 -1 1.76 MB/s 156 MB/s 38280377 24.91 the-anarchist-library-2016-01-18-en_html.tar
lz5 2.0 RC2 -49 1.02 MB/s 669 MB/s 39384382 25.62 the-anarchist-library-2016-01-18-en_html.tar
zstd 1.1.1 -12 5.86 MB/s 509 MB/s 39900793 25.96 the-anarchist-library-2016-01-18-en_html.tar
crush 1.0 -2 0.20 MB/s 276 MB/s 41025173 26.69 the-anarchist-library-2016-01-18-en_html.tar
xpack 2016-06-02 -9 8.37 MB/s 548 MB/s 44393264 28.88 the-anarchist-library-2016-01-18-en_html.tar
libdeflate 16-08-29 -12 4.97 MB/s 473 MB/s 46894308 30.51 the-anarchist-library-2016-01-18-en_html.tar
lz5 2.0 RC2 -29 1.04 MB/s 1049 MB/s 47091588 30.64 the-anarchist-library-2016-01-18-en_html.tar
lz5 2.0 RC2 -39 3.45 MB/s 1341 MB/s 47571029 30.95 the-anarchist-library-2016-01-18-en_html.tar
lzfse 2016-08-16 40 MB/s 423 MB/s 47804940 31.10 the-anarchist-library-2016-01-18-en_html.tar
lzsse2 2016-05-14 -17 2.82 MB/s 2306 MB/s 49079013 31.93 the-anarchist-library-2016-01-18-en_html.tar
zlib 1.2.8 -9 12 MB/s 242 MB/s 49174534 31.99 the-anarchist-library-2016-01-18-en_html.tar
lzsse4 2016-05-14 -17 3.06 MB/s 2328 MB/s 49410765 32.15 the-anarchist-library-2016-01-18-en_html.tar
lzsse8 2016-05-14 -17 2.81 MB/s 2204 MB/s 50005916 32.53 the-anarchist-library-2016-01-18-en_html.tar
ucl_nrv2e 1.03 -9 0.94 MB/s 229 MB/s 50444534 32.82 the-anarchist-library-2016-01-18-en_html.tar
ucl_nrv2d 1.03 -9 0.96 MB/s 234 MB/s 51054403 33.22 the-anarchist-library-2016-01-18-en_html.tar
ucl_nrv2b 1.03 -9 1.02 MB/s 231 MB/s 52192632 33.96 the-anarchist-library-2016-01-18-en_html.tar
lzo1b 2.09 -999 9.68 MB/s 495 MB/s 53373125 34.72 the-anarchist-library-2016-01-18-en_html.tar
lz5 2.0 RC2 -19 3.47 MB/s 2045 MB/s 54892740 35.71 the-anarchist-library-2016-01-18-en_html.tar
lz4hc 1.7.3 -16 17 MB/s 2108 MB/s 55257529 35.95 the-anarchist-library-2016-01-18-en_html.tar
lzmat 1.01 20 MB/s 228 MB/s 55278460 35.96 the-anarchist-library-2016-01-18-en_html.tar
yalz77 2015-09-19 -12 15 MB/s 220 MB/s 57469314 37.39 the-anarchist-library-2016-01-18-en_html.tar
brieflz 1.1.0 87 MB/s 125 MB/s 57801919 37.61 the-anarchist-library-2016-01-18-en_html.tar
lzg 1.0.8 -8 4.58 MB/s 432 MB/s 61669052 40.12 the-anarchist-library-2016-01-18-en_html.tar
quicklz 1.5.0 -3 35 MB/s 597 MB/s 62128153 40.42 the-anarchist-library-2016-01-18-en_html.tar
lzvn 2016-08-16 34 MB/s 620 MB/s 62169348 40.45 the-anarchist-library-2016-01-18-en_html.tar
density 0.12.5 beta -3 265 MB/s 234 MB/s 63067570 41.03 the-anarchist-library-2016-01-18-en_html.tar
gipfeli 2016-07-13 175 MB/s 311 MB/s 63268615 41.16 the-anarchist-library-2016-01-18-en_html.tar
pithy 2011-12-24 -9 220 MB/s 1069 MB/s 65772901 42.79 the-anarchist-library-2016-01-18-en_html.tar
lzrw 15-Jul-1991 -5 92 MB/s 356 MB/s 66374065 43.18 the-anarchist-library-2016-01-18-en_html.tar
fastlz 0.1 -2 202 MB/s 344 MB/s 75968652 49.43 the-anarchist-library-2016-01-18-en_html.tar
slz_zlib 1.0.0 -3 136 MB/s 181 MB/s 77624049 50.50 the-anarchist-library-2016-01-18-en_html.tar
yappy 2014-03-22 -10000 59 MB/s 1439 MB/s 77775276 50.60 the-anarchist-library-2016-01-18-en_html.tar
lzf 3.6 -1 192 MB/s 369 MB/s 78573147 51.12 the-anarchist-library-2016-01-18-en_html.tar
blosclz 2015-11-10 -9 165 MB/s 529 MB/s 78593542 51.13 the-anarchist-library-2016-01-18-en_html.tar
snappy 1.1.3 206 MB/s 660 MB/s 80769657 52.55 the-anarchist-library-2016-01-18-en_html.tar
wflz 2015-09-16 164 MB/s 515 MB/s 90736727 59.03 the-anarchist-library-2016-01-18-en_html.tar
lzjb 2010 148 MB/s 294 MB/s 104500610 67.99 the-anarchist-library-2016-01-18-en_html.tar
shrinker 0.1 1464 MB/s 2851 MB/s 143780839 93.54 the-anarchist-library-2016-01-18-en_html.tar
D:\Textual_Decompression_Showdown_24-files>call turbobench_singlefile_noNakamichi_2G.bat the-anarchist-library-2016-01-18-en_html.tar
D:\Textual_Decompression_Showdown_24-files>turbobenchs.exe the-anarchist-library-2016-01-18-en_html.tar -ezlib,9/libdeflate,12/xpack,9/fastlz,2/lzturbo,19,29,39/bzip2/chameleon,2/snappy_c/zstd,12,22/density,3/lz4,16/lz5,15/lzham,4/brieflz/brotli,11/crush,2/lzma,9/zpaq,2,5/lzf/yappy/trle/memcpy/lzsse2,17/bsc_st,6/shrinker/rans_static16 -g -k0 -J13 -B2G
TurboBench: - Wed Dec 21 22:50:10 2016
C Size ratio% C MB/s D MB/s Name File
25835175 16.8 0.31 0.31 zpaq 5 the-anarchist-library-2016-01-18-en_html.tar.tbb
27232340 17.7 10.77 5.75 bsc_st 6 the-anarchist-library-2016-01-18-en_html.tar.tbb
31423875 20.4 0.83 82.41 lzma 9 the-anarchist-library-2016-01-18-en_html.tar.tbb
31705868 20.6 0.70 161.81 lzham 4 the-anarchist-library-2016-01-18-en_html.tar.tbb
31799880 20.7 0.73 348.20 lzturbo 39 the-anarchist-library-2016-01-18-en_html.tar.tbb
31966739 20.8 0.95 266.20 zstd 22 the-anarchist-library-2016-01-18-en_html.tar.tbb
33325211 21.7 0.36 246.16 brotli 11 the-anarchist-library-2016-01-18-en_html.tar.tbb
35346909 23.0 9.69 22.85 bzip2 the-anarchist-library-2016-01-18-en_html.tar.tbb
39424368 25.6 0.56 318.99 xpack 9 the-anarchist-library-2016-01-18-en_html.tar.tbb
39900797 26.0 6.16 525.36 zstd 12 the-anarchist-library-2016-01-18-en_html.tar.tbb
41025177 26.7 0.20 275.73 crush 2 the-anarchist-library-2016-01-18-en_html.tar.tbb
41203245 26.8 0.75 610.94 lzturbo 29 the-anarchist-library-2016-01-18-en_html.tar.tbb
41418015 26.9 3.25 61.50 zpaq 2 the-anarchist-library-2016-01-18-en_html.tar.tbb
45390283 29.5 1.30 478.41 lz5 15 the-anarchist-library-2016-01-18-en_html.tar.tbb
46894318 30.5 4.94 452.98 libdeflate 12 the-anarchist-library-2016-01-18-en_html.tar.tbb
49079017 31.9 2.79 2306.00 lzsse2 17 the-anarchist-library-2016-01-18-en_html.tar.tbb
49174538 32.0 12.53 241.18 zlib 9 the-anarchist-library-2016-01-18-en_html.tar.tbb
54853124 35.7 0.84 2752.08 lzturbo 19 the-anarchist-library-2016-01-18-en_html.tar.tbb
55257533 36.0 18.26 1975.38 lz4 16 the-anarchist-library-2016-01-18-en_html.tar.tbb
57801923 37.6 88.82 167.89 brieflz the-anarchist-library-2016-01-18-en_html.tar.tbb
63067218 41.0 269.06 242.65 density 3 the-anarchist-library-2016-01-18-en_html.tar.tbb
73161093 47.6 235.84 562.59 shrinker the-anarchist-library-2016-01-18-en_html.tar.tbb
75968656 49.4 194.13 343.94 fastlz 2 the-anarchist-library-2016-01-18-en_html.tar.tbb
78378420 51.0 66.45 1424.60 yappy the-anarchist-library-2016-01-18-en_html.tar.tbb
78633200 51.2 192.41 376.29 lzf the-anarchist-library-2016-01-18-en_html.tar.tbb
80769661 52.5 269.52 712.28 snappy_c the-anarchist-library-2016-01-18-en_html.tar.tbb
87231182 56.8 1066.40 1984.25 chameleon 2 the-anarchist-library-2016-01-18-en_html.tar.tbb
90668672 59.0 215.78 402.88 rans_static16 the-anarchist-library-2016-01-18-en_html.tar.tbb
149809492 97.5 145.29 1328.30 trle the-anarchist-library-2016-01-18-en_html.tar.tbb
153703940 100.0 6457.06 5677.81 memcpy the-anarchist-library-2016-01-18-en_html.tar.tbb
D:\Textual_Decompression_Showdown_24-files>zstd-v1.1.2-win64.exe -b3 the-anarchist-library-2016-01-18-en_html.tar
3#01-18-en_html.tar : 153703936 -> 46007864 (3.341), 119.5 MB/s , 431.4 MB/s
D:\Textual_Decompression_Showdown_24-files>zstd-v1.1.2-win64.exe -b12 the-anarchist-library-2016-01-18-en_html.tar
12#01-18-en_html.tar : 153703936 -> 39900793 (3.852), 5.8 MB/s , 465.9 MB/s
D:\Textual_Decompression_Showdown_24-files>zstd-v1.1.2-win64.exe -b22 --ultra the-anarchist-library-2016-01-18-en_html.tar
22#01-18-en_html.tar : 153703936 -> 31960090 (4.809), 0.9 MB/s , 426.6 MB/s
Done. To copy the conslole content into clipboard: 1] Right Click 2] Select All 3] Enter
Does the v1.1.2 show such superb speeds on CPUs higher than the used i5-2430M?
Yes, the new fast decompression mode is only useful for large files at --ultra
compression setting.
Thing is, the default decompression algorithm works better when window size is "small".
The limit between the 2 modes is 8 MB.
Just wanted to share the log for testfiles where Zstd v0.6.0 -22 --ultra outperforms LzTurbo v1.3 39:
The test was done on i5-2430M 3GHz. Very good indeed. On top of that I see Zstd compresses faster, however, as I see it, LzTurbo still reigns in compression ratio (mostly) and decompression rate departments.