ThomasKaiser / sbc-bench

Simple benchmark for single board computers
BSD 3-Clause "New" or "Revised" License
675 stars 78 forks source link

Results depend on 7z version #81

Closed devizer closed 1 year ago

devizer commented 1 year ago

What the version is used for https://github.com/ThomasKaiser/sbc-bench/blob/master/Results.md?

The latest version of 7z is 1.5x faster than 16.02

ThomasKaiser commented 1 year ago

What the version is used for https://github.com/ThomasKaiser/sbc-bench/blob/master/Results.md?

You can check by yourself since all the detailed results listings are included in https://github.com/ThomasKaiser/sbc-bench/blob/master/results/results.tar.xz

The latest version of 7z is 1.5x faster than 16.02

That depends on the platform/ISA since on some nothing has changed.

But 'fortunately' the p7zip package in Debian/Ubuntu is unmaintained since ages and as such up until now all the submitted results are from 16.02 with 4 exceptions relying on 9.20 (submissions with more recent versions aren't included by me in Results.md for the obvious reason you brought up here).

for file in *.txt ; do grep '^p7zip Version' "${file}" | head -n1 | awk -F" " '{print $3}' ; done | sort | uniq -c
 265 16.02
   4 9.20

Also if you check README.md I also double checked that same 16.02 p7zip version built with different compilers/libs does not end up with different performance which is one of the reasons 7-zip MIPS are sbc-bench's main score since it allows numbers generated in different years (as in 'different OS, different compilers, different libs') to be comparable. With Phoronix for example this is an entirely different thing.