search

hanabi1224 / Programming-Language-Benchmarks

Yet another implementation of computer language benchmarks game
https://programming-language-benchmarks.vercel.app/
MIT License
637 stars 134 forks source link

"docker/k8s" versus "dev machine" #231

Open igouy opened 2 years ago

igouy commented 2 years ago

On the home page

Main goals: … Facilitate benchmarking on real server environments as nowadays more and more applications are deployed with docker/k8s. It's likely to get a very different result from what you get on your dev machine. …

Now there are plenty of results, are they different?

hanabi1224 commented 2 years ago

When writing this, I was assuming GH action uses dockerized environment for CI, but that might not be true per its doc, looks like it's using Azure VM, which might still be some virtualized environment other than bare metal, but may or may not be docker/podman. I will think about how to make the wording more accurate. Thanks for bringing this up.

p.s. Regarding the numbers, I don't see any difference tho

igouy commented 2 years ago

https://benchmarksgame-team.pages.debian.net/benchmarksgame/sometimes-people-just-make-up-stuff.html#cloud-desktop

bpecsek commented 2 years ago

@igouy Could we please have the link to the old numbers published for the i5-3330? I have problem finding it. Any chance seeing the tabulated row numbers with the input parameters, compiler versions and settings etc and to see how the normalization was done? I would also like to know why SBCL was not included in your list?