Add Benchmark_Rules.md - Githubissues

rsb-23 commented 4 days ago

There are so many unnecessary issues/PR/discussions, just because of 1 reason. There is no defined benchmarking rules mentioned by author @bddicken .

I suggest him to add BENCHMARK_RULES.md for his project, else there is no point creating issues and PRs.

Maybe,

Code should use only builtin libraries
Language version should be latest stable version as on 1st Dec 2024.
Each benchmark should be simple and test only 1 aspect.

Originally posted by @rsb-23 in https://github.com/bddicken/languages/issues/71#issuecomment-2503021100

jrosell commented 3 days ago

As compiling times are not measured, I think boostraping for interpreted languages shouldn't be measured. I mean, only the diference between timestamp before and after the loops should be measured and compared.

rsb-23 commented 3 days ago

As code is run thrice and minimum time is taken, but only 1st run adds to compile time. This behavior is true for python, not sure about others.

bddicken / languages

Add Benchmark_Rules.md #98