Constructing a reproducible test environment

haskellfoundation / hs-opt-handbook.github.io

The Haskell Optimization Handbook

https://haskell.foundation/hs-opt-handbook.github.io/

Creative Commons Attribution 4.0 International

171 stars 12 forks source link

Constructing a reproducible test environment #7

Open doyougnu opened 2 years ago

doyougnu commented 2 years ago

This section is a list of things to disable/change to reduce noise in measurement. It should also link to similar lists and provide shell one-liners to achieve the things in the list.

references:

https://easyperf.net/blog/2019/08/02/Perf-measurement-environment-on-Linux

hsyl20 commented 2 years ago

It could be useful to mention tools like hyperfine: https://github.com/sharkdp/hyperfine

It detects outliers and in my case it was an indication that I had forgotten to turn off turbo-boost.