scala / scala3

The Scala 3 compiler, also known as Dotty.
https://dotty.epfl.ch
Apache License 2.0
5.87k stars 1.06k forks source link

dotty-bench.epfl.ch sometimes records running time of 0 seconds, skewing moving average #21688

Open smarter opened 4 weeks ago

smarter commented 4 weeks ago

Lately, https://dotty-bench.epfl.ch has looked pretty eratic:

Screenshot_20241001_225413

Zooming out and enabling "min", we see that some points are incorrectly recorded as 0 second long:

Screenshot_20241001_225527

Gedochao commented 4 weeks ago

cc @mbovel @hamzaremmal

mbovel commented 3 weeks ago

Sorry this issue has been standing for so long. I plan to clean up the data when merging the new visualiser (#21720) and the new benchmarks infrastructure (#21719). This should be done in a few weeks.