search

krausest / js-framework-benchmark

A comparison of the performance of a few popular javascript frameworks
https://krausest.github.io/js-framework-benchmark/
Apache License 2.0
6.77k stars 839 forks source link

NaN% and broken compare #1749

Open yuri0sh opened 1 week ago

yuri0sh commented 1 week ago

Example table: https://krausest.github.io/js-framework-benchmark/2024/table_chrome_129.0.6668.58.html When any framework is selected for comparison, the comparison metric is sometimes displayed as NaN%, also leading to the framework showing as "significantly slower" than itself (red instead of white)

Present on nearly all official benchmark pages, including the latest

Screenshot 2024-10-01 at 15 39 55
yuri0sh commented 1 week ago

https://github.com/krausest/js-framework-benchmark/blob/3d0af4e7930160386e59a9617d94682facf25bc5/webdriver-ts-results/src/Common.ts#L504

standardDeviation on sets of size 1 is NaN, which then coalesces to zero before being divided by.