search

zombocom / derailed_benchmarks

Go faster, off the Rails - Benchmarks for your whole Rails app
2.96k stars 144 forks source link

Use median over average #160

Closed schneems closed 4 years ago

schneems commented 4 years ago

Since we don't know the shape of the distribution we're dealing with, it's better to use the median value rather than the average for comparisons

Also adding some alignment so that 

[3054e1d584] "Merge pull request #36506 from kamipo/group_by_with_order_by_virtual_count_attribute" - (0.016381 seconds)
  SLOWER by:
    0.9697x [older/newer]
    -3.1224% [(older - newer) / older * 100]

Will become:

[3054e1d584] "Merge pull request #36506 from kamipo/group_by_with_order_by_virtual_count_attribute" - (0.016381 seconds)
  SLOWER by:
     0.9697x [older/newer]
    -3.1224% [(older - newer) / older * 100]

(Minor, but it was really bugging me)

Also added emojis for faster and slower:

  SLOWER 🐢🐢🐢 by:

Which helps to visually distinguish results.