search

HPCE / hpce-2017-cw5

1 stars 6 forks source link

Performace Graphs #45

Open benfwalker opened 6 years ago

benfwalker commented 6 years ago

I dont really understand the performance graphs. What are all the dotted lines? Are they other peoples runs? If so, what does the min/max mean?

Also, what is the time scale? I'm pretty sure it isnt milliseconds, because I imagine that no-one is hitting nanoseconds at any input scale.

m8pple commented 6 years ago

If you mean the straight lines, then they are straight lines on a log-log graph, so the slope is allowing you to judge the slope of other lines.

For the other wavy dotted lines, they should be giving you the min/median/max across all implementations. So they should form a bracket on your personal results (which appear in bold - though if you have no results for an implementation it won't appear).

As to the time-scale, there was a question about it here #34. The newer graphs (if they ever finish), have a different y-scale. However, you have all your raw data available in the logs.

benfwalker commented 6 years ago

Ah right, so just to check, the colored (red and turquoise) min/max lines are what they seem, i.e. the best and worst implementations of the master branch of everyone who's opted in?

m8pple commented 6 years ago

Yes, that's correct.