gunrock / io

Input (scripts, etc.) and output (scripts, performance results, etc.) for Gunrock and other graph engines
10 stars 6 forks source link

v1+ (and if possible for older versions too, mainly 0.4+) avg-process-time #46

Closed jowens closed 4 years ago

jowens commented 4 years ago

avg-process-time Not interested in any parameters used here, just plain ol' mteps and runtime for every dataset for every primitive. Tooltips are appreciated. Note for pagerank, the time would be divided by max-iter.

jowens commented 4 years ago

@neoblizz : these are for the 4 app-specific v1-0-0 directories:

SSSP: gunrock_primitives_sssp_avg-process-time TC: gunrock_primitives_tc_avg-process-time BC: gunrock_primitives_bc_avg-process-time PR: gunrock_primitives_pr_avg-process-time

Please let me know if those are what you are thinking. If so, I will start pushing them into the docs. Also, you want the same thing BUT also including previous < 1.0 runs? I'm a little skeptical there; I think the analysis I did for @crozhon that was specific to comparing pre-1.0 and 1.0+ is probably what we want. But I'll do what you find useful.

jowens commented 4 years ago

(Pushing pngs because they appear inline within the issue. Happy to push PDFs if you prefer those. HTML will have tooltips.)

neoblizz commented 4 years ago

Please let me know if those are what you are thinking. If so, I will start pushing them into the docs. Also, you want the same thing BUT also including previous < 1.0 runs? I'm a little skeptical there; I think the analysis I did for @crozhon that was specific to comparing pre-1.0 and 1.0+ is probably what we want. But I'll do what you find useful.

These are great, but I really do prefer best results from anything >= v1.0.0, so including Chuck's analysis. And then we can create one version of these plots which best performance from < v1.0.0 (separately, not added to the same plots).

Tooltips are great here for gunrock-devs.

jowens commented 4 years ago

So include ... cuda_arch_comparison and launch_bounds_comparison? @crozhon ?

neoblizz commented 4 years ago

Yes. And whatever else @crozhon produces in future.

jowens commented 4 years ago

Are you cool with what we have now?