We believe the following measurements are consistent with our concern that the Groute paper's characterization of Gunrock's performance on BFS on soc-LiveJournal1 was not representative of its actual performance.
Non-idempotent, not direction optimized:
We note the following runs we did on BFS with soc-LiveJournal1, all "on original input" (MatrixMarket):
Yuechao notes that he fixed a correctness bug in idempotence mode on 4 October 2016 (https://github.com/gunrock/gunrock/commit/23490d30fb330c984ba9cb3239838d5dbe2d155d). For our testing in idempotence mode only, we measured Gunrock versions both immediately before and immediately after this bug was fixed ("the performance differences were very small"). We believe running on any July-October Gunrock build would give similar performance results. Anyway, for idempotence:
Multi-GPU DOBFS was added to BFS primitive, and single-GPU direction_optimizing_bfs was removed as of 26 April 2016 (https://github.com/gunrock/gunrock/commit/1fbbc85ab07fcbb0d418202fcd5a77290b6df508). Gunrock's DOBFS has different behavior to Groute's (or anyone else's) BFS, which makes performance differences challenging to explain.
We believe the following measurements are consistent with our concern that the Groute paper's characterization of Gunrock's performance on BFS on soc-LiveJournal1 was not representative of its actual performance.
Non-idempotent, not direction optimized:
We note the following runs we did on BFS with soc-LiveJournal1, all "on original input" (MatrixMarket):
Idempotent, not direction optimized:
Yuechao notes that he fixed a correctness bug in idempotence mode on 4 October 2016 (https://github.com/gunrock/gunrock/commit/23490d30fb330c984ba9cb3239838d5dbe2d155d). For our testing in idempotence mode only, we measured Gunrock versions both immediately before and immediately after this bug was fixed ("the performance differences were very small"). We believe running on any July-October Gunrock build would give similar performance results. Anyway, for idempotence:
DOBFS
Multi-GPU DOBFS was added to BFS primitive, and single-GPU direction_optimizing_bfs was removed as of 26 April 2016 (https://github.com/gunrock/gunrock/commit/1fbbc85ab07fcbb0d418202fcd5a77290b6df508). Gunrock's DOBFS has different behavior to Groute's (or anyone else's) BFS, which makes performance differences challenging to explain.