amplab / graphx

Former GraphX development repository. GraphX has been merged into Apache Spark; please submit pull requests there.
https://github.com/apache/spark
Apache License 2.0
360 stars 103 forks source link

Improve pre-shuffle aggregation performance in mrTriplets #106

Open rxin opened 10 years ago

rxin commented 10 years ago

I realized today that we can actually save the position of the source vertex and the target vertex in the array in EdgeTriplet, and then in aggregation, we can simply use that position to update the aggregation value (without actually doing any hash lookups).

Issue 101 will make this easier to implement.

https://github.com/amplab/graphx/issues/101