amplab / graphx

Former GraphX development repository. GraphX has been merged into Apache Spark; please submit pull requests there.

https://github.com/apache/spark

Apache License 2.0

360 stars 103 forks source link

In mapReduceTriplets, walk vertices instead of edges #95

Closed ankurdave closed 10 years ago

ankurdave commented 10 years ago

This greatly improves performance in Pregel when the active set is small, such as in the later stages of connected components.

To do:

Support walking destination vertices as well as source vertices.
~~Dynamically switch between the two strategies based on the size of the active set.~~ (done)
Fix GraphSuite.deltaJoinVertices test failure caused by a change in the semantics of graph.deltaJoinVertices.mapReduceTriplets

AmplabJenkins commented 10 years ago

Merged build triggered.

AmplabJenkins commented 10 years ago

Merged build triggered.

AmplabJenkins commented 10 years ago

Merged build started.

AmplabJenkins commented 10 years ago

Merged build finished.

AmplabJenkins commented 10 years ago

One or more automated tests failed Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/GraphXPullRequestBuilder/2622/

AmplabJenkins commented 10 years ago

Merged build started.

AmplabJenkins commented 10 years ago

Merged build finished.

AmplabJenkins commented 10 years ago

One or more automated tests failed Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/GraphXPullRequestBuilder/2623/

ankurdave commented 10 years ago

100 changes the incremental view maintenance code enough that this PR doesn't apply directly. I'm closing this one and will open a new one on top of that.

See #102 for the new PR.