Open benmccann opened 8 years ago
Thanks mate! The change is not that necessary. I just want to reduce an unneeded rdd.mapPartitions operation :-). Because the only thing that GraphImpl.apply (line 341-354) is more than GraphImpl.fromExistingRDDs is that GraphImpl.apply calls EdgePartition.withoutVertexAttributes to generate a new empty vertex attributes array which will not be used at all.
I'd like to make any changes necessary to graphx to use the upstream library. This repo is still on graphx 1.4 I believe and so we're not getting any of the graphx bug fixes.
I sent https://github.com/cloudml/zen/pull/56 and https://github.com/cloudml/zen/pull/57 to reduce the diff between graphx2 and upstream
I sent https://github.com/apache/spark/pull/14291 to upstream addition of a new method
Changes left:
GraphImpl.fromEdgeRDD
visibilityRoutingTablePartition.routingTable
visibilityGraphImpl
was necessary?