scanLeft and parallel prefix scan as pure lazy transformations

[erikerlandson]

An issue for scanLeft and parallell scan for RDDs, as pure lazy transformations:

Implementing an RDD scanLeft Transform With Cascade RDDs http://erikerlandson.github.io/blog/2014/08/09/implementing-an-rdd-scanleft-transform-with-cascade-rdds/

Implementing Parallel Prefix Scan as a Spark RDD Transform http://erikerlandson.github.io/blog/2014/08/12/implementing-parallel-prefix-scan-as-a-spark-rdd-transform/

[ryan-williams]

This is really cool Erik, thanks, will look into it shortly!

On Thu, Feb 9, 2017, 3:28 PM Erik Erlandson notifications@github.com wrote:

An issue for scanLeft and parallell scan for RDDs, as pure lazy transformations:

Implementing an RDD scanLeft Transform With Cascade RDDs

http://erikerlandson.github.io/blog/2014/08/09/implementing-an-rdd-scanleft-transform-with-cascade-rdds/

Implementing Parallel Prefix Scan as a Spark RDD Transform

http://erikerlandson.github.io/blog/2014/08/12/implementing-parallel-prefix-scan-as-a-spark-rdd-transform/

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/hammerlab/magic-rdds/issues/39, or mute the thread https://github.com/notifications/unsubscribe-auth/AAcYlZ2BlZAs8733Ik3AtUqqmX6wFwO6ks5ra3bQgaJpZM4L8oIC .

[erikerlandson]

Hi @ryan-williams - had a chance to take a look at this?

[ryan-williams]

Hi @erikerlandson, unfortunately I've not; I'd still like to but in the meantime if you want to send a PR that is more than welcome.