Note, this is a PR into #1868 (so, I will point it at develop after that merges).
This is part to support Execution in spark.
With this, you can run an Execution[A] in SparkMode which pretty much gets us to probably an alpha version of this code.
The last thing to do is provide standard SparkSources that convert the common sources/sinks to spark (e.g. TypedText.tsv, TextLine, SequenceFile, and maybe a few others).
Note, this is a PR into #1868 (so, I will point it at develop after that merges).
This is part to support Execution in spark.
With this, you can run an
Execution[A]inSparkModewhich pretty much gets us to probably an alpha version of this code.The last thing to do is provide standard SparkSources that convert the common sources/sinks to spark (e.g. TypedText.tsv, TextLine, SequenceFile, and maybe a few others).
cc @ianoc @non