search

twitter / scalding

A Scala API for Cascading
http://twitter.com/scalding
Apache License 2.0
3.48k stars 704 forks source link

Use SparkSession instead of SparkContext #1870

Closed johnynek closed 5 years ago

johnynek commented 5 years ago

Move to using SparkSession instead of SparkContext. This allows you to use the dataset or sql APIs in sources or sinks, which can be interesting.

@ianoc please take a look.

ianoc commented 5 years ago

lgtm