At the spark summit 2017, we learned that 80% of spark users are on spark 2, so it makes sense to make the default support for rheem on spark 2.x. We plan to maintain a separate branch for 1.6.x. But from now on, the master branch will be supporting spark 2.x. Note that this PR contains breaking changes.
At the spark summit 2017, we learned that 80% of spark users are on spark 2, so it makes sense to make the default support for rheem on spark 2.x. We plan to maintain a separate branch for 1.6.x. But from now on, the master branch will be supporting spark 2.x. Note that this PR contains breaking changes.