Update Spark jobtype to support Spark 2.0 applications.

azkaban / azkaban-plugins

Plugins for Azkaban.

https://azkaban.github.io

Apache License 2.0

130 stars 178 forks source link

Update Spark jobtype to support Spark 2.0 applications. #253

Closed Victsm closed 7 years ago

Victsm commented 7 years ago

Removed the enforcement of ignoring user supplied num executors parameters because the versions of Spark that we enable dynamic allocation internally have the patch SPARK-13723