Spark package release 2.12.0-3.0.1 - Githubissues

mesosphere / spark-build

Used to build the mesosphere/spark docker image and the DC/OS Spark package

52 stars 34 forks source link

Spark package release 2.12.0-3.0.1 #580

Closed farhan5900 closed 4 years ago

farhan5900 commented 4 years ago

What changes were proposed in this pull request?

Resolves COPS-6356

Changes default Scala version from 2.11 to 2.12
Hadoop versions used are 2.7 and 3.2
Modifies CLI flag (--executor-auth-secret) to accept direct secret value instead of filename
Adds File-Based RPC Authentication support flag in CLI (--executor-auth-secret-path)
Adds Integration test for File-Based RPC Authentication support

How were these changes tested?

Integration tests