add missing spark_version 2.1.0

amplab / spark-ec2

Scripts used to setup a Spark cluster on EC2

Apache License 2.0

393 stars 299 forks source link

add missing spark_version 2.1.0 #87

Closed shiyuangu closed 7 years ago

shiyuangu commented 7 years ago

Added missing spark_version 2.1.0

shivaram commented 7 years ago

Just to confirm, with this PR you were able to launch a cluster with 2.1.0 ?

shiyuangu commented 7 years ago

Yes, I can see Spark 2.1.0 launches in both scala and python spark shell with this PR. There is a warning "Java 1.7 is deprecated as of Spark 2.0.0" . Basic functionality seems work fine regardless of this warning. To fix this warning, AMI needs a java upgrade?

shivaram commented 7 years ago

Yeah that's a separate issue. Merging this. Thanks @shiyuangu !