amplab / spark-ec2

Scripts used to setup a Spark cluster on EC2
Apache License 2.0
392 stars 299 forks source link

Spark 2.1 Supported? #85

Open shiyuangu opened 7 years ago

shiyuangu commented 7 years ago

Is Spark 2.1 supported? It is not in the VALID_SPARK_VERSIONS in branch-2.0. What changes are needed for spark_ec2.py to support Spark 2.1?

shivaram commented 7 years ago

I think we should support it. Please open a PR if you have a chance to add support for this.

shiyuangu commented 7 years ago

PR #87