"--spark-version" does not work

amplab / spark-ec2

Scripts used to setup a Spark cluster on EC2

Apache License 2.0

392 stars 299 forks source link

Open wangshusen opened 7 years ago

wangshusen commented 7 years ago

If I don't specify "--spark-version", the "/root/spark/" directory contains nothing but "/conf/".

When I specify "--spark-version=2.0.0", "--spark-version=2.0.2", "--spark-version=2.1.0", or "--spark-version=2.2.0", the error is like

Don't know about Spark version: 2.0.0

and spark-ec2 does not launch EC2 clusters.

But when I specify "--spark-version=1.4.1", it works fine.

I need to use Spark version after 2.0. Please help!

wangshusen commented 7 years ago

The issue is solved by using branch-2.0.

git clone -b branch-2.0 https://github.com/amplab/spark-ec2.git