amplab / spark-ec2

Scripts used to setup a Spark cluster on EC2
Apache License 2.0
393 stars 299 forks source link

Simple setup fails. - Duplicate (hence closed) #69

Closed alokshenoy closed 8 years ago

alokshenoy commented 8 years ago

First attempt at trying to get a spark cluster running. Ran the following command:

./spark-ec2 --instance-type=t1.micro --region=us-west-2 --zone=us-west-2c --ebs-vol-size=8 -k myeky -i ~/.ssh/mykey.pem -s 1 --vpc-id=vpc-myvpc launch microcluster

In the end I cannot connect to the spark dashboard. Was trying to figure out what's going and while going through the output landed on this:

--2016-11-02 04:15:11--  http://s3.amazonaws.com/spark-related-packages/spark-1.6.2-bin-hadoop1.tgz
Resolving s3.amazonaws.com (s3.amazonaws.com)... 52.216.1.51
Connecting to s3.amazonaws.com (s3.amazonaws.com)|52.216.1.51|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2016-11-02 04:15:11 ERROR 404: Not Found.

ERROR: Unknown Spark version
spark/init.sh: line 137: return: -1: invalid option
return: usage: return [n]
Unpacking Spark
tar (child): spark-*.tgz: Cannot open: No such file or directory
tar (child): Error is not recoverable: exiting now
tar: Child returned status 2
tar: Error is not recoverable: exiting now
rm: cannot remove `spark-*.tgz': No such file or directory
mv: missing destination file operand after `spark'
Try `mv --help' for more information.
[timing] spark init:  00h 00m 01s

duplicate of #43