search

amplab / spark-ec2

Scripts used to setup a Spark cluster on EC2
Apache License 2.0
392 stars 299 forks source link

VPC/Subnet requirements not documented #90

Open matthewadams opened 7 years ago

matthewadams commented 7 years ago

I don't believe that all of the requirements to use spark-ec2 with an existing VPC & subnet are documented. If I create a VPC & subnet, then use those to run spark-ec2 as documented here, I get an error ending with

Waiting for cluster to enter 'ssh-ready' state...........
Error:
 Failed to determine hostname of Instance:i-0909d1ed1af09cd09.
Please check that you provided --private-ips if necessary

More info on SO at http://stackoverflow.com/questions/42654336/how-do-i-resolve-failed-to-determine-hostname-of-instance-error-using-spark-ec

yuj commented 6 years ago

I am running into the same issue. Have you got any update?

matthewadams commented 6 years ago

@yuj nope...it's been so long I can't remember what the solution or workaround was...sorry.