search

nchammas / flintrock

A command-line tool for launching Apache Spark clusters.
Apache License 2.0
636 stars 116 forks source link

Flintrock got stuck when restarting a Spark cluster on AWS #293

Closed foolhb closed 4 years ago

foolhb commented 4 years ago

I used Flintrock to start a Spark cluster on AWS and stopped it after using it. Then I restarted the cluster using the command: flintrock start --ec2-identity-file ./AWS.pem cluster-name But it got stuck at "Starting big-spark..." and ended up "[IP address] Could not connect via SSH." The instances were successfully stared, but the Spark seems not stared since I can't access 8080 port of the master instance

I'm not sure if this should be posted here, but I did try to Google for some information but got nothing. Thanks for your help!

Update: I uninstalled the Flintrock in Homebrew and tried pip3 install Flintrock. It works now!

nchammas commented 4 years ago

Hmm, everything else was the same, and you just installed Flintrock with pip instead of Homebrew? That's strange. It should have worked with Homebrew (even though it's an unofficial installation method), but I'm glad you're all set now!