search

amplab / training

Training materials for Strata, AMP Camp, etc
150 stars 121 forks source link

update path from /root/spark/sbin/ to /root/spark/bin #159

Open M1chaelM opened 10 years ago

M1chaelM commented 10 years ago

The path to various bash scrips seems to be incorrect in both spark-ec2.py and /root/spark-ec2/spark-standalone/setup.sh. It's easy to fix the first one; not sure about the second.

JoshRosen commented 10 years ago

Hi @M1chaelM,

Which version of the exercises are you using, and which version of the Spark AMI / spark-ec2? Some scripts changed locations from Spark 0.8-0.9 to Spark 1.0.0. My hunch is that you're following an older set of AMP Camp exercises and using a newer version of the Spark code.

M1chaelM commented 10 years ago

That sounds likely. :) I believe I’m following the directions for ampcamp4. The instructions for using us-west-1 give ami-6ac4ee2f (see http://ampcamp.berkeley.edu/big-data-mini-course/launching-a-bdas-cluster-on-ec2.html under "Can I use a EC2 region other than us-east-1 while creating the cluster?”)

I created a key-pair for the east region and rerunning the launch command shows that the most recent ami is ami-19474270. This seems to be working now.

Thank you!

On Sep 1, 2014, at 1:32 PM, Josh Rosen notifications@github.com wrote:

Hi @M1chaelM,

Which version of the exercises are you using, and which version of the Spark AMI / spark-ec2? Some scripts changed locations from Spark 0.8-0.9 to Spark 1.0.0. My hunch is that you're following an older set of AMP Camp exercises and using a newer version of the Spark code.

— Reply to this email directly or view it on GitHub.