Closed etrain closed 8 years ago
They keystone-ec2 scripts should build against the correct versions of spark/hadoop for the cluster that is launched (e.g. SPARK_VERSION=1.3.1 HADOOP_VERSION=2.0.0 sbt/sbt assembly
SPARK_VERSION=1.3.1 HADOOP_VERSION=2.0.0 sbt/sbt assembly
Fixed by https://github.com/shivaram/spark-ec2/commit/36d998c76a0750513948bad48801528425d96063
Nice - thanks @shivaram !
They keystone-ec2 scripts should build against the correct versions of spark/hadoop for the cluster that is launched (e.g.
SPARK_VERSION=1.3.1 HADOOP_VERSION=2.0.0 sbt/sbt assembly