amplab / spark-ec2

Scripts used to setup a Spark cluster on EC2
Apache License 2.0
393 stars 299 forks source link

Added SPARK_TACHYON_MAP for spark 2.0.0 and 2.0.1 #68

Open skshambhu opened 8 years ago

skshambhu commented 8 years ago

Hello all,

Could you please test the changes for SPARK_TACHYON_MAP for spark 2.0.0 and 2.0.1

Many thanks! Sanjay

shivaram commented 8 years ago

I think Tachyon 0.8.2 is very old and the new versions of Alluxio have their own setup which is incompatible with existing spark-ec2 code. I am not sure this change is very useful because of that.