Lines 38-39 of aws/ec2_bootstrap.sh are inconsistent

rjurney / Agile_Data_Code_2

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

http://bit.ly/agile_data_science

MIT License

456 stars 307 forks source link

Lines 38-39 of aws/ec2_bootstrap.sh are inconsistent #39

Closed mileserickson closed 7 years ago

mileserickson commented 7 years ago

Line 38 is a comment indicating that Spark will use 8GB of RAM, but the following line sets spark.driver.memory to 25GB. One or the other needs to be updated for consistency.

38: # Give Spark 8GB of RAM, used Python3 39: echo "spark.driver.memory 25g" | sudo tee -a $SPARK_HOME/conf/spark-defaults.conf

rjurney commented 7 years ago

How nice to get a pull request! Thanks, merged :)