search

daithiocrualaoich / spark-emr

Spark Elastic MapReduce bootstrap and runnable examples.
17 stars 3 forks source link

Examine cluster utilization #9

Open daithiocrualaoich opened 11 years ago

daithiocrualaoich commented 11 years ago

Extract Hadoop memory sizes and use for SPARK_MEM

daithiocrualaoich commented 11 years ago

Set SPARK_MEM in run.sh. 6.3Gb possible on large instances. c.f. #11.