search

Spirals-Team / hadoop-benchmark

Docker containers to build an Hadoop infrastructure and experiment feedback control loops atop of it.
Apache License 2.0
9 stars 5 forks source link

MapReduce function memory values #6

Closed ghost closed 7 years ago

ghost commented 8 years ago

Where can these values set in this system: yarn.scheduler.maximum-allocation-mb, mapreduce.map.memory.mb, mapreduce.map.java.opts, mapreduce.reduce.memory.mb, mapreduce.reduce.java.opts? I haven't found containing XML files.

zhangbbo commented 8 years ago

In directory "images/hadoop/hadoop-conf/", there are all the configuration files used to configure the Hadoop system.

ghost commented 8 years ago

Yes, but I couldn't see these YARN related values in those files.

zhangbbo commented 8 years ago

That means we used the default values. :) You just need to add the related YARN parameter in the correct file with your preferred value. When you launch the Hadoop container, the system will apply your configuration automatically.