hpcugent / hanythingondemand

hanythingondemand provides a set of scripts to easily set up an ad-hoc Hadoop cluster through PBS jobs
https://hod.readthedocs.org
GNU General Public License v2.0
12 stars 6 forks source link

Optimization: Add yarn.scheduler.capacity.node-locality-delay=0 to capacity scheduler settings #165

Open ehiggs opened 8 years ago

ehiggs commented 8 years ago

The capacity scheduler supports a property "yarn.scheduler.capacity.node-locality-delay". This is a setting to let you delay yarn container allocation to see if locality can improve. However, HOD uses parallel file systems with little or no locality so this is not useful. So set it to 0.