search

gablab / mindhive

scripts, wiki and issues related to mindhive
mindhive.mit.edu
7 stars 77 forks source link

recon queue load balancing should take memory usage into account #21

Open satra opened 12 years ago

satra commented 12 years ago

does load balancing on the recon queue take memory consumption into account? or is it purely based on cpu usage? if cpu only, could we create a bigmem queue that takes jobs which use upto 10GB of RAM and will only run at most 4 of them on each of the mh nodes.

mibr-admin commented 12 years ago

right now it is purely CPU, but we can add memory into the mix, too. i'll probably take the first example from this document:

http://www.adaptivecomputing.com/resources/docs/maui/5.2nodeallocation.php#PRIORITY

mibr-admin commented 12 years ago

let me set up a bigmem queue. i'll let you know when it's done.