search

Molns / molns

MOLNs: a cloud appliance for systems biology applications
http://molns.github.io/molns
4 stars 28 forks source link

Alarm for workers #33

Open ahellander opened 9 years ago

ahellander commented 9 years ago

Should we turn off workers automatically after idle for some time? To save on resources.

briandrawert commented 8 years ago

Proposal: Each WorkerGroup has a setup option: "auto-shutoff time" (in hours). We use a timer like we do with the StochSS workers, and integrate with molnsutil to restart the timer each time a job is run on a worker node. Issue: If you use ipython.parallel directly, nodes will just shutdown unexpectedly on you. Partial solution: change ipython.parallel profile from 'default' to 'molnsutil' to make it more obvious that is what is it for.

ahellander commented 8 years ago

Spontaneously this seems reasonable, but I do worry about the ipython parallel issue. Maybe we could have a timer that is based on cpu load?