CoBrALab / antsRegistration-MAGeT

A reimplementation of MAGeTbrain using only ANTs tools.
Other
16 stars 6 forks source link

Make generic cluster support honour QBATCH variables #58

Closed gdevenyi closed 8 years ago

gdevenyi commented 8 years ago

We should assume that if someone sets QBATCH variables that that's how they want their cluster jobs submitted.

We can use those variables to compute reasonable memory and time estimates: QBATCH_PPJ = processors per job QBATCH_CHUNKSIZE = commands per job QBATCH_CORES = how many running in parallel per job

With unset variables, qbatch assumes PPJ=1=CHUNK=CORES

gdevenyi commented 8 years ago

In general,

CHUNKS scales walltime up PPJ scales walltime down CORES scales memory up and walltime down

Need to special case undefined environment variables since qbatch defaults to PPJ=CHUNKS=CORES