Closed gdevenyi closed 8 years ago
Does setting individual jobs on qbatch avoid this?
Submitting individual jobs definitely allows backfill cheating.
We need a way to detect available backfill space and cheat our way in.
Something like a "grouping" option to adjust CHUNKSIZE + a script to parse backfill and suggest an appropriate option?
Scinet is all weird, who knows how backfill works. Not worth wasting time on.
New qbatch submits jobs which are considered 'large' by scinet.
With careful splitting we should be able to cheat the backfill algorithm.
This might be array jobs fault.