search

CoBrALab / antsRegistration-MAGeT

A reimplementation of MAGeTbrain using only ANTs tools.
Other
16 stars 6 forks source link

Limit number of total jobs on SciNet #75

Closed gdevenyi closed 6 years ago

gdevenyi commented 7 years ago

Gabriel,

The limit is currently 3000 but I would target say 2000 at a time in the queue. How long will the jobs be?

Scott

gdevenyi commented 7 years ago

Count total atlas, template, subject.

Total = atlastemplate + templatesubject

Chunking size = ceil(Total/2000)

gdevenyi commented 7 years ago

Gabriel,

We have a max user queueable currently set at 2500, which is the total amount of jobs a user can have in the scheduler. There is a limit as well on how many you can submit at a single time, which is currently set at 1000. This is to prevent large automatic jobs submissions from overwhelming the scheduler. If the system is not busy you probabaly wouldn't run into this lower limit, however when it gets bogged down, then this limit can come into play. In general we recommend people keep the number of jobs in the queue under 2000, as our scheduling system is not really high throughput type workloads.

Scott