search

DCAN-Labs / infant-abcd-bids-pipeline

Human infant pipeline, based on abcd-hcp-pipeline, to process fMRI data.
https://hub.docker.com/r/dcanumn/infant-abcd-bids-pipeline
BSD 3-Clause "New" or "Revised" License
8 stars 4 forks source link

Cap the thread-pool used for processing tasks. #4

Closed kathy-snider closed 4 years ago

kathy-snider commented 4 years ago

When we have lots of tasks and try to process them all at the same time, they take too much memory all at one time and some of the threads get shorted of memory and die. So, no matter how many thread we actually have when we start the pipeline, don't try to process more than a few tasks at the same time.