Open vijayiyer05 opened 1 year ago
Any initial thoughts/insights @aranega?
@vijayiyer05 We have a good control over the startup.m
file from the Dockerfile
, so I think your proposal to set the number of the parallel workers there is the best option right now. I'll check how to modify this parameter programmatically and inject it in the startup file :)
I think this is what you need:
myCluster = parcluster('Processes')
myCluster.NumWorkers = 5
saveProfile(myCluster)
The saveProfile might not be necessary if its in the startup file
@ehennestad Thanks a lot! I'll update the startup file accordingly
The Brain Observatory Toolbox lead developer has confirmed successful initial operation on the DandiHub MATLAB server option.
One issue has arisen however: the default number of parallel workers for 'Process' workers is somehow set to 48. Given there are only 6 cores, this should be set to 5 or 6.
Updating the default will help prevent errors/crashes in some workflows that rely on the default value.
Suggest to patch this for now as needed, e.g. using a startup file. Eventually the root cause should be identified and addressed.