SDS has requested another config file for us/them to test on 32 or 64 CPU machines.
We'll need to adjust the parallelism of the stages. Assuming we have 128 GB of ram, we can try
Wrapped phase: n_parallel_bursts = 27
Running 9 parallel bursts led to ~30 GB of RAM usage.
Unwrapping: (multiple options for this)
n_parallel_tiles: 8
n_parallel_jobs: 5
(TBD: exact math on how much RAM snaphu uses for different tiles shapes/sizes.)
One possible idea to aid them: make a few "standard configurations" or "base configurations" (similar to the idea here, where you just specify 'big'. We could have a 16cpu configuration, a 64 cpu one, etc.
SDS has requested another config file for us/them to test on 32 or 64 CPU machines. We'll need to adjust the parallelism of the stages. Assuming we have 128 GB of ram, we can try
n_parallel_bursts = 27n_parallel_tiles: 8n_parallel_jobs: 5(TBD: exact math on how much RAM snaphu uses for different tiles shapes/sizes.)One possible idea to aid them: make a few "standard configurations" or "base configurations" (similar to the idea here, where you just specify 'big'. We could have a
16cpuconfiguration, a64cpu one, etc.