Currently only one optimizer run can be executed at any given time. Sometimes (especially on GPUs) it would be more efficient if multiple optimizer runs are executed in parallel on the same GPU to use the full capacity of the device. These multiple runs can be different runs (with different seeds) of the same input data (i.e., same subject), or on different input data.
Currently only one optimizer run can be executed at any given time. Sometimes (especially on GPUs) it would be more efficient if multiple optimizer runs are executed in parallel on the same GPU to use the full capacity of the device. These multiple runs can be different runs (with different seeds) of the same input data (i.e., same subject), or on different input data.