According to the comment, the intention is to stop multiprocessing after loading the data into memory. However, setting num_workers = 1 results in a creation of an extra process later on when using the custom data loader.
Having the extra worker resulted in deadlocks when I worked with larger data.
Avsecz
commented
2 years ago
Same pull request as (https://github.com/kundajelab/bpnet/pull/34), because I had deleted my original fork:
According to the comment, the intention is to stop multiprocessing after loading the data into memory. However, setting num_workers = 1 results in a creation of an extra process later on when using the custom data loader.
Having the extra worker resulted in deadlocks when I worked with larger data.
Corrected by setting num_workers = 0.