This PR sets up the targets pipeline to work with distributed SLURM workers using crew.cluster. It's not quite working on the HPC yet, but it continues to work locally, so I'm going to go ahead and merge this. The issues on the HPC are likely due to timeout settings that need to be tweaked. This should also work on an open on demand session with multiple cores.
Addresses #3.
This PR sets up the targets pipeline to work with distributed SLURM workers using
crew.cluster. It's not quite working on the HPC yet, but it continues to work locally, so I'm going to go ahead and merge this. The issues on the HPC are likely due to timeout settings that need to be tweaked. This should also work on an open on demand session with multiple cores.