PyWiFeS / pipeline

The Python data reduction pipeline for WiFeS
6 stars 26 forks source link

Draft: Use multiprocessing utils for wavesoln #44

Open timothyfrankdavies opened 4 months ago

timothyfrankdavies commented 4 months ago

Preq: https://github.com/PyWiFeS/pipeline/pull/43

This PR applies the functions added in https://github.com/PyWiFeS/pipeline/pull/43 to 'Wavelength Solution'. With the new max_processes config, it runs much faster with limited CPUs on Slurm. I think https://github.com/PyWiFeS/pipeline/issues/36 can be closed once this is merged.

Besides that, this is just a refactor to simplify some repeated (and complex) code.