search

LinkedEarth / Pyleoclim_util

Python Package for the Analysis of Paleoclimate Data. Documentation at
https://pyleoclim-util.readthedocs.io
GNU General Public License v3.0
87 stars 33 forks source link

Enable proper multiprocessing for significance testing for spectral and wavelet methods #467

Open khider opened 1 year ago

khider commented 1 year ago

WWZ takes a while to run, so doing 1000 MC is impossible for significance testing. Use the Multiprocessing Pool method properly to run these in parallel considering that most modern machines will have cores available.

CommonClimate commented 1 year ago

Note for humans reading this: WWZ is already running multi-processing, but we have reasons to think it wasn't implemented correctly. There might also be ways to speed up the algorithm by better exploiting matrix algebra in Python 3.11