NCAR / ctsm_python_gallery

A place to put sample workflows and tools that use ctsm model output
Apache License 2.0
18 stars 28 forks source link

DASK for computationally expensive tasks #18

Open wwieder opened 5 years ago

wwieder commented 5 years ago

@jhamman can you help with providing an example for how to use DASK to handle computationally expensive jobs. I got the for loop to calculated SVD in the script below (on my fork), but it's pretty slow for a single variable and single model. Is there a slick way to use DASK to speed this up?

notebook also available in /home/wwieder/python/ctsm_py/notebooks/.

https://github.com/wwieder/ctsm_py/blob/master/notebooks/MonthlySVD.ipynb P.S., if the notebook renders can you find out why it's printing so much output to the screen?

Finally, also good to mask out grids w/ zero GPP (e.g. Antarctic)?