search

carpentries-lab / python-aos-lesson

Python for Atmosphere and Ocean Scientists
https://carpentries-lab.github.io/python-aos-lesson/
Other
87 stars 49 forks source link

Other options for parallel processing #43

Open DamienIrving opened 3 years ago

DamienIrving commented 3 years ago

In the exercises of the large data lesson, learners are required to think about alternative options to Dask. The ARC Centre of Excellence for Climate Extremes have some notes that go through the options in detail. It would be good to have learners explore those notes so that they're aware of GNU parallel and the multiprocessing library.