mcmancini / Era5Weather

0 stars 0 forks source link

Set up parallelisation #12

Closed mcmancini closed 5 months ago

mcmancini commented 5 months ago

Set the script to parallelise the processing and saving of the weather data into csv files for each 1km tile. I am using joblib because it is the package with the lowest oberhead creating the parallel pool of workers compared to other libraries such as multiprocessing or concurrent