Vhi preprocess #preprocess

ECMWFCode4Earth / ml_drought

Machine learning to better predict and understand drought. Moving github.com/ml-clim

https://ml-clim.github.io/drought-prediction/

92 stars 18 forks source link

Vhi preprocess #preprocess #14

Closed tommylees112 closed 5 years ago

tommylees112 commented 5 years ago

TODO:

[x] Implement a VHI cleaner to turn the raw .nc files into one .nc file subset for kenya across multiple timesteps
[ ] Make the functions as general as possible
[ ] WRITE TESTS

What we want:

a preprocessing script that turns the raw VHI files into files with latitude longitude time dimensions
Subset Kenya (same bounding box as the ERA5 data)

tommylees112 commented 5 years ago

Recent additions have achieved a number of things (sorry for not splitting up properly)

1) Added the datasets wanted to a notebook 2) Added the functionality to rerun the missing files 3) Implemented VHI preprocessing in parallel which currently takes the data that is already downloaded (from the exporter) and then turns it into a subset of the data for kenya with latitude longitude and time dimensions added to the .nc file