openclimatefix / ocf_datapipes

OCF's DataPipe based dataloader for training and inference
MIT License
13 stars 11 forks source link

resample lat lon #280

Closed peterdudfield closed 4 months ago

peterdudfield commented 4 months ago

Detailed Description

It would be good to have a pipeline that resamples the latitude and longitudes.

Context

Trianing dataset for ECMWF is in 0.05, and live data is in 0.1 intervals. https://github.com/openclimatefix/india-forecast-app/issues/35

Possible Implementation

jacobbieker commented 4 months ago

284 does the resampling from 0.05 to 0.1 in training. Hardcoded for now if 0.05 data shows up, but fixes that overall I think.

peterdudfield commented 4 months ago

Great stuff. Shall we keep it open, until a model is trained and deployed?

jacobbieker commented 4 months ago

Yeah, keep it open until we know its fixed.