openclimatefix / MetOfficeDataHub

Python wrapper around MetOffice Atmospheric Model Data REST API
MIT License
3 stars 0 forks source link

Save as Zarr #59

Closed peterdudfield closed 1 year ago

peterdudfield commented 1 year ago

Detailed Description

I want to make it a .zarr file with chunks that include all the variables and all the steps. We could very well have the two formats (latest.netcdf and latest.zarr). If my tests are correct this will load the NWP data tens of times faster, which is the current bottleneck.

Context

Speed up site level forecasts

Possible Implementation

See save method, and yea just both netcdf and zarr. The code looks already set up save a zarr file

simlmx commented 1 year ago

Done in #62 Follow up fixes in #63.