openclimatefix / nwp

Tools for downloading and processing numerical weather predictions

MIT License

10 stars 3 forks source link

Add better NWP compression and speed up #12

Closed jacobbieker closed 1 year ago

jacobbieker commented 1 year ago

Pull Request

Description

This PR is to add better compression to NWP data to speed up training/

Fixes #11

How Has This Been Tested?

Ran to create new Zarr

[ ] Yes

If your changes affect data processing, have you plotted any changes? i.e. have you done a quick sanity check?

[ ] Yes

Checklist:

[ ] My code follows OCF's coding style guidelines
[ ] I have performed a self-review of my own code
[ ] I have made corresponding changes to the documentation
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] I have checked my code and corrected any misspellings