openclimatefix / ocf_datapipes

OCF's DataPipe based dataloader for training and inference
MIT License
13 stars 11 forks source link

Add support for ECMWF #228

Closed jacobbieker closed 10 months ago

jacobbieker commented 10 months ago

Pull Request

Description

This PR adds support for opening the ECMWF Zarrs generated by the NWP consumer.

Fixes #223

How Has This Been Tested?

Unit Test

Checklist:

codecov[bot] commented 10 months ago

Codecov Report

Merging #228 (7cb17b3) into main (13fff0e) will decrease coverage by 2.78%. Report is 3 commits behind head on main. The diff coverage is 22.22%.

@@            Coverage Diff             @@
##             main     #228      +/-   ##
==========================================
- Coverage   82.50%   79.73%   -2.78%     
==========================================
  Files         125      126       +1     
  Lines        5402     5507     +105     
==========================================
- Hits         4457     4391      -66     
- Misses        945     1116     +171     
Files Coverage Δ
ocf_datapipes/load/nwp/nwp.py 97.43% <100.00%> (+0.21%) :arrow_up:
ocf_datapipes/load/nwp/providers/ecmwf.py 94.11% <94.11%> (ø)
ocf_datapipes/training/pseudo_irradience.py 16.41% <11.27%> (-58.59%) :arrow_down:

... and 5 files with indirect coverage changes

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more