openclimatefix / ocf_datapipes

OCF's DataPipe based dataloader for training and inference
MIT License
13 stars 11 forks source link

Pseudo-Irradiance Datapipe Updates #186

Closed jacobbieker closed 10 months ago

jacobbieker commented 1 year ago

Pull Request

Description

This adds testing config to use the public satellite data as well, if wanted. This also adds a irradiance datapipe test using that public data, as when running it on leonardo, there seemed to be some issues. This also combines the metadata and PV image creator datapipes to ensure that the same location is chosen each time, rather than hopeing the random seeds stay in sync.

Fixes #

How Has This Been Tested?

Unit tetss

Checklist:

codecov[bot] commented 1 year ago

Codecov Report

Merging #186 (260dde2) into main (1be38aa) will increase coverage by 0.49%. The diff coverage is n/a.

:exclamation: Current head 260dde2 differs from pull request most recent head bcd8f2e. Consider uploading reports for the commit bcd8f2e to get more accurate results

@@            Coverage Diff             @@
##             main     #186      +/-   ##
==========================================
+ Coverage   81.39%   81.88%   +0.49%     
==========================================
  Files         128      124       -4     
  Lines        5568     5102     -466     
==========================================
- Hits         4532     4178     -354     
+ Misses       1036      924     -112     

see 30 files with indirect coverage changes

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

jacobbieker commented 10 months ago

Closing this as pausing development on PIM model for now.