openclimatefix / nowcasting_dataset

Prepare batches of data for training machine learning solar electricity nowcasting data
https://nowcasting-dataset.readthedocs.io/en/stable/
MIT License
24 stars 6 forks source link

Will check 5 min sat data exists #720

Closed peterdudfield closed 1 year ago

peterdudfield commented 1 year ago

Pull Request

Description

checks if 5 min satellite data is there or not, and then loads 15 minute data

How Has This Been Tested?

Added a test, to check if only _15 sat file is there, it stil works. (it caught a different bug, so I'm happy i wrote this)

Checklist:

codecov-commenter commented 1 year ago

Codecov Report

Merging #720 (57041e5) into main (2a1226d) will decrease coverage by 0.07%. The diff coverage is 82.60%.

@@            Coverage Diff             @@
##             main     #720      +/-   ##
==========================================
- Coverage   92.91%   92.84%   -0.08%     
==========================================
  Files          49       49              
  Lines        3459     3480      +21     
==========================================
+ Hits         3214     3231      +17     
- Misses        245      249       +4     
Impacted Files Coverage Δ
nowcasting_dataset/data_sources/fake/batch.py 87.12% <ø> (ø)
nowcasting_dataset/data_sources/gsp/eso.py 67.12% <33.33%> (ø)
nowcasting_dataset/config/model.py 91.81% <60.00%> (-1.18%) :arrow_down:
...et/data_sources/satellite/satellite_data_source.py 93.68% <93.10%> (+0.04%) :arrow_up:
nowcasting_dataset/config/save.py 100.00% <100.00%> (ø)
nowcasting_dataset/data_sources/fake/utils.py 94.44% <100.00%> (ø)
nowcasting_dataset/filesystem/utils.py 97.59% <100.00%> (ø)

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more