Backfill NaNs in Satellite nonHRV 2018

openclimatefix / Satip

Satip contains the code necessary for retrieving, transforming and storing EUMETSAT data

https://satip.readthedocs.io/

MIT License

41 stars 28 forks source link

Backfill NaNs in Satellite nonHRV 2018 #237

Open jacobbieker opened 6 months ago

sergyDwhiz commented 6 months ago

Hello @jacobbieker can you provide more insight on this issue ? Willing to crack it!

jacobbieker commented 6 months ago

Hi,

This is primarily with our public GCP EUMETSAT dataset, the 2018 non-HRV channels are nearly all NaN for 2018 for some reason. We have been processing timesteps of the imagery to Hugging Face here https://huggingface.co/datasets/openclimatefix/eumetsat-rss but not sure as much for what help we need. This issue is more just tracking progress on replacing the NaN values with real ones.

sergyDwhiz commented 6 months ago

Okay thanks. Would look for other issues!

sergyDwhiz commented 6 months ago

Or do you suggest any ?

jacobbieker commented 6 months ago

This might be a good one? https://github.com/openclimatefix/Satip/issues/124 There might be more of Satip that can be converted to using eumdac in the background, but yeah, if you want to check it out, that would be great!