search

openclimatefix / Satip

Satip contains the code necessary for retrieving, transforming and storing EUMETSAT data
https://satip.readthedocs.io/
MIT License
41 stars 29 forks source link

Add Support for EUMETSAT Cloud Properties Dataset #265

Open jacobbieker opened 1 month ago

jacobbieker commented 1 month ago

It could be helpful to add processing cloud property archives from EUMETSAT, and adding them to the public dataset, if possible. Total size is currently ~70TB from 2004 to now.

Detailed Description

There is a ~1 week delayed archive of cloud properties dataset https://wui.cmsaf.eu/safira/action/viewDoiDetails?acronym=CLAAS_V002 that goes back the full archive, and has cloud optical depth, etc. at the native resolution of the EUMETSAT satellites.

Context

This can give much richer information about clouds vs cloud masks, and could be more helpful in forecasting clouds and their effects. It also would be then possible to train a model to predict the cloud properties from the live imagery, which could be quite helpful for short term forecasting.

Possible Implementation

Not sure if SatPy already supports this or not, but it is NetCDF files, so should be easy to open and collate into a Zarr.

jacobbieker commented 1 month ago

The data is available with just a simple sign up, with a limit of 1TB per order.

Plomo-02 commented 1 month ago

Hi, Jacob. I really wanna try to add this. Can I be assigned to this issue?

jacobbieker commented 1 week ago

Sorry for missing this, but yes!

Hi, Jacob. I really wanna try to add this. Can I be assigned to this issue?

jacobbieker commented 1 week ago

@Sukh-P This is the dataset that might be useful for cloud properties

Sukh-P commented 4 days ago

Thanks for this @jacobbieker! Just putting the link to the V3 version here as I think the slightly older V2 version was linked above https://wui.cmsaf.eu/safira/action/viewDoiDetails?acronym=CLAAS_V003