openclimatefix / satflow

Satellite Optical Flow with machine learning models
https://satflow.readthedocs.io/en/stable/
MIT License
59 stars 11 forks source link

Try superresolution images #12

Open jacobbieker opened 3 years ago

jacobbieker commented 3 years ago

While having a network predict super-resolution images from just the geo satellite images is probably not helpful, as it would be making up data that does not exist there, one option that could be kinda cool and useful could be to have it create a super-resolution image using data that we do have in higher resolution. For example, while the sat images are roughly ~3km-4km resolution, we can get radar data at 1km resolution, and probably NWP at 1km resolution as well, so combining that data with the lower resolution images, and higher resolution images from other satellites, such as Sentinel or Landsat or something, could work? And would not just be a network extrapolating entirely from just the low resolution satellite image.

JackKelly commented 3 years ago

Love this idea!

And, just for completeness, I'll mention the crazy idea we discussed briefly last week: We should soon have access to realtime data from about 2,000 PV systems for the UK (about 1,000 from PVOutput.org plus another about 1,000 from PassivSystems). So, in some areas, we'll have PV systems that are quite close together. Conceivably, that might provide additional "high res" information for helping reconstruct the clouds. But, this is likely to be super-tricky to achieve in practice (because the PV data is spatially sparse and very noisy) but just wanted to park this idea here for us to revisit later, maybe :)