SatelliteShorelines / CoastSeg

An interactive toolbox for downloading satellite imagery, applying image segmentation models, mapping shoreline positions and more. The mapping extension for CoastSat and Zoo.
https://satelliteshorelines.github.io/CoastSeg/
GNU General Public License v3.0
46 stars 9 forks source link

Super Resolution with Hugging Face Models #127

Open 2320sharon opened 1 year ago

2320sharon commented 1 year ago

Super Resolution with Hugging Face Models

Replace pan sharpening with a super resolution model from hugging face. These models would not require a GPU as they run on inference mode which only requires a CPU to run.

Basic Workflow

  1. Download the model weights if they don't exist locally
  2. Apply the model to the imagery

From what I understand the super resolution AI increases the number of pixels in the image meaning the process of extracting shorelines will not be impacting as no spatial information will be lost. Is this correct @dbuscombe-usgs or am I misunderstanding something

dbuscombe-usgs commented 1 year ago

Here's a (bad) example I put together a while back https://huggingface.co/spaces/dbuscombe/SatelliteSuperResolution

dbuscombe-usgs commented 1 year ago

Another potential option:https://huggingface.co/CompVis/ldm-super-resolution-4x-openimages

dbuscombe-usgs commented 1 year ago

This is a v2 feature request