Algolzw / image-restoration-sde

Image Restoration with Mean-Reverting Stochastic Differential Equations, ICML 2023. Winning solution of the NTIRE 2023 Image Shadow Removal Challenge.
https://algolzw.github.io/ir-sde/index.html
MIT License
580 stars 42 forks source link

Latent-Refusion v.s. Refusion #85

Open MU-MU-M opened 6 months ago

MU-MU-M commented 6 months ago

Hi, I've only seen the code for refusion but no code for latent-refusion. Are there the codes for latent-refusion and the latent-refusion pretrained model in this package? Also, I have no idea about the model architecture of latent-refusion. Is latent-refusion just pretrained autoencoder + NAFNet? On the other hand, I mainly want to focus on deblurring application, but there is only ir-sde pretrained model and no refusion pretrained model for deblurring in this package.

Thanks.

Algolzw commented 6 months ago

Hi, the latent-refusion code is the latent-unet. If you want to perform latent-refusion on the deblurring task, you need to pretrain the latent-unet (U-Net autoencoder) on your dataset. Please refer to the latent-dehazing for more details.

MU-MU-M commented 6 months ago

Are both the training flow and inference flow of the latent-unet for deblurring application the same as latent-unet for dehazing? That is to say for deblurring, do we need to compute latent_lq, latent_gt, hidden_lq, and hidden_gt? But here is a question, when performing inference without ground truth (since actual deblur has no ground truth), how should I perform latent-unet testing?

Thanks.

Algolzw commented 6 months ago

In inference, we don't need the latent_gt and hidden_gt, you can just set them to None.