cyclomon / UNSB

Official Repository of "Unpaired Image-to-Image Translation via Neural Schrödinger Bridge" (ICLR 2024)
MIT License
154 stars 5 forks source link

Some issues in generation. #11

Closed DZRRRRRR closed 10 months ago

DZRRRRRR commented 10 months ago

image The UNSB project is quite impressive. During the actual code execution process, we used the code for underwater image translation experiments and noticed that several results exhibited flaws resembling "holes." Could you suggest possible improvements to address this issue? Thank you.

cyclomon commented 10 months ago

Hi, thank you for the comment

We have also experienced similar issues in natural scene dataset.

We do not know the exact reason for the artifact, but we can recommend several solutions

  1. Longer training time
  2. More downsampling & upsampling layer : If the network have to make large changes, using the bottleneck layer with lower resolution sometimes makes better results. As our basic network uses 2 down and upsampling layers, this might make some artifacts
  3. Using different weight for regularization loss
  4. Use patching sampling on vgg features instead of direct network features.

Best Regards, Gihyun Kwon