raspstephan / nwp-downscale

MIT License
38 stars 9 forks source link

Improve upscaling CNN #24

Open raspstephan opened 3 years ago

raspstephan commented 3 years ago

Following on from #12 we can now try to improve the upscaling CNN (i.e. with MSE instead of GAN loss). Here are a few ideas:

The goal should be to comprehensively beat a pure linear interpolation.

HirtM commented 3 years ago

@raspstephan, regarding the checkerboard pattern you mentioned, this video states that applying upsampling followed by a convolution reduces that problem:

https://www.coursera.org/learn/build-basic-generative-adversarial-networks-gans/lecture/H02dK/transposed-convolutions

But it seems, you are already doing that in your CNN, right? Here is also a more detailed discussion about the problem, but I haven't read it myself thoroughly. And it's also from 2016, so I don't know if it is really helpful.