search

xinntao / ESRGAN

ECCV18 Workshops - Enhanced SRGAN. Champion PIRM Challenge on Perceptual Super-Resolution. The training codes are in BasicSR.
https://github.com/xinntao/BasicSR
Apache License 2.0
6.05k stars 1.07k forks source link

White balance is affected #42

Open AndersMalmgren opened 5 years ago

AndersMalmgren commented 5 years ago

Hi, I did a quiick test for our game. The white balance of the image is affected by the upscale. Here I switch between the two. The upscale is 4 maps, one base color, one specular/glossness (alpha chanel processed seperate), normalmap and AO map.

https://www.youtube.com/watch?v=79Cy8jUOjRA

As you can see the white balance of the texture is affected

xinntao commented 5 years ago

What if test on images, will this problem still occur?

AndersMalmgren commented 5 years ago

Hi, as you can see here the white balance changes between orignal and upscale

Gif

xinntao commented 5 years ago

Yes, it indeed changes. Which model do you use? Do you use the interpolated model?

AndersMalmgren commented 5 years ago

I used the RRDB_ESRGAN_x4.pth model

xinntao commented 5 years ago

Maybe the statistics of the training datasets and the test images differ a lot. I do not observe an obvious color shift for natural colorful images, but for gray images, the color changes.

You may try: 1) use the color histogram to post-process the output images, letting the color histogram of the output matches the input one. 2) if you have enough data whose distribution similar to your testing images, you can do a simple finetuning on that datasets.