search

EvgenyKashin / stylegan2-distillation

https://arxiv.org/abs/2003.03581
Other
1.01k stars 105 forks source link

What is this noise in the generated images? #18

Closed 0x454447415244 closed 3 years ago

0x454447415244 commented 3 years ago

What is this noise in the generated images (the dark circular area)? How to remove it?

epoch080_synthesized_image epoch096_synthesized_image epoch104_synthesized_image epoch081_synthesized_image

EvgenyKashin commented 3 years ago

It's well known pix2pixHD's artefacts, you could look at https://github.com/NVIDIA/pix2pixHD/issues/46

How to remove it?

You could try a different image2image model for the distillation, for example SPADE

0x454447415244 commented 3 years ago

Thanks. I will look into that. As far as I know, SPADE doesn't support image-to-image translation.

8secz-johndpope commented 3 years ago

Nvidia labs solved this with stylegan2-ada https://github.com/nvlabs/stylegan2-ada pytorch version coming soon.

To get this code working with stylegan2-ada is trivial - just need to drop in the dnnlib folder

Here's some video discussing noise. https://youtu.be/7eEom1X1thA?t=365

I built an updated tensorflow2 compatibility mode fork here - https://github.com/johndpope/stylegan2-ada

EvgenyKashin commented 3 years ago

Thanks @8secz-johndpope !

AugustLee93 commented 2 years ago

Thanks. I will look into that. As far as I know, SPADE doesn't support image-to-image translation.

Same issue occures on my model for pix2pixHD, do you have any idea how to solve it ? Or do you have a better image2image model to recommend? Any helps will be appreciated! Thanks

EvgenyKashin commented 2 years ago

Hey, you could check TSIT repo