mahmoudnafifi / HistoGAN

Reference code for the paper HistoGAN: Controlling Colors of GAN-Generated and Real Images via Color Histograms (CVPR 2021).
MIT License
267 stars 27 forks source link

Trained HistoGAN head for ReHistoGAN and Universal HistoGAN #3

Closed Werty18 closed 3 years ago

Werty18 commented 3 years ago

Hi. Great work. For ReHistoGAN, it has been mentioned in paper that the weights of head are initialized based on a previously trained HistoGAN. Have you tried training from the scratch and any observations (without skip connection and fine-tuning results are in paper)? And have you used the same trained HistoGAN head (trained on face images) for universal HistoGAN? Thanks.

mahmoudnafifi commented 3 years ago

Hi,

Thank you for your question.

I didn't train the HistoGAN head from scratch for domain-specific ReHistoGAN, but it was trained from scratch for the universal ReHistoGAN on 2 million images. Without skip connections, it couldn't get satisfying reconstruction. Keep in mind that I had some limitations in hardware, so maybe things could work in a different way with more capacity.