mit-han-lab / anycost-gan

[CVPR 2021] Anycost GANs for Interactive Image Synthesis and Editing
https://hanlab.mit.edu/projects/anycost-gan/
MIT License
776 stars 98 forks source link

Using this tool for another LSUN dataset + model #19

Closed doctor-gonzo closed 2 years ago

doctor-gonzo commented 2 years ago

Hello! Thanks for creating this.

I am trying to use this tool with another model (the LSUN Churches dataset) with sliders that represent attributes.

As I understand it, these are the steps I need to take to configure this toolset to work with a different dataset + pre-trained network:

I am just wondering if there any obvious steps I am missing to get this working, I am very new to the world of GANs and toolsets. Thank you for your time 😊

tonylins commented 2 years ago

Hi, currently we only provide the encoder and editing directions for the FFHQ dataset. For other datasets like LSUN Church, you need to first train the generator on this dataset, and then train the encoder. Finally, you need to extract the editing directions (this might be tricky; for FFHQ we can use the supervised label from the CelebA dataset, while for LSUN Church, you may need to rely on some unsupervised method). Putting all these together, you might be able to make it work on the LSUN Church dataset.

MDGoncalves commented 2 years ago

Hello! First of all thank you so much for your contribution. I'm trying to apply this code to a different Dataset as well. You mentioned that for FFHQ you used the supervised label from the CelebA dataset, but could you tell us what did you used for the LSUN Car dataset?

tonylins commented 2 years ago

Hi, for the LSUN Car dataset, you may refer to some unsupervised methods for discovering editing directions like https://arxiv.org/abs/2004.02546.

MDGoncalves commented 2 years ago

Thank you very much for the reply! Will give it a try

tonylins commented 2 years ago

Close due to inactivity. Feel free to reopen.