lllyasviel / ControlNet

Let us control diffusion models!
Apache License 2.0
29.14k stars 2.63k forks source link

Finetune the Autoencoder #292

Open liuzhihui2046 opened 1 year ago

liuzhihui2046 commented 1 year ago

Hello, thank you for your work. As the current autoencoder is not very consistent with my existing data, I would like to fine-tune the encoder and decoder based on this. However, I cannot find the corresponding training configuration, especially for the loss configuration. Could you please provide me with some help? Thank you very much!

YihanHu-2022 commented 1 year ago

For the finetuning of autoencoder you can refer to the settings of "Latent Diffusion Model" (https://github.com/CompVis/latent-diffusion)

GISStd commented 8 months ago

I meet the same question,how do you deal with it