search

tencent-ailab / IP-Adapter

The image prompt adapter is designed to enable a pretrained text-to-image diffusion model to generate images with image prompt.
Apache License 2.0
4.46k stars 289 forks source link

Training UNET along IP_Adapter? #348

Open Bilal143260 opened 2 months ago

Bilal143260 commented 2 months ago

Thanks for the amazing work. I would like to know how can we train the unet as well alongside IP_Adapter?

xiaohu2015 commented 2 months ago

why do that?

Bilal143260 commented 2 months ago

I have trained Ip_Adapter with sdxl in-painting model on a very niche dataset. Results aren't that good so I want to retrain the network but this time with unet unfreezed.