Training of Ip_adpter_sdxl with ip_adapter_plus

tencent-ailab / IP-Adapter

The image prompt adapter is designed to enable a pretrained text-to-image diffusion model to generate images with image prompt.

Apache License 2.0

4.48k stars 293 forks source link

Training of Ip_adpter_sdxl with ip_adapter_plus #323

Open Bilal143260 opened 3 months ago

Bilal143260 commented 3 months ago

Thank you for this amazing project. I want to train ip adapter sdxl but I want to use ip adapter plus. What modifications do I have to make in tutorial_train_sdxl.py? Is it just the number of tokens to query from the CLIP image encoding?

regards

xiaohu2015 commented 3 months ago

you can follow https://github.com/tencent-ailab/IP-Adapter/blob/main/tutorial_train_plus.py