search

tencent-ailab / IP-Adapter

The image prompt adapter is designed to enable a pretrained text-to-image diffusion model to generate images with image prompt.
Apache License 2.0
4.46k stars 289 forks source link

Why train AttnProcessor2_0 and IPAttnProcessor2_0 instead of only train IPAttnProcessor2_0? #358

Closed YoucanBaby closed 1 month ago

YoucanBaby commented 1 month ago

Dear author,

Thank you for your great work.

Why train AttnProcessor2_0 and IPAttnProcessor2_0 instead of only train IPAttnProcessor2_0? AttnProcessor2_0 is self-attn. IPAttnProcessor2_0 is cross-attn. But the paper says it only trains cross-attn.

Best wishes!

YoucanBaby commented 1 month ago

AttnProcessor2_0 is no parameters.