search

gligen / GLIGEN

Open-Set Grounded Text-to-Image Generation
MIT License
1.92k stars 144 forks source link

How Token Selection work in gated self attention? #5

Closed YJ-142150 closed 1 year ago

YJ-142150 commented 1 year ago

Thanks for your great work. It seems there are no description about token selection in gated_self_attention. Can I know how the operation works?

Yuheng-Li commented 1 year ago

https://github.com/gligen/GLIGEN/blob/master/ldm/modules/attention.py#L241

Simply select tokens corresponding to the visual tokens