microsoft / GLIP

Grounded Language-Image Pre-training
MIT License
2.24k stars 193 forks source link

About BiMultiHeadAttention #166

Open kanuore opened 8 months ago

kanuore commented 8 months ago

Hello @liunian-harold-li , there are difficulties in understanding the BiMultiHeadAttention module implemented in the code. May I ask what the implementation principle is and if there are any reference materials available?