microsoft / GLIP

Grounded Language-Image Pre-training
MIT License
2.07k stars 186 forks source link

About BiMultiHeadAttention #166

Open kanuore opened 3 months ago

kanuore commented 3 months ago

Hello @liunian-harold-li , there are difficulties in understanding the BiMultiHeadAttention module implemented in the code. May I ask what the implementation principle is and if there are any reference materials available?