search

open-mmlab / mmdetection

OpenMMLab Detection Toolbox and Benchmark
https://mmdetection.readthedocs.io
Apache License 2.0
28.71k stars 9.32k forks source link

BiMultiHeadAttention #11401

Open Chop1 opened 6 months ago

Chop1 commented 6 months ago

mmdetection implement BiMultiHeadAttention, used in grounding dino.

Why does this reimplement the whole multiheadatt ? Is this different that doing A B cross attention AB cross attention BA

as illustrated in the figure from the grounding dino paper? Sélection_168

hhaAndroid commented 6 months ago

@Chop1 We rely on the code as the reference. You can go and verify the code for confirmation. Thank you.