Caiyun-AI / DCFormer

MIT License
185 stars 15 forks source link

How to use your dcmha in my vision_transformer.py #14

Open dwt0206 opened 6 days ago

dwt0206 commented 6 days ago

Hello author, you have inspired me a lot about the paper. Inside your abstract, you mentioned that DCMHA can be used as a direct replacement for MHA in any transformer architecture for the corresponding DCFormer, but I would like to know how this is a replacement?