search

LeapLabTHU / Agent-Attention

Official repository of Agent Attention (ECCV2024)
473 stars 35 forks source link

Implementation based on ViT and DeiT #9

Closed BJFU-CS2012 closed 8 months ago

tian-qing001 commented 8 months ago

Hi @BJFU-CS2012, thank you for acknowledging our work, but I could not understand your question.

BJFU-CS2012 commented 8 months ago

Hi @BJFU-CS2012, thank you for acknowledging our work, but I could not understand your question.

sry about that. I want to apply agent_attention to the Transformer module in the VIT model, and I need to write my own code at the moment I don't know if you've had any previous work on this for reference.

tian-qing001 commented 8 months ago

Hello @BJFU-CS2012, we've implemented our agent attention in DeiT, which shares the same model structure as ViT. You can find the details in the agent_deit.py.

BJFU-CS2012 commented 8 months ago

Okay, thank you very much for your patience and good luck with your research!