Closed BJFU-CS2012 closed 8 months ago
Hi @BJFU-CS2012, thank you for acknowledging our work, but I could not understand your question.
sry about that. I want to apply agent_attention to the Transformer module in the VIT model, and I need to write my own code at the moment I don't know if you've had any previous work on this for reference.
Hello @BJFU-CS2012, we've implemented our agent attention in DeiT, which shares the same model structure as ViT. You can find the details in the agent_deit.py.
Okay, thank you very much for your patience and good luck with your research!
Hi @BJFU-CS2012, thank you for acknowledging our work, but I could not understand your question.