Question about calculation of absorption weight for target prompt

WangWenhao0716 / TransHP

[NeurIPS 2023] The official implementation of "TransHP: Image Classification with Hierarchical Prompting"

12 stars 0 forks source link

Question about calculation of absorption weight for target prompt #3

Closed Haifeng3 closed 4 months ago

Haifeng3 commented 4 months ago

TransHP is a great work! I have a small question: when calculating the absorption weight of the target prompt using the self-attention mechanism, is the value calculated the average absorption weight of all feature tokens? 1716956893988

WangWenhao0716 commented 4 months ago

Thanks for this insightful question. After checking, it seems that is correct. Since it has been quite a while (about 2 years) since I finished this paper, I am not pretty sure :)

Haifeng3 commented 4 months ago

thank you for your reply.