raoyongming / DynamicViT

[NeurIPS 2021] [T-PAMI] DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsification
https://dynamicvit.ivg-research.xyz/
MIT License
551 stars 69 forks source link

Question about the keep/drop token #48

Open King4819 opened 3 months ago

King4819 commented 3 months ago

Hi, I want to ask that in the paper, you mentioned that: index 0 corresponds to the probability of dropping token index 1 corresponds to the probability of keeping token

image

However, when I trace the code:

https://github.com/raoyongming/DynamicViT/blob/1322e626d1e9eca18cc150569908fb4af29e15f7/models/dyvit.py#L444

this line seems to indicate that index 0 is the score of keeping token, so I'm confused about the actual implementation in your work, Thanks !!!