youweiliang / evit

Python code for ICLR 2022 spotlight paper EViT: Expediting Vision Transformers via Token Reorganizations
Apache License 2.0
162 stars 19 forks source link

When to start fusing image patches #17

Open Bugs-Bunny01 opened 1 year ago

Bugs-Bunny01 commented 1 year ago

hi, I now have a question, do you start to fuse image blocks from the first epoch, will there be a large error

youweiliang commented 1 year ago

Hi, Thanks for your interest. It is fine to start to fuse image tokens from the first epoch, as we didn't see an accuracy drop after doing so.