search

youweiliang / evit

Python code for ICLR 2022 spotlight paper EViT: Expediting Vision Transformers via Token Reorganizations
Apache License 2.0
169 stars 19 forks source link

EViT-DeiT-S Finetune-30 Reproduce #9

Open BWLONG opened 2 years ago

BWLONG commented 2 years ago

Thanks for your open source work.

image

Following the finetune.sh configuration, I just use the batch_size of 8x256=2048, but the accuracy is only 79.35%.

youweiliang commented 2 years ago

Hi, which checkpoint did you use for finetuning? Did you modify any hyperparameters? I checked it twice for reproducibility and there should be no problem in getting 79.5% accuracy.

BWLONG commented 2 years ago

I used the batch_size of 8x256=2048 and the checkpoint=deit_small_patch16_224-cd65a155.pth , the other hyperparameters followed the finetune.sh configuration.