dongzelian / SSF

[NeurIPS'22] This is an official implementation for "Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuning".
https://arxiv.org/pdf/2210.08823.pdf
MIT License
172 stars 12 forks source link

Performance of VTAB-DTD #13

Open RaptorMai opened 1 year ago

RaptorMai commented 1 year ago

Thank you so much for sharing the code. I tried running train_scripts/vit/vtab/dtd/train_ssf.sh and found that the result could not match the number on the paper. At the end of the 100 epoch, the top 1 accuracy is 67.44 instead of 75.1 reported on the paper. I can reproduce the performance of most of the VTAB datasets. I'm curious if I missed anything for DTD or if there are mistakes in the training script for DTD. Thank you so much again and I look forward to hearing back from you.