search

chmxu / eTT_TMLR2022

20 stars 2 forks source link

some hyperparameter detail problem in the code #2

Closed pyjnqd closed 1 year ago

pyjnqd commented 1 year ago

hello, it's a fantastic work which achieve a ViT-applied adapter. It can expand adapter method from Resnet to ViT-like network. Could you provide some suggestions on how to choose a good learning rate with adam/adamw? Also, I wanna know how the hyperparameters in code you get. Appreciate your efforts on it.

chmxu commented 1 year ago

Hi, the learning rate settings are given in my code and are tuned via validation. Can you provide your reproduced results so that I can check if there are any problems in the current version?

pyjnqd commented 1 year ago

Sorry, the abnormal results is invalid because of my fault when I run the codes, Now it performs better and reasonably. Thanks for your reply. Happy weekend.