Closed keertika-11 closed 1 year ago
@keertika-11 nothing wrong with the model, has been tested. I can't get into detail debugging other's train scripts or hparams, but you LR is 1-2 orders of magnitude too large for that batch size and I'd never train these models without gradient clipping. Moving to dicussions in case anyone else has suggestions as this isn't a bug...
Hi, I am retraining the eva2mim model, but the model is not converging, I get 0% test Accuracy To Reproduce
what am i doing wrong?
1.0.221_cudnn8.0.3_0]
Desktop (please complete the following information):