Closed jsadu826 closed 2 weeks ago
Dear author, for ssl pretraining, I notice there is no validation code. How did you determine the training steps needed and how did you avoid overfitting?
I did not conduct validation in SSL pre-training. Since we got plenty of data for pre-training, I think overfitting would not be a big problem.
Dear author, for ssl pretraining, I notice there is no validation code. How did you determine the training steps needed and how did you avoid overfitting?