Open swaggy-TN opened 1 year ago
Please release the hyperparameters and code for the small datasets like Cifar and TinyImageNet.
Thanks for your attention. Actually there is nothing different among all datasets, we don't have special hyperparameters for small datasets. All you should do is loading the specific dataset that you want to finetune. If needed, the code will be released at a later time.
Thanks for your kind reply. In my case, I find it's really sensitive to lr and bsz so I thought it was crucial to have ideal hyperparameters. I will check if it's because of some bugs.
Please release the hyperparameters and code for the small datasets like Cifar and TinyImageNet.