vturrisi / solo-learn

solo-learn: a library of self-supervised methods for visual representation learning powered by Pytorch Lightning
MIT License
1.39k stars 181 forks source link

Results of Cifar-100 are linear offline? #336

Closed kkokilep closed 1 year ago

kkokilep commented 1 year ago

Thank you for answering my questions and thanks for the great repository!

In the table that you all made for Cifar100 on this repo, is the result shown the performance after offline fine-tuning with a linear layer (standard way done in papers) or the accuracy when doing online linear evaluation?

DonkeyShot21 commented 1 year ago

For cifar100 we used online evaluation because it worked a bit better than offline. Nonetheless, by tuning the offline evaluation you should be able to obtain the same performance. Methodologically, online and offline evals are exactly the same, because the backbone features are detached before being fed to the linear classifier.