YyzHarry / imbalanced-semi-self

[NeurIPS 2020] Semi-Supervision (Unlabeled Data) & Self-Supervision Improve Class-Imbalanced / Long-Tailed Learning
https://arxiv.org/abs/2006.07529
MIT License
735 stars 115 forks source link

moco on cifar dataset #19

Closed IssacCyj closed 9 months ago

IssacCyj commented 3 years ago

Thanks for the great repo!

I have a quick question, is there any specific reason not adding cifar&svhn datasets to the moco training script? like, it's not suitable or the performance is really bad on the small datasets?

Thanks!

YyzHarry commented 3 years ago

Hi, thanks for your interest!

We provided experiment results of MoCo on CIFAR in Appendix Table 9 of our paper. It could bring improvements over the baseline, but is not as much as using Rotation. My guess is that since MoCo needs a large number of (negative) samples to be effective, the smaller yet imbalanced datasets thus may not benefit much from MoCo, compared to those with larger size and more samples (such as ImageNet).