LTH14 / rcg

PyTorch implementation of RCG https://arxiv.org/abs/2312.03701
MIT License
785 stars 36 forks source link

Question about the moco-v3-large code. #26

Open xbyym opened 5 months ago

xbyym commented 5 months ago

Impressive work, thank you for sharing! I have now reproduced most of the experiments; additionally, I plan to fine-tune on a small-scale dataset. Could you provide the moco-v3-large code? I would be very grateful if you could help me!

LTH14 commented 5 months ago

Thanks for your interest! We included the architecture for moco-v3 large model here, and we also share the pre-trained weights on ImageNet (please see the README). To train moco v3, we follow this repo: the same training recipe as ViT-Base and ViT-Small.