search

facebookresearch / moco

PyTorch implementation of MoCo: https://arxiv.org/abs/1911.05722
MIT License
4.83k stars 794 forks source link

Training time #4

Closed chenwydj closed 4 years ago

chenwydj commented 4 years ago

On your side, how long it takes to train unsupervised pre-training of a ResNet-50 model on ImageNet in an 8-gpu machine for 800 epochs?

Thank you!

KaimingHe commented 4 years ago

53 hours per 200 epochs, so 800 epochs take 53 * 4 = 212 hours or ~9 days.