How long does CLIP-VIP pretraining takes?

microsoft / XPretrain

Multi-modality pre-training

Other

467 stars 36 forks source link

How long does CLIP-VIP pretraining takes? #27

Open daizuozhuo opened 1 year ago

daizuozhuo commented 1 year ago

Paper states that "We train our model with 32 NVIDIA Tesla V100 GPUs in a batch size of 1024", but it doesn't tell how long the pretraining takes in this setting. Could you tell me the pretraining cost?

simanw304 commented 1 year ago

I have the same question. Curious how long it takes.