search

jiasenlu / vilbert_beta

473 stars 96 forks source link

what is the amount of time to pretrain the whole model? #49

Open junchen14 opened 4 years ago

junchen14 commented 4 years ago

Hi I prepare to pretrain a similar model, but I am not sure how much resources does it require. could you kindly let me know what type/how many gpus do you use and how long did you spend on pretraining?