microsoft / CodeBERT

CodeBERT
MIT License
2.19k stars 450 forks source link

How long does it take to train the code2nl model in the codebert folder? #297

Open ydteng opened 11 months ago

ydteng commented 11 months ago

I tried to reproduce it, but it had been running for a day on a Tesla K80 graphics card, and progress was extremely slow. The dataset is less than 1GB.

guoday commented 10 months ago

I am not sure how much time the training takes in K80. Even if the model is trained on 4 v100, it also needs to take about one day.