Open hwopark opened 1 month ago
In the paper, the model was optimized using Adam on 8 NVIDIA 3090 GPUs with a batch size of 16. How many epochs are needed to achieve performance comparable to the released pre-trained checkpoint? and could you share how much time it will take?
Hi, @hwopark , We trained for about 15 epochs on all the data, and it took about 15 days to achieve the desired results.
In the paper, the model was optimized using Adam on 8 NVIDIA 3090 GPUs with a batch size of 16. How many epochs are needed to achieve performance comparable to the released pre-trained checkpoint? and could you share how much time it will take?