Closed WenM1222 closed 2 years ago
Training time for synthetic data is around 2 days for 25 epochs. For real finetuning, the training should run for a couple hours for a few epochs (1-5)
Closing due to inactivity!
Hi, @zubair-irshad Thanks for amazing work,
May I ask the detail about your hardware? How many GPUs did you use to train? And how many GPU memories?
I guess the dataset is so large 800GB... it will take more time with only one GPU.
Thanks for sharing your great works! May I know how much time the training took?