Open s0mnus112 opened 3 months ago
It will not have any impact on the training process, but the performance of distributed training is better. Please note that training and inference should be consistent for whether distributed training is used.
Thank you very much for your answer!!! I will note that.
Hello!Thank you so much for your work I would like to ask is there any effect on removing distributed training from model training. Thank you!