Open glistering96 opened 1 year ago
Will be good to be implemented
Refer to this:
https://medium.com/huggingface/training-larger-batches-practical-tips-on-1-gpu-multi-gpu-distributed-setups-ec88c3e51255
Will be good to be implemented