search

ROCm / apex

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
BSD 3-Clause "New" or "Revised" License
17 stars 14 forks source link

Add FusedLARS optimizer #109

Closed luise1030 closed 1 year ago

luise1030 commented 1 year ago

ref: https://arxiv.org/abs/1708.03888