search

ROCm / apex

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
BSD 3-Clause "New" or "Revised" License
17 stars 14 forks source link

Add FusedLARS optimizer #108

Closed hubertlu-tw closed 1 year ago

hubertlu-tw commented 1 year ago

This PR is to add FusedLARS on behalf of @luise1030. ref: https://arxiv.org/abs/1708.03888