This PR updates the current patch files to conform to Horovod's new horovod/torch/optimizer.py structure. Tested and verified with Horovod 0.23.0 and PyTorch 1.7.1 on the new imagenet example (examples/torch/pytorch_imagenet_resnet50-grace.py).
I'm aware that the GRACE team is working on a cleaner way to integrate with Horovod (https://github.com/sands-lab/grace/issues/21), this is just to maintain support in the meantime.
This PR updates the current patch files to conform to Horovod's new
horovod/torch/optimizer.pystructure. Tested and verified with Horovod 0.23.0 and PyTorch 1.7.1 on the new imagenet example (examples/torch/pytorch_imagenet_resnet50-grace.py).I'm aware that the GRACE team is working on a cleaner way to integrate with Horovod (https://github.com/sands-lab/grace/issues/21), this is just to maintain support in the meantime.
Let me know if you have any questions or edits :)