This PR will fix this issue: https://github.com/ROCmSoftwarePlatform/apex/issues/106.
I have tested it on my dev node with rocm-5.4.0 and PyTorch 1.13.0a0+git941769a which means it should be backward compatible with not only PT 2.0 but also the older PT versions (PT 1.13+ at least).
This PR will fix this issue: https://github.com/ROCmSoftwarePlatform/apex/issues/106. I have tested it on my dev node with rocm-5.4.0 and PyTorch 1.13.0a0+git941769a which means it should be backward compatible with not only PT 2.0 but also the older PT versions (PT 1.13+ at least).