Closed hubertlu-tw closed 2 years ago
As the PR in PyTorch upstream for rocblas_gemm_flags_fp16_alt_impl (used in Apex MHA and MLP extensions) has renamed BackwardPassGuard to ROCmBackwardPassGuard, the changes in this PR can prevent the backward-breaking issues.
As the PR in PyTorch upstream for rocblas_gemm_flags_fp16_alt_impl (used in Apex MHA and MLP extensions) has renamed BackwardPassGuard to ROCmBackwardPassGuard, the changes in this PR can prevent the backward-breaking issues.