IFU-master-2021-12-08 - Githubissues

ROCm / apex

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

BSD 3-Clause "New" or "Revised" License

19 stars 17 forks source link

IFU-master-2021-12-08 #64

Closed hubertlu-tw closed 2 years ago

hubertlu-tw commented 2 years ago

This PR includes the commits which remove THC code in Apex. Please refer to one of the commits in PyTorch which deprecated THC here. This PR has been tested locally on rocm/pytorch:rocm4.3.1_ubuntu18.04_py3.6_pytorch_1.8.1 and the latest PyTorch commit in ROCm IFU-master-2021-12-13 branch.

Conditionally skipping a unit test test_fused_layer_norm because torch.cuda.is_bfloat16_supported is not defined: https://github.com/ROCmSoftwarePlatform/apex/pull/64/commits/68364b49221d36099c8298709ecb7ea0876ca642

hubertlu-tw commented 2 years ago

jenkins: retest this please