A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
BSD 3-Clause "New" or "Revised" License
8.34k
stars
1.39k
forks
source link
get compatible with the latest `torch.distributed.distributed_c10d._coalescing_manager` #1660
Closed
crcrpar closed 1 year ago
I have some modifications to ensure backwards compatibility: https://github.com/timmoon10/apex/tree/contrib-optimizer/coalescing_manager It runs fine when I run with the 23.02 NGC container (PyTorch 1.14.0), but I haven't tried with the latest PyTorch yet.