search

NVIDIA / apex

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
BSD 3-Clause "New" or "Revised" License
8.34k stars 1.39k forks source link

AttributeError: module 'torch.distributed' has no attribute '_all_gather_base' #1671

Open HloveMM opened 1 year ago

HloveMM commented 1 year ago

my pytorch version is 1.7.1,CUDA version is 10.2,apex is 0.1version. how to solve this issue. Do I have to upgrade the pytorch version?

HloveMM commented 1 year ago

I have solved that. Just need to uninstall my old version apex, and copy these codes. But I didn't test it on other projects. For reference only.

git clone https://github.com/ptrblck/apex.git cd apex git checkout apex_no_distributed pip install -v --no-cache-dir ./