How to tansfer "nccl" to "gloo"?

AntixK / PyTorch-VAE

A Collection of Variational Autoencoders (VAE) in PyTorch.

Apache License 2.0

6.44k stars 1.05k forks source link

How to tansfer "nccl" to "gloo"? #73

Open XinyiZhang0724 opened 1 year ago

XinyiZhang0724 commented 1 year ago

Hello, I run it on Windows. How can I tansfer "nccl" to "gloo"?

XinyiZhang0724 commented 1 year ago

erro: Distributed package doesn't have NCCL built in

TenchuBlossom commented 1 year ago

I managed to get this working after receiving the same issue. I add this line os.environ["PL_TORCH_DISTRIBUTED_BACKEND"] = "gloo" at the top of the run.py file. Then I removed strategy parameter from line 53 of run.py file strategy=DDPPlugin(find_unused_parameters=False). Seems DDPPlugin doesn't support gloo, please someone correct me if wrong on this.