search

sihyun-yu / PVDM

Official PyTorch implementation of Video Probabilistic Diffusion Models in Projected Latent Space (CVPR 2023).
https://sihyun.me/PVDM
MIT License
299 stars 15 forks source link

torch.nn.parallel.DistributedDataParallel #33

Open TousenKaname opened 11 months ago

TousenKaname commented 11 months ago

Excellent work! : ) But I got a bug. When I use the multi-GPU run the first_stage code, my code was block up at this line. I find the issue is induced by model desynchronization. criterion = torch.nn.parallel.DistributedDataParallel(criterion, device_ids=[device], broadcast_buffers=False, find_unused_parameters=True)