jkpark0825 / CAL_GAN

Apache License 2.0
14 stars 0 forks source link

Does it support DDP? #6

Open Magauiya opened 1 month ago

Magauiya commented 1 month ago

Dear authors,

Thank you for sharing the code. In the paper, you have mentioned that the Cal-GAN is trained using 4 GPUs and in the repo you kindly provided multigpu training instructions. However, I have faced several issues starting from Batch Norm layer, which does not support DDP as it is. By replacing the BatchNorm with SyncBatchNorm, I was able to launch dataparallel scheme, but the GPU utilization is very low (1-2%). So, my questions are:

Thank you!

ButoneDream commented 3 weeks ago

when i use ddp . it report an error . do you solve it ? 3q for your help