search

InternLandMark / LandMark

Other
441 stars 39 forks source link

Warning,DDP #16

Closed ghd98522 closed 11 months ago

ghd98522 commented 1 year ago

I use 6 sheets of 3090 distributed training, does this warning have any impact? 1692080679106

zyfhaha commented 1 year ago

The reason for this warning is that we added the parameter "find_unused_parameters=True" to Pytorch DDP. As mentioned in the warning，we have flow control in model forwarding, so in some iterations, there will be no unused parameters. I think this warning don't have any impact.