Open zhangdan8962 opened 3 years ago
Hi,
I realize that you loaded pre-trained model before DDP constructor. I am wondering if there is any specific consideration for doing so, rather than after DDP constructor?
Thank you in advance!
Hi,
I realize that you loaded pre-trained model before DDP constructor. I am wondering if there is any specific consideration for doing so, rather than after DDP constructor?
Thank you in advance!