search

raoyongming / DenseCLIP

[CVPR 2022] DenseCLIP: Language-Guided Dense Prediction with Context-Aware Prompting
505 stars 38 forks source link

Misaligned params #27

Closed sfchen94 closed 1 year ago

sfchen94 commented 1 year ago

Hi, when I apply DenseCLIP to torch.nn.DataParallel for multi-GPUs training, the pretrained model can not load correctly, how can I fix this? (Single GPU training work well) image

raoyongming commented 1 year ago

Hi, thanks for your interest in our work. Our codebase is developed with DistributedDataParallel for multi-GPU training. Is that possible to try with DistributedDataParallel instead of DataParallel?

sfchen94 commented 1 year ago

Thanks for your reply. It is difficult to apply DDP with DP in my case currently. But I will try to seek a way to do that. And hope DenseCLIP can also train with DP later.