search

bosung / MTL-KGC

code for the paper 'Multi-Task Learning for Knowledge Graph Completion with Pre-trained Language Models' (COLING20).
Apache License 2.0
28 stars 12 forks source link

Error with DistributedSampler #1

Open vickyli99 opened 2 years ago

vickyli99 commented 2 years ago

Hi, I am trying to run your code but I have the issue with "Default process group has not been initialized, " RuntimeError: Default process group has not been initialized, please make sure to call init_process_group. I checked the initialization of DistribuedSampler and it looks fine to me, not sure what went wrong. Any help will be highly appreciated!

bosung commented 2 years ago

Hi, thanks for bringing this issue up. Have you tried -m torch.distributed.launch? You can use like this python -m torch.distributed.launch run_bert_multitask.py [options].

yys-1 commented 1 year ago

Hi, I am trying to run your code but I have the issue with "Default process group has not been initialized, " RuntimeError: Default process group has not been initialized, please make sure to call init_process_group. I checked the initialization of DistribuedSampler and it looks fine to me, not sure what went wrong. Any help will be highly appreciated请问您解决了吗，多卡训练的如何用单卡跑