search

LTH14 / rcg

PyTorch implementation of RCG https://arxiv.org/abs/2312.03701
MIT License
785 stars 36 forks source link

RuntimeError #16

Open swayampragnya-malla opened 8 months ago

swayampragnya-malla commented 8 months ago

i am getting RuntimeError("Default process group has not been initialized, " RuntimeError: Default process group has not been initialized, please make sure to call init_process_group. issue while training MAGE and i am using only one gpu for training. error

LTH14 commented 8 months ago

Did you use DDP? The original code is designed for multi-GPU DDP and thus cannot work without DDP. You can follow the command in Readme and use DDP even with 1 GPU, by setting --nproc_per_node=1 --nnodes=1.

swayampragnya-malla commented 8 months ago

Thank you so much for your guide, now i can able to train and waiting for the result