Open wangshankun opened 2 years ago
For single device, maybe you don't need allreduce @wangshankun.
For single device, maybe you don't need allreduce @wangshankun.
OK,But how to remove allreduce when only have one gpu card?
Just delete this line or note it when world_size <= 1 @wangshankun
have you solved this problem?
单机train的时候当指令ng=1,不论是train还是test都会遇到同样的error;
当 --ng=1的时候出现Error:“`........please make sure to call init_process_group”