local_rank默认设置-1，在执行torch.distributed.get_rank()时报错：RuntimeError: Default process group has not been initialized, please make sure to call init_process_grroup. - Githubissues

liucongg / ChatGLM-Finetuning

基于ChatGLM-6B、ChatGLM2-6B、ChatGLM3-6B模型，进行下游具体任务微调，涉及Freeze、Lora、P-tuning、全参微调等

2.66k stars 294 forks source link

local_rank默认设置-1，在执行torch.distributed.get_rank()时报错：RuntimeError: Default process group has not been initialized, please make sure to call init_process_grroup. #135

Open dczhangii opened 9 months ago

ZzYAmbition commented 4 months ago

解决了吗，兄弟