search

Macielyoung / Bloom-Lora

Finetune Bloom big language model with Lora method
28 stars 2 forks source link

TypeError: init_process_group() got multiple values for keyword argument 'backend' #8

Open belle9217 opened 1 year ago

belle9217 commented 1 year ago

使用deepspeed --include=localhost:0,1 deepspeed_finetune_lora.py命令运行代码报错了

Macielyoung commented 1 year ago

transformers包的版本改一下，用4.28.1应该会有效。参考链接：https://github.com/LianjiaTech/BELLE/issues/226