Closed uloveqian2021 closed 1 year ago
您好,多卡跑baichuan2报错
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cuda:1!
多卡要用deepspeed,参考一下这个范例:https://github.com/xxm1668/chatglm2_lora/blob/main/train2.py
您好,多卡跑baichuan2报错