推理时怎么指定用哪几张卡

ssbuild / chatglm_finetuning

chatglm 6b finetuning and alpaca finetuning

1.53k stars 175 forks source link

Closed tjulh closed 1 year ago

tjulh commented 1 year ago

跑lora的推理代码时，默认用的第一张卡，怎么指定用其他卡呢，代码是最新的

ssbuild commented 1 year ago

device = 2 pl_model.eval().half().cuda(device)

tjulh commented 1 year ago

device = 2 pl_model.eval().half().cuda(device)

感谢感谢