我设置了cuda:0，但是还是显示Expected all tensors to be on the same device, but found at least two devices, cuda:1 and cuda:0!

SCIR-HI / Huatuo-Llama-Med-Chinese

Repo for BenTsao [original name: HuaTuo (华驼)], Instruction-tuning Large Language Models with Chinese Medical Knowledge. 本草（原名：华驼）模型仓库，基于中文医学知识的大语言模型指令微调

Apache License 2.0

4.31k stars 422 forks source link

我设置了cuda:0，但是还是显示Expected all tensors to be on the same device, but found at least two devices, cuda:1 and cuda:0! #73

Closed handsomexiaoyi closed 9 months ago

handsomexiaoyi commented 10 months ago

在运行infer.sh文件时，遇到了错误

s65b40 commented 10 months ago

你好，建议尝试设置cuda环境，只让cuda0可见，应该可以解决这个问题

gggdroa commented 10 months ago

你好，建议尝试设置cuda环境，只让cuda0可见，应该可以解决这个问题

我创建了cuda环境指定到0 还是会报这样的错误，请问该修改哪个参数呢报错的地方并没有相关变量可以设置

gggdroa commented 10 months ago

在运行 infer.sh 文件时，遇到了错误

请问您解决了吗

handsomexiaoyi commented 10 months ago

在运行 infer.sh 文件时，遇到了错误

请问您解决了我在命令行加了一句，CUDA_VISIBLE_DEVICES='0' bash ./scripts/infer-literature-multi.sh

gggdroa commented 10 months ago

在运行 infer.sh 文件时，遇到了错误

请问您解决了我在命令行加了一句，CUDA_VISIBLE_DEVICES='0' bash ./scripts/infer-literature-multi.sh

感谢回复