Yi-1.5-9B推理gpu利用率为0

[Jack-mi]

Reminder

• [X] I have read the README and searched the existing issues.

System Info

【llamafactory-cli】CUDA_VISIBLE_DEVICES=0,1,2,3,4,5,6,7 llamafactory-cli train config_infer.yaml
【config_infer.yaml】

Reproduction

【gpu利用率】

Expected behavior

No response

Others

No response

[Jack-mi]

只有0号卡在跑，其余利用率都为0

[hiyouga]

建议更新代码。

[Jack-mi]

我已经pull了最新的llamafactory，但还是利用率不平衡。或者是我的infer脚本有啥问题？你这也不说