baichuan-inc / Baichuan2

A series of large language models developed by Baichuan Intelligent Technology
https://huggingface.co/baichuan-inc
Apache License 2.0
4.1k stars 297 forks source link

调用接口时CPU100% #388

Open liuzongyang255 opened 8 months ago

liuzongyang255 commented 8 months ago
image image

如图 这个是在使用CPU作答吗还是?

LiangYong1216 commented 8 months ago

加载完模型 .cuda()放到GPU上吧,你这好像确实在用cpu算