20核cpu，32G内存，用cpu推理，加载Baichuan-7B-Chat的模型内存溢出

baichuan-inc / Baichuan2

A series of large language models developed by Baichuan Intelligent Technology

https://huggingface.co/baichuan-inc

Apache License 2.0

4.09k stars 295 forks source link

Open one-farmer opened 10 months ago

one-farmer commented 10 months ago

如题
微信图片_20240110173848

虚心求教各位大佬

wjaxx commented 10 months ago

同