加载8bit量化/离线量化模型报错：RuntimeError: probability tensor contains either inf, nan or element < 0 - Githubissues

baichuan-inc / Baichuan2

A series of large language models developed by Baichuan Intelligent Technology

https://huggingface.co/baichuan-inc

Apache License 2.0

4.03k stars 289 forks source link

加载8bit量化/离线量化模型报错：RuntimeError: probability tensor contains either inf, nan or element < 0 #328

Open jiaweiLL opened 6 months ago