按照示例运行报错

[zhihao-chen]

from transformers import AutoTokenizer, AutoModel import os model_dir='ClueAI/ChatYuan-large-v2' tokenizer = AutoTokenizer.from_pretrained(model_dir)

速度会受到网络影响，网络不好可以使用下面高级参数配置方式

model = AutoModel.from_pretrained(model_dir, trust_remote_code=True) history = [] print("starting") while True: query = input("\n用户：") if query == "stop": break if query == "clear": history = [] os.system('clear') continue response, history = model.chat(tokenizer, query, history=history) print(f"小元：{response}")

报错信息： 用户：你好 Traceback (most recent call last): File "/root/work2/work2/chenzhihao/llm_chatbot/examples/chatyuan_interact.py", line 79, in main() File "/root/work2/work2/chenzhihao/llm_chatbot/examples/chatyuan_interact.py", line 71, in main response = answer(query, context) File "/root/work2/work2/chenzhihao/llm_chatbot/examples/chatyuan_interact.py", line 52, in answer out = model.generate(*encoding, return_dict_in_generate=True, output_scores=False, max_new_tokens=1024, File "/root/anaconda3/envs/llm_chatbot-py39/lib/python3.9/site-packages/torch/autograd/grad_mode.py", line 27, in decorate_context return func(args, **kwargs) File "/root/anaconda3/envs/llm_chatbot-py39/lib/python3.9/site-packages/transformers/generation/utils.py", line 1437, in generate return self.sample( File "/root/anaconda3/envs/llm_chatbot-py39/lib/python3.9/site-packages/transformers/generation/utils.py", line 2479, in sample next_tokens = torch.multinomial(probs, num_samples=1).squeeze(1) RuntimeError: probability tensor contains either inf, nan or element < 0

[joytianya]

是不会环境版本不对 试试https://colab.research.google.com/drive/1ZcLIJuemiojigrfjbsDMBWrX7JqXZX6I?usp=sharing#scrollTo=lGnzjx0k_TDk

[zhihao-chen]

在提供的colab上能运行，但我的本地环境不行。 我的环境配置： transformers=4.26.1 pytorch=1.12.1+cu102 你们要求的环境是怎样的

[joytianya]

可能是版本不匹配，transformers低一点试试，也可以看看colab的环境配置

[zhihao-chen]

升级了torch版本后可以了。但项目主页写的，torch==1.7，transformer==4.26.1

[joytianya]

我们稍后改下

[huhk-sysu]

升级了torch版本后可以了。但项目主页写的，torch==1.7，transformer==4.26.1

你好，请问你升级到多少版本以后正常

[zhihao-chen]

我没有指定版本，默认升级到了最新