ymcui / Chinese-LLaMA-Alpaca

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
https://github.com/ymcui/Chinese-LLaMA-Alpaca/wiki
Apache License 2.0
17.98k stars 1.84k forks source link

在运行scripts/inference/inference_hf.py时,在seq_len> self.max_seq_len_cached部分,会出现RuntimeError: Boolean value of Tensor with more than one value is ambiguous #897

Closed WWWWWWLLLL closed 1 month ago

WWWWWWLLLL commented 1 month ago

提交前必须检查以下项目

问题类型

模型推理

基础模型

LLaMA-7B

操作系统

Linux

详细描述问题

No response

依赖情况(代码类问题务必提供)

# 请在此处粘贴依赖情况

运行日志或截图

# 请在此处粘贴运行日志
github-actions[bot] commented 1 month ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your consideration.

github-actions[bot] commented 1 month ago

Closing the issue, since no updates observed. Feel free to re-open if you need any further assistance.