THUDM / ChatGLM3

ChatGLM3 series: Open Bilingual Chat LLMs | 开源双语对话语言模型

Apache License 2.0

13.19k stars 1.52k forks source link

bug when running inference_hf.py after finetuning with lora. #1243

Open RemiAlliah opened 2 months ago

RemiAlliah commented 2 months ago

System Info / 系統信息

torch: 2.3.0+cu121 transformers: 4.40.0 python: 3.10 os: win10

Who can help? / 谁可以帮助到您？

No response

Information / 问题信息

[ ] The official example scripts / 官方的示例脚本
[ ] My own modified scripts / 我自己修改的脚本和任务

Reproduction / 复现过程

1.python .\inference_hf.py .\output\isign\checkpoint-3000\ --prompt "今天"周几"

Expected behavior / 期待表现

希望可以顺利跑完推理

daihuaiii commented 7 hours ago

1300

参考