THUDM / ChatGLM3

ChatGLM3 series: Open Bilingual Chat LLMs | 开源双语对话语言模型
Apache License 2.0
13.5k stars 1.57k forks source link

Loading checkpoint shards: 0%| 进度始终为0 无法加载 #1317

Closed YourFau1t closed 2 months ago

YourFau1t commented 3 months ago

streamlit run main.py之后如下输出: Setting eos_token is not supported, use the default one. Setting pad_token is not supported, use the default one. Setting unk_token is not supported, use the default one. Loading checkpoint shards: 0%| | 0/7 [00:00<?, ?it/s] PS D:\ChatGLM3\ChatGLM3-main\composite_demo> 自己就结束了 是什么问题 MODEL_PATH已经修改过了 跪求大佬解答orz

YourFau1t commented 3 months ago

已解决 由于本人显存过低只有8G,在量化的时候仅仅只修改了basic_demo里的代码, 未修改client.py的model代码,添加完毕后可以正常loaing并启动