search

GaiZhenbiao / ChuanhuChatGPT

GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.
https://huggingface.co/spaces/JohnSmith9982/ChuanhuChatGPT
GNU General Public License v3.0
15.07k stars 2.28k forks source link

[本地部署]: chatglm2-6b本地模型无法使用，确认是在models/文件夹下 #1114

Open MoonShadow1976 opened 2 months ago

MoonShadow1976 commented 2 months ago

是否已存在现有反馈与解答？

是否是一个代理配置相关的疑问？

错误描述

ai提示说是值与MODEL_METADATA字典不匹配，但是并没有字符上的异常。

复现操作

正常部署，创建虚拟环境，git抓取并配置使用chatglm2-6b模型。 image

错误日志

Opening ChuanhuChatGPT...
venv "F:\APPLICATION\amaconda\envs\ChuanhuChat\Python.exe"
2024-05-06 23:31:39,573 [INFO] [_client.py:1026] HTTP Request: GET https://api.gradio.app/gradio-messaging/en "HTTP/1.1 200 OK"
2024-05-06 23:31:40,834 [INFO] [config.py:327] 默认模型设置为了：chatglm2-6b
2024-05-06 23:31:42,142 [INFO] [utils.py:148] Note: NumExpr detected 12 cores but "NUMEXPR_MAX_THREADS" not set, so enforcing safe limit of 8.
2024-05-06 23:31:42,143 [INFO] [utils.py:161] NumExpr defaulting to 8 threads.
Traceback (most recent call last):
  File "F:\CodeAPP\MapGBT\ChuanhuChatGPT\ChuanhuChatbot.py", line 204, in <module>
    value=i18n(MODEL_METADATA[MODELS[DEFAULT_MODEL]]["description"]),
KeyError: 'chatglm2-6b'

运行环境

- OS: windows 11 23H2
- Browser: edge
- Gradio version: 4.26.0
- Python version: 3.10.14

补充说明

cuda版本3.11