X-D-Lab / LangChain-ChatGLM-Webui

基于LangChain和ChatGLM-6B等系列LLM的针对本地知识库的自动问答
Apache License 2.0
3.15k stars 475 forks source link

模型未成功重新加载,请点击重新加载模型 #36

Closed liningwangyi closed 1 year ago

liningwangyi commented 1 year ago

embedding_model_dict = { "ernie-base": "D:/AIL/workspace/LangChain-ChatGLM-Webui/models/ernie-3.0-base-zh", "simbert-base-chinese": "D:/AIL/workspace/LangChain-ChatGLM-Webui/models/simbert-base-chinese", "text2vec-base": "D:/AIL/workspace/LangChain-ChatGLM-Webui/models/text2vec-large-chinese"

}

llm_model_dict = { "ChatGLM-6B-int4": "D:/AIL/workspace/LangChain-ChatGLM-Webui/models/chatglm-6b-int4", "BELLE-LLaMA-7B-2M": "D:/AIL/workspace/LangChain-ChatGLM-Webui/models/BELLE-LLaMA-7B-2M" }

配置的绝对地址路径

thomas-yanxin commented 1 year ago

检查日志,看具体报错

liningwangyi commented 1 year ago

Explicitly passing a revision is encouraged when loading a model with custom code to ensure no malicious code has been contributed in a newer revision. No sentence-transformers model found with name D:/AIL/workspace/LangChain-ChatGLM-Webui/models/text2vec-large-chinese. Creating a new one with MEAN pooling. No sentence-transformers model found with name D:/AIL/workspace/LangChain-ChatGLM-Webui/models/text2vec-large-chinese. Creating a new one with MEAN pooling. Explicitly passing a revision is encouraged when loading a model with custom code to ensure no malicious code has been contributed in a newer revision.

liningwangyi commented 1 year ago

解决了,路径应该这么写 embedding_model_dict = { "ernie-base": "D:\AIL\workspace\LangChain-ChatGLM-Webui\models\ernie-3.0-base-zh", "simbert-base-chinese": "D:\AIL\workspace\LangChain-ChatGLM-Webui\models\simbert-base-chinese", "text2vec-base": "D:\AIL\workspace\LangChain-ChatGLM-Webui\models\text2vec-large-chinese" }

ccartermices commented 1 year ago

windows下的路径怎么选择?一直报错:

model config

embedding_model_dict = { "text2vec-base": "E:\langchain-chatGLM-webui\LangChain-ChatGLM-Webui\model_cache\GanymedeNil\text2vec-base-chinese", 'simbert-base-chinese': 'E:\langchain-chatGLM-webui\LangChain-ChatGLM-Webui\model_cache\WangZeJun\simbert-base-chinese', }

No sentence-transformers model found with name E:\langchain-chatGLM-webui\LangChain-ChatGLM-Webui\model_cache\WangZeJun\simbert-base-chinese. Creating a new one with MEAN pooling. No sentence-transformers model found with name E:\langchain-chatGLM-webui\LangChain-ChatGLM-Webui\model_cache\WangZeJun\simbert-base-chinese. Creating a new one with MEAN pooling. No sentence-transformers model found with name E:\langchain-chatGLM-webui\LangChain-ChatGLM-Webui\model_cache\WangZeJun\simbert-base-chinese. Creating a new one with MEAN pooling. No sentence-transformers model found with name E:\langchain-chatGLM-webui\LangChain-ChatGLM-Webui\model_cache\WangZeJun\simbert-base-chinese. Creating a new one with MEAN pooling.

thomas-yanxin commented 1 year ago

两个斜杠…

thomas-yanxin commented 1 year ago

image

ccartermices commented 1 year ago

还是不行 No sentence-transformers model found with name E:\langchain-chatGLM-webui\LangChain-ChatGLM-Webui\model_cache\GanymedeNil\text2vec-base-chinese. Creating a new one with MEAN pooling. $KBE(0MGSB@8Q}U{9}BACUT $P6M~YJ@RUD$A~@SOYM3@EG

thomas-yanxin commented 1 year ago

还是不行 No sentence-transformers model found with name E:\langchain-chatGLM-webui\LangChain-ChatGLM-Webui\model_cache\GanymedeNil\text2vec-base-chinese. Creating a new one with MEAN pooling. $KBE(0MGSB@8Q}U{9}BACUT $P6MYJ@RUD$A@SOYM3@EG

您发的那一串并不影响最终结果。

thomas-yanxin commented 1 year ago

还是不行 No sentence-transformers model found with name E:\langchain-chatGLM-webui\LangChain-ChatGLM-Webui\model_cache\GanymedeNil\text2vec-base-chinese. Creating a new one with MEAN pooling. $KBE(0MGSB@8Q}U{9}BACUT $P6MYJ@RUD$A@SOYM3@EG

您这里需要把init_llm改为ChatGLM-6b-int4

这里的逻辑解释在这:https://github.com/thomas-yanxin/LangChain-ChatGLM-Webui/issues/61#issuecomment-1564194790

ccartermices commented 1 year ago

改成int4了,但是还是不行: @X20@GRG W_1}_3%I0P1VTH

thomas-yanxin commented 1 year ago

改成int4了,但是还是不行: @X20@GRG W_1}_3%I0P1VTH

https://github.com/thomas-yanxin/LangChain-ChatGLM-Webui/issues/69#issuecomment-1572247002