mmz-001 / knowledge_gpt

Accurate answers and instant citations for your documents.
https://knowledgegpt.streamlit.app/
MIT License
1.58k stars 729 forks source link

This model's maximum context length is 4097 tokens, however you requested 7203 tokens (6947 in your prompt; 256 for the completion). Please reduce your prompt; or completion length. #15

Closed hujili007 closed 1 year ago

hujili007 commented 1 year ago

I uploaded a Chinese txt file(zy.txt). Input chinese prompt: “什么是精气学说” input english prompt:"What is the concept of Jingqi theory", Whether inputting Chinese or English, the following errors will always occur: This model's maximum context length is 4097 tokens, however you requested 7203 tokens (6947 in your prompt; 256 for the completion). Please reduce your prompt; or completion length. zy.txt

ScottishFold007 commented 1 year ago

I uploaded a Chinese txt file(zy.txt). Input chinese prompt: “什么是精气学说” input english prompt:"What is the concept of Jingqi theory", Whether inputting Chinese or English, the following errors will always occur: This model's maximum context length is 4097 tokens, however you requested 7203 tokens (6947 in your prompt; 256 for the completion). Please reduce your prompt; or completion length. zy.txt

就是你的输入长了,考虑检索器那块用本地的吧,答案生成再用线上接口

chinesewebman commented 1 year ago

这是通病了。不是输入长,是本地搜到的内容太多,因为这个工具对中文支持差一些。可以试试先用中文分词工具分好了再上传。如果还有问题那就得...换一个应用了。DocsGPT刚修复了这个问题不久。

new4u commented 1 year ago

DocsGPT刚修复了这个问题不久。

现在最新版本修复了吗?需要更新那一块代码?求助