search

nlpxucan / WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
9.25k stars 716 forks source link

Questions about tokens limit #96

Open sunzx8 opened 1 year ago

sunzx8 commented 1 year ago

We meet an error 'list index out of range' while input question in local model, but it works well both on demo and text-generation webui, which is running the same code. I am very confused about it. I found that the answer will repeat the input question and it will also be counted in the token limits so as to raise error, But why does it work on webui or demo?

sunzx8 commented 1 year ago

I also find that the response from local machine will try to edit the input instruction but the webui won't, and if I ask the same question, the local model can always answer rightly but the webui won't, why will this happen?