KoboldAI / KoboldAI-Client

For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp
https://koboldai.com
GNU Affero General Public License v3.0
3.46k stars 747 forks source link

Prompts that have too much tokens breaks and hangs application #346

Open SuperMasterBlasterLaser opened 1 year ago

SuperMasterBlasterLaser commented 1 year ago

Hello everyone. I want to report error that really makes frustrating experience.

When you enter memory and prompt with giant text then try to start it throws this error:

File "aiserver.py", line 4741, in calcsubmit
    subtxt, min, max = calcsubmitbudget(actionlen, winfo, mem, anotetxt, vars.actions, submission=txt)
File "aiserver.py", line 4669, in calcsubmitbudget
    assert len(tokens) <= vars.max_length - lnsp - vars.genamt - budget_deduction
AssertionError

The proplem is that this error does not apper on webui and just hangs with loading progress bar. This error does not allow me to resubmit prompt and forces me to restart web app, reload model and reimport prompts which is really frustrating.