search

oobabooga / text-generation-webui

A Gradio web UI for Large Language Models.
GNU Affero General Public License v3.0
40.25k stars 5.28k forks source link

infinite generation #4437

Closed etozherstk closed 10 months ago

etozherstk commented 11 months ago

Describe the bug

when trying to use any model, i get the next message in cmd after trying to talk to the character. no, i dont get any answer from the characters, and the generation never ends

Is there an existing issue for this?

Reproduction

load the model write any message to ai

get an error, and no answer from ai

Screenshot

image image

Logs

2023-11-01 13:00:29 INFO:Loading the extension "gallery"...
2023-11-01 13:00:36 INFO:Streaming API URL:

ws://127.0.0.1:5005/api/v1/stream

2023-11-01 13:00:36 INFO:Blocking API URL:

http://127.0.0.1:5000/api

J:\text-generation-webui-main\installer_files\env\Lib\site-packages\gradio\components\dropdown.py:231: UserWarning: The value passed into gr.Dropdown() is not in the list of choices. Please update the list of choices to include: llama or set allow_custom_value=True.
  warnings.warn(
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
127.0.0.1 - - [01/Nov/2023 13:03:31] "GET /api/v1/model HTTP/1.1" 200 -
J:\text-generation-webui-main\installer_files\env\Lib\site-packages\gradio\components\dropdown.py:231: UserWarning: The value passed into gr.Dropdown() is not in the list of choices. Please update the list of choices to include: 4 or set allow_custom_value=True.
  warnings.warn(
J:\text-generation-webui-main\installer_files\env\Lib\site-packages\gradio\components\dropdown.py:231: UserWarning: The value passed into gr.Dropdown() is not in the list of choices. Please update the list of choices to include: 128 or set allow_custom_value=True.
  warnings.warn(
J:\text-generation-webui-main\installer_files\env\Lib\site-packages\gradio\components\dropdown.py:231: UserWarning: The value passed into gr.Dropdown() is not in the list of choices. Please update the list of choices to include: llama or set allow_custom_value=True.
  warnings.warn(
127.0.0.1 - - [01/Nov/2023 13:03:41] "POST /api/v1/generate HTTP/1.1" 200 -

System Info

i5
1050 Ti
github-actions[bot] commented 10 months ago

This issue has been closed due to inactivity for 6 weeks. If you believe it is still relevant, please leave a comment below. You can tag a developer in your comment.