oobabooga / text-generation-webui

A Gradio web UI for Large Language Models.
GNU Affero General Public License v3.0
40.25k stars 5.28k forks source link

--api flag not generating api link, the value passed into gr.Dropdown() is not in the list of choices #4624

Closed wonkers27 closed 9 months ago

wonkers27 commented 11 months ago

Describe the bug

I want to use the --api flag to generate a secondary link that I could use with something like Tavern.AI, but every time I add the --api or the --public-api flag (via the webui and restart, not the command prompt, although that doesn't seem to work either) it doesn't do anything but spit out a series of errors at me. I'm on windows 10 and have a Nvidia RTX 3060

Is there an existing issue for this?

Reproduction

run the start_windows.bat, open the webui, head to the session tab and add api under Boolean command-line flags, click Apply flags/extensions and restart.

Screenshot

C__Windows_system32_cmd exe 2023-11-16 2_56_49 PM

Logs

Closing server running on port: 7860
2023-11-16 14:49:06 INFO:Loading the extension "gallery"...
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
C:\Users\willr\Documents\AI\OOBABOOGA\text-generation-webui\installer_files\env\Lib\site-packages\gradio\components\dropdown.py:231: UserWarning: The value passed into gr.Dropdown() is not in the list of choices. Please update the list of choices to include: 4 or set allow_custom_value=True.
  warnings.warn(
C:\Users\willr\Documents\AI\OOBABOOGA\text-generation-webui\installer_files\env\Lib\site-packages\gradio\components\dropdown.py:231: UserWarning: The value passed into gr.Dropdown() is not in the list of choices. Please update the list of choices to include: 128 or set allow_custom_value=True.
  warnings.warn(
C:\Users\willr\Documents\AI\OOBABOOGA\text-generation-webui\installer_files\env\Lib\site-packages\gradio\components\dropdown.py:231: UserWarning: The value passed into gr.Dropdown() is not in the list of choices. Please update the list of choices to include: llama or set allow_custom_value=True.
  warnings.warn(

System Info

OS: Windows 10
GPU Brand: NVIDIA
GPU: GeForce RTX 3060 Laptop GPU
AManNamed2 commented 11 months ago

also getting this now, fresh install too. Rip

Samogub commented 11 months ago

same problem...

github-actions[bot] commented 9 months ago

This issue has been closed due to inactivity for 6 weeks. If you believe it is still relevant, please leave a comment below. You can tag a developer in your comment.