search

oobabooga / text-generation-webui

A Gradio web UI for Large Language Models.
GNU Affero General Public License v3.0
40.4k stars 5.3k forks source link

Restarting gets stuck if LLaVA(extension) is enabled. #1584

Closed LaaZa closed 1 year ago

LaaZa commented 1 year ago

Describe the bug

When trying to restart the webui from the "interface mode" tab it gets stuck at the reloading... message and there is no output in the log. It will only get stuck if LLaVA extension is loaded before restarting, it will work when enabling LLaVA during the restart. Does not matter what options are changed even disabling LLaVA will get it stuck.

Can happen for some other reason, but for me llava is one that triggers it.

Is there an existing issue for this?

Reproduction

  1. Have LLaVA extension enabled.
  2. Restart webui fron interface mode tab
  3. Stuck at reloading, no console output

Screenshot

No response

Logs

No output

System Info

WSL2 Ubuntu-22.04
GPTQ-for-LLaMA triton
RTX 3080 10 GB
Ryzen 5800X
24 GB RAM

webui c83210c
model: wojtab/llava-13b-v0-4bit-128g (fully on gpu)
Wojtab commented 1 year ago

I don't think it's llava, same thing happens for me without the extension

LaaZa commented 1 year ago

It did happen to me without llava at some point but I don't remember what it might have been.

github-actions[bot] commented 1 year ago

This issue has been closed due to inactivity for 6 weeks. If you believe it is still relevant, please leave a comment below. You can tag a developer in your comment.