-
After finish fintuning, I would like to set up the text-generation-webui server for text generation. But how to install monkeypatch?
Approach #1: pip install monkeypatch didn't work
```shell
❯…
-
Why am I getting these errors?
I installed DCNv3 in Docker via whl file. I want to avoid that error
python test.py err
-
Oobabooga/text-generation-webui - OpenAI API through plugin (https://docs.vllm.ai/en/latest/serving/openai_compatible_server.html)
ExLlamaV2 - OpenAI API (TabbyAPI)
GPT4ALL - OpenAI API
Llama.cpp -…
-
I wrote a quick script to load memories into the vector DB.
```
import re
import json
import pathlib
from extensions.long_term_memory.core.memory_database import LtmDatabase
# === Internal c…
-
### Describe the bug
Until `gradio==3.18.0`, I could do `demo.close()` for a `gr.Blocks()` interface.
In `gradio==3.23.0`, I get the error below every time. This error is not an exception that I…
-
Hello
can someone tell me where to put the chatgpt files for offline usage.
thanks in advance.
-
### Describe the bug
![image](https://github.com/oobabooga/text-generation-webui/ass…
-
I'm sorry if I am just blind and can't happen to find it, but I can not find the data format template used for training. I saw some references to "tool-llama-single-round" in the code (I thought that …
-
### Describe the bug
```
python webui.py
```
Just prints
```
Conda is not installed. Exiting...
```
And quit.
I opened up `webui.py` to see how it works. This line simply doesn't work…
-
I am trying to use the model llava-v1.6-mistral-7b-hf in the text-generation-webui demo, but I am getting errors. The last few lines of the error message read like:
/usr/local/lib/python3.10/dist…