-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [X] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
By default Exllama V2 uses a batch of 2048 for prompt processing, which adds a ton of VRAM usage. On TabbyAPI and ExGUI it is possible to set the prompt processing batch to 1024 and 512. Those decreas…
-
Research local Large Language Models that can fit within 16GB VRAM, respond within 5 seconds (the less the better), and are available for commercial use. You will need to research both a back end to r…
-
```
ERROR:Failed to load the extension "edge_tts".
Traceback (most recent call last):
File "B:\text-generation-webui\modules\extensions.py", line 36, in load_extensions
exec(f"import extensi…
-
binary_path: C:\AIGC\MiniGPT-4\bitsandbytes-windows\bitsandbytes\cuda_setup\libbitsandbytes_cuda116.dll
CUDA SETUP: Loading binary C:\AIGC\MiniGPT-4\bitsandbytes-windows\bitsandbytes\cuda_setup\libbi…
-
Now that this proof-of-concept seems to be functional, is it about time to think about merging the changes upstream to respective repos?
`text-generation-webui` and `GPTQ` shouldn't be a problem be…
-
### 🐛 Describe the bug
When trying to add embedchain app in a flask project and running it on docker, I am getting the following error.
```
embedchain-server-1 | Traceback (most recent call la…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues and checked the recent builds/commits
### What happened?
I am seeing in ublock origin that the webui connects to c…
-
I installed it under wsl2 oobabooga on windows 10 and when I select a local model it gives and error "Git repository not found". It is a little cryptic what the problem is. I deleted the yaml file it …
-
I took the liberty of modifying the script because it didn't work for me. It's trivial to write for most people, but I remind all those who are beginners like me: on Text Generation WebUI you must act…