-
I've seen the struggles with flash attention and was wondering if some of these pre-built wheels would work. They help a ton on Windows because flash retention on Windows is a struggle.
I first saw t…
-
### Describe the bug
There is an issue with textgen when trying to unload a superboogav2 database. Creating a database works, but unloading does not.
To fix this the following changes need to be …
-
### Describe the bug
llamacpp doesn't see radeon rx6900xt, previous version worked fine, it seems it has missing dependencies (rocm 5.7.1 is installed)
in particular llama_cpp_cuda can not be import…
pl752 updated
3 months ago
-
### Describe the bug
When i load my model and try to user it get a error
13:41:11-717356 INFO Saved "I:\programming\text-generation-webui\presets\My Preset.yaml".
I:\programming\text-generat…
-
### Question
I downloaded llava-llama-2-13b from:
https://huggingface.co/liuhaotian/llava-llama-2-13b-chat-lightning-preview
Then I've quantized the model to 4-bit using .
```
git clone htt…
-
### System Info / 系統信息
Cuda 12.5
Trasnformers 4.41.2
Python 3.12
Ubuntu 22.04
### Who can help? / 谁可以帮助到您？
_No response_
### Information / 问题信息
- [X] The official example scripts / 官方的示例脚本
- […
-
When i select hindi from language section and press on generate i get the following error message -
Using ready reference
Using folder reference
None test
C:\Tools\xtts-webui\temp\resampled_audio…
-
### Describe the bug
working on windows
I create a person Вика Бокс - russin language
FileNotFoundError: [WinError 3] Системе не удается найти указанный путь: 'logs\\chat\\Вика Бокс '
FileNotFoun…
-
### Describe the bug
After downloading a model I try to load it but I get this message on the console:
Exception: Cannot import 'llama-cpp-cuda' because 'llama-cpp' is already imported. Switching to…
-
**Describe the bug**
text-generation-webui API chat completion broke completely after I tried using a "Generation Preset/Character Name" of my own. Even after removing it, it's not working anymore,…