-
### Describe the bug
After installing Yaml and other modules, now i am facing the issue pertaining to AttributeError: module 'gradio' has no attribute 'Box'
I tried fixing the code, changing it wi…
-
Llamacpp-python (text generation web ui dev branch) and LM studio have both added support for Gemma models. However when merging Gemma models, then converting to GGUF, the resulting model does not loa…
-
it works for me....
You need installed and working (PATH is the main problem):
git
python (i use 3.10.11)
cuda toolkit (i use 11.8)
I have visual studio 2022 community AND Build Tools 201…
-
### Describe the bug
RuntimeError: CUDA error: no kernel image is available for execution on the device
CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace …
-
How can I run the local flan-t5 model on this benchmark? I found that oobabooga already supports Seq2Seq models : [Add support for Seq2Seq LMs](https://github.com/oobabooga/text-generation-webui/pull/…
-
How to modify the chat template including (role prefix user/assistant and stop sign) base on different finetuning setting? Does chat_template in tokenizer_config.json work? If so, any example we can b…
-
I did a fresh install and have the ooba api running, but can not run as anything I try different in the .env I keep getting this error
```
Traceback (most recent call last):
File "/home/aaron/D…
-
### Describe the bug
start_linux.sh fails with:
Traceback (most recent call last):
File "/home/dagb/llm/text-generation-webui/one_click.py", line 360, in
install_webui()
File "/home/da…
-
After installing the oobabot thing, Oobabooga won't start anymore.
Cmd outputs this:
2024-01-19 05:21:18,804 DEBUG oobabot_plugin: inside Oobabooga, using script.py version: 0.1.8
2024-01-19 0…
-
Running in kubernetes, it works fine except the EXTRA_LAUNCH_ARGS are not honored as env vars.
The following I would expect to enable the api and preload a model, neither are enabled though.
```…