-
Running in kubernetes, it works fine except the EXTRA_LAUNCH_ARGS are not honored as env vars.
The following I would expect to enable the api and preload a model, neither are enabled though.
```…
-
After installing the oobabot thing, Oobabooga won't start anymore.
Cmd outputs this:
2024-01-19 05:21:18,804 DEBUG oobabot_plugin: inside Oobabooga, using script.py version: 0.1.8
2024-01-19 0…
-
### Describe the bug
I put an img_me.jpg into the main folder but the profile pic doesn't show up.
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Reproducti…
-
How to modify the chat template including (role prefix user/assistant and stop sign) base on different finetuning setting? Does chat_template in tokenizer_config.json work? If so, any example we can b…
-
In the official OpenAI API documentation there seems to be an optional variable in the message data structure that allows to differentiate users within the same role, but it doesn't seem to have any e…
-
### Describe the bug
Since the update to `llama_cpp_python`/`llama_cpp_python_cuda` 0.2.59, there's a segfault on at least an AMD RX7900XT when using models loaded with the llama.cpp loader. This s…
-
2023-12-18 03:34:00 INFO:Loading the extension "webui_tavernai_charas-master"...
2023-12-18 03:34:00 ERROR:Failed to load the extension "webui_tavernai_charas-master".
Traceback (most recent call la…
-
This is my code. The input ids is less than the max seq len 4096.
Error:
```
File "/home/ec2-user/anaconda3/envs/obaga/lib/python3.10/site-packages/exllamav2/generator/streaming.py", line 111…
-
**Describe the feature you'd like**
oobabooga Text-generation UI has a plugin which emulates the openAI API. But in the UI of Flowise it is not possible to set the URL of OpenAI.
Setting the OPENAI…
-
I've noticed when using the API the generated responses don't use the extensions in Text generation web UI. I was trying to use Superbooga but text sent to the model didn't attempt to include RAG inje…