-
- https://github.com/turboderp/exllama
- https://github.com/oobabooga/text-generation-webui/blob/c7058afb402bd381d1983837b779c106217120b3/modules/exllama.py
-
text-generation-webui appears to have an OpenAI compatible API. It's not clear when you have the openAI docs how to use it that way. Looks like there's a custom API option, but seems excessive if we'r…
-
Think I found where LM Studio is failing to render a response in some front ends.
HTTP 1.1 mandates a connection header, and that header can be either "keep-alive" or "close"
Case in point, when…
-
I was wondering if it would be possible to have some kind of implementation with the Oobabooga text generation webui? it already has the implementation of bark, but i think an extension API to it and …
-
oobabot -c config.yml
[33;40m2024-04-10 22:24:04,870[0m[37;40m INFO [0m[37;40mStarting oobabot, core version 0.2.3[0m
[33;40m2024-04-10 22:24:04,870[0m[37;40m INFO [0m[37;40mOobabooga i…
-
I followed the installation instructions exactly with the exception of modifying the webui.py file to add the --extension flag as you can now just check a box for the desired extension in the GUI. The…
-
See: https://github.com/PanQiWei/AutoGPTQ/
For reference, text gen ui is using it here: https://github.com/oobabooga/text-generation-webui/blob/main/modules/AutoGPTQ_loader.py
-
### Describe the bug
I get some sort of LiteLLM error when I try to connect to the openai api in oogabooga.
It works fine to connect to the API from SillyTavern.
On a tangent: It looks like LiteL…
-
For reviewing confidential documents, we'd prefer to use our own APIs, either view oobabooga or koboldcpp. Is there the possibility of including options for using alternate APIs, including local or Cl…
-
Rather than only using OpenAi please add models such as vicuna,alpaca and more to be compatible.
Maybe something in Oobaboogas code could help with this or perhaps in Agent-LLM code as well.