-
**Is your feature request related to a problem? Please describe.**
The current voice input implementation is only supported by Safari. Also, it is highly unreliable due to constant typos and lack of …
-
### Describe the bug
OSError: [WinError 126] The specified module could not be found. Error loading "E:\oobabooga\text-generation-webui-main\installer_files\env\Lib\site-packages\torch\lib\cudnn_cnn_…
-
Hi,
Source from where I followed steps on using oobabooga+gpt4-x-alpaca: https://www.youtube.com/watch?v=nVC9D9fRyNU&t=191s
I was trying to use the gpt4-x-alpaca-13b-native-4bit-128g model to tr…
-
First off, thank you so much for this excellent extension and how well you've maintained it.
After running into some issues after a textgenwebui update, I just did a fresh clean install of that.
…
-
### Describe the bug
Haven't had any issues with ooba before but a recent update has caused random severe repetition issues with this error that is responsible I believe. I have reinstalled with the …
-
So, was working fine for a bit yesterday, then perhaps upgraded to this latest push and here is the big string of issues, please note might be the models I am trying to run:
Traceback (most recent…
-
The inference speed of naive model parallel is much better than tensor parallel:
Setup: Llama-30b on 2080Ti 22G x4
Naive: 31.64s
4-way TP, main branch: 177.78s
4-way TP, llama branch: 102.22s
…
-
This happens for the two consequent nightly versions, and I have also built an image from the 2024-03-10 snapshot version:
https://github.com/oobabooga/text-generation-webui/releases/tag/snapshot-202…
-
This discussion is on the validity of adding PEFT fine tuning abilities and QLoRA adapter loading to ollama. Allowing expandable tensor level knowledgebases to be added via ollama model configuration…
-
Traceback (most recent call last):
File “C:\Users\Moiz Contractor\Desktop\AI\oobabooga-windows\installer_files\env\lib\site-packages\llama_cpp\llama_cpp.py”, line 54, in _load_shared_library
return …