-
### Describe the bug
I noticed some OpenAI API emulators contain `\r\n\r\n` instead of `\n\n` in streaming messages. which breaks the parsing of the chunks.
### To Reproduce
happens with https://gi…
-
Hello,
I have two basic questions:
1) Do you have any data on how long it takes to quantize a 70b model using 24GB VRAM (assuming that's possible)?
2) Do you plan to release prequantized models…
-
Hi, teams!
Thanks so much for the great repo! I want to report a problem about add `eos` token in the `finetune.py`
https://github.com/allenai/open-instruct/blob/763206f5b8fe340c7833c438113f69ba7b…
-
### Describe the bug
Cannot install whl on centos7, any workaround or newer whl might help?
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Reproduction
```…
sdwcn updated
6 months ago
-
Latest Spell and Application pair
Oobabooga Local host with Toppy 7b AWQ
Microphone off.
xVASynth launched manually beforehand.
All after a full PC restart to ensure that the error is repeatable a…
-
### Describe the bug
During text streaming, the browser uses 100% CPU. This causes an artifact where if the server is streaming fast enough, the frontend will lag behind and will continue streaming…
-
Is tawern ai still maintained? Last update to release has been in november, also i saw another issue suggesting that it is not compatible with new oobabooga. Also in tawern ai there seams to be no opt…
-
### Describe the bug
When attempting to install the webui for the first time on windows I get the error: ModuleNotFoundError: No module named 'yaml'
I have installed PyYAML in the venv and in my loc…
-
Hi, thank you for this great ui.
Today I tried to use mosaicml/mpt-7b-instruct model. downloading from webui is successufully finished but it can't be loaded. Here is error message:
> Traceback (mos…
-
### Describe the bug
I'm trying to finetune llama2, but an error occurs when calling the encoder
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Reproduction…