-
You cannot run any of the models when using their Premium GPUs like NVIDIA A100, which gives this error:
```
Launching KoboldAI with the following options : python3 aiserver.py --model KoboldAI/OPT-…
-
Most of us don't have GPUs powerful enough to even run models with 6 billion parameters. Can we port this to Colab in any way so it would be more accessible?
-
Bugs found as at 17 Apr, from commit f9fb5eba8 (Remove Debug) of [one-some:model-structure-and-maybe-rwkv](https://github.com/one-some/KoboldAI-united/tree/model-structure-and-maybe-rwkv)
1. Commen…
-
I encountered the following error message after installing the entire package. I have carefully followed each step the guide have given. I also tried reinstalling it, but it still shows the same error…
-
I recently tried chat.lmsys.org. They have a lot of models. They are collecting large chat datasets for research purposes. You can try to integrate it if you can. You can even get in touch with the te…
-
Incredible project, i managed to run the model with good speed on my hardware (AMD) thanks.
I have a question do you have any plans to offload the weights and be able to run bigger models like 13B o…
-
I tried to use mpt-7b-ggml-q5_1(https://huggingface.co/TheBloke/MPT-7B-GGML) with koboldcpp(commit hash: e6ddb15c3a8) on Ubuntu 22.04. It was fine with generating English alphabet but when it comes to…
-
This is a very popular method of interacting with models. Frequent updates and good performance. Can it be used with your program?
-
Right now Localtunnel is down as mentioned in #501 , since this seems to be an independent effort it is understandable that the service can sometime have an interruption. The client however should hav…
-
`[2023-08-01 01:45:02] [ERROR ] discord.client: Ignoring exception in on_message
Traceback (most recent call last):
File "D:\PygDiscordBot-main\venv\lib\site-packages\discord\client.py", line 44…