-
I'm using Koboldcpp with singleline.mjs format. I'm trying to make it so the character always starts with an action or description by putting `"*"` in character bias (also tested with `"\*"` and the r…
-
Sometimes koboldcpp crashes when using `--useclblast`
Not using BLAS or only using OpenBLAS works fine. It only crashes when i add `--useclblast 0 0` to the command line.
I'm not sure if this has …
-
### Describe the bug
I have installed oobabooga on the CPU mode but when I try to launch pygmalion it says "CUDA out of memory"
### Is there an existing issue for this?
- [X] I have searched the ex…
-
I can't seem to get t to createa new character or load a character. It gives this error everytime. Koboldcpp is working, and running on port 5001, however it doesn't seem as if anything is being passe…
-
you're not considering a connection to oobabooga web ui API?
-
Some models might take a while to generate on some hardware.
So to not always have 3 dots hovering around for half an hour, it might be beneficial to implement token streaming similar to Kobold lite'…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [X] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
i have this issue when i try to run vicuna-13b model
Attempting to Load...
---
System Info: AVX = 1 | AVX2 = 1 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | FMA = 1 | NEON = 0 | ARM_FMA = 0 …