-
**Have you searched for similar [bugs](https://github.com/SillyTavern/SillyTavern/issues?q=)?**
Yes
**Describe the bug**
I've noticed multiple cases of the user's name changing to "You" and the b…
-
**Have you searched for similar [bugs](https://github.com/SillyTavern/SillyTavern/issues?q=)?**
Yes
**Describe the bug**
From v1.6.8 to v1.7.0 or v1.7.1, the username is now being inserted into t…
-
First of all, I congratulate you on this project.
I am on Ubuntu 22.04 platform.
I wanted to try https://huggingface.co/cakewalk/ggml-q4_0-stablelm-tuned-alpha-7b/blob/main/ggml-model-stablelm-tune…
-
![image](https://github.com/LostRuins/koboldcpp/assets/97628039/a482a060-f009-44f9-bbff-c60e8868b24d)
.\koboldcpp.exe G:\LLM_MODELS\LLAMA\Manticore-13B.ggmlv2.q5_1.bin --unbantokens --smartcontext …
-
As it stands right now, it seems like llama.cpp (https://github.com/ggerganov/llama.cpp) is the fastest inference backend for running LLaMA models. Are there any plans for supporting calls to it for T…
-
With the latest proxy script the single line prompt format seems to be broken. The user input gets treated as empty lines by the character. Verbose works without issue.
My backend is koboldcpp (1.18…
-
Please add [starcoder](https://github.com/bigcode-project/starcoder) models. Starcoder and starcoderbase are good models to autocomplete code and StarChat Alpha is an interesting technical assistant. …
-
No matter which number I enter for the second argument, CLBlast attempts to use Device=0
This is a problem for me as I have both an AMD CPU and GPU, so the GPU is likely Device=1
Platform: Linux (…
-
This is the error prompt from simple-proxy-for-tavern in the terminal
```
{ user: 'You', assistant: 'Saga' }
final prompt tokens = 1797
{ stop_sequence: [ '\n##', '\n*You', '\nYou:' ] }
TypeErr…
-
It's really hard to describe but basically I tried running [this model](https://www.reddit.com/r/LocalLLaMA/comments/13yfask/manticore13bchatpygguanacoggmlq4_0_americas_next/) with mirostat 2 0.1 0.1 …