-
### Example save file
[saved_story.json](https://github.com/LostRuins/koboldcpp/files/15445249/saved_story.json)
### Description
As seen in the screenshots below, the Chat mode UI mistakenly iden…
-
I'm having some really weird performance issues when loading Kobold AI models into multiple GPUs. I'm using the United version at https://github.com/henk717/KoboldAI. I'm using Linux and installed Kob…
-
Hello drizzle-mizzle, your work connecting Character.AI with Discord has been incredible, but I was wondering if you could create something similar for SillyTavern? Due to the nsfw filter on Character…
-
Right now, I can't figure out how to alter generation settings, such as temperature, rept-penalty, tail-free sampling etc, and I also don't know how to change maximum generation length. Digging around…
-
**What is the requested feature?**
A ready-to-use container image for CPU/GPU, enabling quick start use of GEOSX.
**Is your request related to a specific problem?**
It's kind of tedious for someo…
-
**Describe the Issue**
Since Control Vectors were implemented in [llama.cpp](https://github.com/ggerganov/llama.cpp/pull/5970) a few months ago there still doesn't seem to be any way to actually use …
-
Even though memory savings are great, I hoped that the quality will be the same, but it is not. For example, on https://6b.eleuther.ai/ I try the following prompt (highlighted in **bold**) and get dec…
-
Thanks for merging in the branch. The current path patch method on textgen-ui looks pretty brittle + doesn't patch LORA directory (and potentially other directories, I haven't checked)
Ideal fix fo…
-
I want the model, no matter what tokens are printed, to continue forever until I stop it. Is it possible?
-
I'm sure it's not an issue and I'm just doing it wrong, but I can seem to figure out how to select a specific model directly. Right now im using the clear_models method and then the add_model method p…