-
Platform:0 Device:0 - NVIDIA CUDA with NVIDIA GeForce RTX 3050
Platform:1 Device:0 - Intel(R) OpenCL HD Graphics with Intel(R) UHD Graphics 770
64Gb RAM
Does it make sense to use the video core…
-
I have noticed that models give the same answers with the same prompt. It seems as if the seed is not randomized.
-
**Describe the bug**
When trying to connect to [koboldcpp](https://github.com/LostRuins/koboldcpp) using the KoboldAI API, SillyTavern crashes/exits.
**To Reproduce**
Steps to reproduce the behav…
-
PygmalionAI's new model instruction following model, Metharme, requires prompt formatting like this:
`This is a text adventure game. Describe the scenario to the user and give him three options to…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
Yesterday i downloaded koboldcpp for windows in hopes of using it as an API for other services on my computer, but no matter what settings i try or the models i use, kobold seems to always generate we…
-
This addition has completely destroyed my workflow, I would like to completely remove /nYou as a stop sequence. It's not a character, it only aborts generation on anything descriptive, such as actions…
-
After the rewrite of the Makefile (i think in 346cd68), koboldcpp doesn't compile anymore with openblas.
`$ make LLAMA_OPENBLAS=1`
Error message:
```bash
g++ -I. -I./examples -Ofast -DNDEBUG -…
-
KoboldCpp takes a while to generate, and it DOES eventually generate, but tavern gives up on listening well before the process finishes.
Is there a way to increase how long tavern waits?
-
**FWIW, I'm remoting into the Windows 7 machine using TightVNC but I've never had it cause issues with running program.**
When running the windows 7 exe on a windows 7 machine, nothing happens for …