-
### Describe the bug
I think my 12700K is stuck on 2 threads or something. CPU is at most 22-25% performance. I am running a 30B Alpaca model it is working. But is very slowly. I am running the alp…
-
Hello guys,
I was just able to compile the project succesfully at Windows using w64devkit version 1.18.0 .
The problem I had is that I was using the binaries directly at my PATH, and I needed t…
-
Platform:0 Device:0 - NVIDIA CUDA with NVIDIA GeForce RTX 3050
Platform:1 Device:0 - Intel(R) OpenCL HD Graphics with Intel(R) UHD Graphics 770
64Gb RAM
Does it make sense to use the video core…
-
I have noticed that models give the same answers with the same prompt. It seems as if the seed is not randomized.
-
**Describe the bug**
When trying to connect to [koboldcpp](https://github.com/LostRuins/koboldcpp) using the KoboldAI API, SillyTavern crashes/exits.
**To Reproduce**
Steps to reproduce the behav…
-
PygmalionAI's new model instruction following model, Metharme, requires prompt formatting like this:
`This is a text adventure game. Describe the scenario to the user and give him three options to…
-
Yesterday i downloaded koboldcpp for windows in hopes of using it as an API for other services on my computer, but no matter what settings i try or the models i use, kobold seems to always generate we…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
After the rewrite of the Makefile (i think in 346cd68), koboldcpp doesn't compile anymore with openblas.
`$ make LLAMA_OPENBLAS=1`
Error message:
```bash
g++ -I. -I./examples -Ofast -DNDEBUG -…
-
This addition has completely destroyed my workflow, I would like to completely remove /nYou as a stop sequence. It's not a character, it only aborts generation on anything descriptive, such as actions…