-
**Have you searched for similar [requests](https://github.com/Cohee1207/SillyTavern/issues?q=)?**
Yes. The previous requests were impossible to satisfy without KoboldCPP implementing streaming endpoi…
-
# Expected Behavior
Building new versions from source must succeed with AVX2 ON. I could build past versions up to 1.44.2 with AVX2 ON.
# Current Behavior
Does not build with AVX2 since versi…
-
> **Warning**. Complete **all** the fields below. Otherwise, your bug report will be **ignored**!
**Have you searched for similar [bugs](https://github.com/SillyTavern/SillyTavern/issues?q=)?**
Ye…
-
I have been finding that the default ROPE in KoboldCPP is very unreliable. It takes some tweaking to find the right setting. Problem is, I have to go over to the LlamaCPP github and dig around to fi…
-
As the title mentioned, I tried out WizardLM 34b, and it didn't boot up.
> ***
> Welcome to KoboldCpp - Version 1.42.1
> For command line arguments, please refer to --help
> ***
> Attemptin…
-
Implement a queue system in the api.
I'm currently attempting to build a project based on the kobolt api, only problem is if more than 1 person attempts to make an api request that person will automa…
-
A simple one, in the title.
Is it possible, to have the model used for chatting, somehow noted in the chat log, txt and json?
It would help to compare what model gave more/better responses on what c…
-
[Nix](https://nixos.org/) offers a reproducible build environment. I have compiled koboldcpp on Ubuntu and Arch before. It was always a chore especially when I had CUDA version dependencies conflictin…
-
I just saw in a [recent commit](https://github.com/LostRuins/koboldcpp/commit/6570a2005b6b58b2afbe21d628014cfd73f7d566) that you just took the existing `api/extra/tokencount` API end-point and had it …
-
Currently, the model name loaded is always reported as concedo/koboldcpp regardless of what model is actually loaded.
Is there any way this could be synced to show the model that is currently loaded …