-
otherarch/ggml_v3-cuda.cu(609): warning #177-D: function "warp_reduce_sum(half2)" was declared but never referenced
otherarch/ggml_v3-cuda.cu(630): warning #177-D: function "warp_reduce_max(half2)"…
-
I loaded up a Vicuna cocktail after seeing the new prompt format in the changelog, but every generation the model is intent on injecting `` at the end (or even ending sentences). I believe it's an end…
-
Requesting a little help here. Trying to test out copilot functionality with `llama-cpp-python` with this extension. Below is my configuration setting.
```bash
{
"[python]": {
"edit…
-
Toppy's a great 7B model - the best, in my opinion, and many others have also loved it for RP.
Aside from that, Min P is a sampler implemented in every open source LLM backend. (except transformers)
-
### Feature request
Have ability to
1. edit last request, to get a better response quality
2. edit previous request/response to tune response quality
3. select and delete previous request/respon…
-
Hi all,
I just noticed something interesting. For some reason, when koboldcpp is generating tokens, the clock speeds of my CPUs are actually slowing way down.
This is a Lenovo P360 Tiny. The compute…
-
I switched from chatting with koboldcpp to story mode. Although some of the previous content
remained in memory, it suddenly started writing a different novel. I registered a profile for the
prota…
-
With the newest Version of the Ooba Booga Text Generation WebUI they replaced the old KoboldAI API with the new OpenAI compatible API. My Tavern Ai wasn't able to connect to this new API either with t…
-
I tried Qwen2-72B-Instruct with both this quantization: https://huggingface.co/bartowski/Qwen2-72B-Instruct-GGUF/blob/main/Qwen2-72B-Instruct-Q4_K_M.gguf
And this one: https://huggingface.co/mraderma…
-
On older versions of KoboldCPP, I have been able to use Airoboros c34b. That is no longer the case. From the looks of it, Kobold is seeing it as Llama v0?
> ***
> Welcome to KoboldCpp - Versio…