-
Dunno if it would actually improve the effectiveness of AI or grant a speedup, but having Simple Tavern have a toggle to adjust the sampler order automatically would be nice. The current setup is a b…
-
**Have you searched for similar [requests](https://github.com/SillyTavern/SillyTavern/issues?q=)?**
[Yes](https://github.com/SillyTavern/SillyTavern/issues?q=mirostat)
**Is your feature request re…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
> `Processing Prompt [BLAS] (2130 / 2130 tokens)ggml_opencl: ggml_cl_h2d_tensor_2d(queue, d_Q, 0, src0, i03, i02, events.data() + ev_idx++) error -30 at ggml-opencl.cpp:1708
You may be out of VRAM. P…
-
It appears that this LoRA adapter, which works with regular `transformers` and AutoGPTQ in backends like `text-generation-webui`, has issues getting loaded with KoboldCPP. The base model is supposed t…
-
**Have you searched for similar [bugs](https://github.com/SillyTavern/SillyTavern/issues?q=)?**
Yes
**Describe the bug**
Although not using the Objective extension, Task Checks are running regula…
-
### Describe the bug
![Screenshot_20231011_185746_Termux](https://github.com/openai/openai-python/assets/288394/6f6323f9-9af1-4f06-8f31-3a62f38bf81e)
When iterating through chunks in a chat comp…
-
```
D:\textgen\kobold>.\koboldcpp.exe --useclblast 0 0 --smartcontext --threads 16 --blasthreads 24 --stream --gpulayers 43 --contextsize 4096 --unbantokens
Welcome to KoboldCpp - Version 1.33
For …
-
There is CLBlast GPU support for GPT-2 based models on koboldcpp for example, where I can do prompt processing on the GPU VRAM for less prompt batching errors with my 16GB of CPU RAM. Does anyone know…
-
### Description
New Agent Provider setting is not saved. I suspect it is the new error handler.
In the console log I get only 200 OKs for all transactions.
I followed the instructions for GPT4al…