-
When I enter for instance:
"Write a code in python to read btc price" i get an error in the main console:
Processing Prompt [BLAS] (49 / 49 tokens)ggml_new_tensor_impl: not enough space in the con…
-
When started with the --contextsize 8192 the model is loaded with the 8192 context size. The UI however still limits the context at 2048.
![image](https://github.com/LostRuins/koboldcpp/assets/779…
-
I am currently trying to load Alpaca via Koboldcpp on Google Colab.
This is my code in Colab:
%cd /content
!git clone https://github.com/LostRuins/koboldcpp.git
%cd koboldcpp
!git clone https://g…
-
Is it possible to support MPI?
It's implemented in upstream but I didn't see any traces of it working here.
Specifically it will allow spliting larger model into parts that could be individually lo…
-
# Expected Behavior
The stop-sequence token should be removed from the chat window.
# Current Behavior
The chat window displays (that stop-sequence will be generated when you call koboldcpp…
-
I couldn't find any documentation about the RAG functionality of SillyTavern.
There's the "attach a file" function, but can only select one document and sometimes the AI references it an sometimes …
-
Please say me. how to, if it maybe, run or convert https://huggingface.co/TheBloke/WizardLM-30B-Uncensored-GPTQ model
-
Latest version, 1.29. Including "--contextsize 512" to the command line prompt frequently leads to crashes during longer (Instruct, at least) outputs.
To reproduce:
1. In app, click New Game bu…
-
When using Longchat model with latest version `94e0a06daf9605b3fe23252bf3e4aa123f6027f4`, it will generate gibberish. I find that using the version `e1a7042943a0016dc979554372641112150dc346` at 2nd Ju…
-
Platform: macOS / Apple M2 Pro
Currently the current thread finalisation / synchronisation logic in ggml_graph_compute_thread relies on sched_yield() to spin idly waiting for other threads to comp…