-
Kind of a noonish I really dig what your doing but open ai going to be adding quick when releasing to madness I want to use open source is there ways to do this only with the ollama
-
Hello, can you add optional dynamic memory?
Record the input and output in a json file, and use the RAG method to store the memory in the koboldcpp backend.
-
Очень неплохо. В принципе это то, что я хотел. Введённый текст на русском виден в окне диалога, а в промпт уходит английский перевод. Ответы ИИ на английском можно переводить даже динамически - плагин…
-
Hey!
I installed Alpaca and Llama (after trying 3000 times), but it doesnt seem to work.
It doesnt work on firefox anyway, but when I tried in Chrome, another issue created itself. When I click "g…
-
Logs: https://pastebin.com/raw/V2PYd9Hw
```
node:events:492
throw er; // Unhandled 'error' event
^
Error: EIO: i/o error, write
Emitted 'error' event on WriteStream instance at:
…
-
Hi , I'm using koboldcpp on Android through termux . I built it with openblas and clblast with make llama_openlas llama_clblast . Whenever I use --useclblast I get error low vram , I've experimented w…
-
I tried Qwen2-72B-Instruct with both this quantization: https://huggingface.co/bartowski/Qwen2-72B-Instruct-GGUF/blob/main/Qwen2-72B-Instruct-Q4_K_M.gguf
And this one: https://huggingface.co/mraderma…
-
I have Intel Core i7-12700K (on Windows 10), it has 8 main «Performance» cores with hyperthreading, and 4 energy «Efficient» cores, giving in total 16+4=20 virtual cores.
The problem is, if I just …
-
I am running the 'koboldcpp_CUDA_only'.
# Expected Behavior
Im trying to start the ggml model by doping them onto the koboldcpp_CUDA_only.exe, however each time I get an error message that api-m…
-
There are no 'install' instructions in cmake files.
It has only built 3 static libs: libcommon2.a libgpttype_adapter.a.
What can users do with these static libs?
Shouldn't there be any execut…