-
Hey how do I run the koboldcpp.bin file I'm trying to install this on Android but I can get the file to work. I tried rename the file to koboldcpp.sh and chmod it but it still says no such file or dir…
-
Title. Would resolve a lot of headaches.
Something like https://github.com/kalomaze/koboldcpp/blob/concedo/make_pyinstaller.sh & https://github.com/kalomaze/koboldcpp/blob/concedo/make_pyinstaller.…
-
The app fails while loading models:
```
root@koboldcpp-cb947d9b7-jqrfp:/koboldcpp# python koboldcpp.py --model /app/models/mythalion-13b.Q8_0.gguf --threads 8 --noavx2 --debugmode
***
Welcome to K…
-
Is support for llama-2 planned?
-
Hello, dear developer mkiol. Are you planning to add OpenAI Compatible API to your awesome application in the near future? If not, then I ask you to do so. In my opinion this would be incredibly u…
-
So following the recommended install method of cloning the client repository and running ./play-rocm.sh, the install goes smoothly then as soon as it starts to load kobold itself it immediately crashe…
-
Please make it so you can select what GPUs you want to use. Also I have Nvidia P40 and K80 I would like to be able to run them both. It defaults to my P40 and won't use my K80, if I disable my P40 it …
-
My Computer:
Operating System: Windows 11 Professional 22H2 (Chinese Traditional)
CPU: AMD Ryzen 5 5600 6-Core Processor 3.50 GHz
GPU: GIGABYTE AMD Radeon RX 6650 XT (Driver Version 23.10.2)
RAM: …
-
I was using a pair of 3060 12gb cards, and got the error below. With the settings I had, about 19gb would be taken by VRAM, the remaining 20gb as RAM. Using a single card at 7 layers, I successful…
-
Title says it all really but, if that's still not enough, then here's a video demonstration (using the Linux Mint 21.2 Cinnamon live ISO):
[video.webm](https://github.com/LostRuins/lite.koboldai.ne…