-
I try to use Koboldcpp's OpenAI compatible API in the Custom Local (OpenAI format) section, but it is not working. I input the model name, protocol and the port number. Please let me know if you need …
-
I think LLaMa-1, LLaMa-2, Mistral-v0.1, Mistral-v0.2, Solar (which is based on Mistral-v0.1), and probably a few others all use [`"legacy": true`](https://huggingface.co/mistral-community/Mistral-7B-v…
-
Hi
I'd like to request that support for Intel® Arc™ Graphics be added to KoboldCpp.
-
I made a [Koboldcpp](https://github.com/LostRuins/koboldcpp) experimental provider: https://github.com/synw/wingman/blob/main/src/providers/koboldcpp.ts. I did it to be able to run inference from my 8…
synw updated
10 months ago
-
### Prerequisites
- [X] I am running the latest code. Mention the version if possible as well.
- [X] I carefully followed the [README.md](https://github.com/ggerganov/llama.cpp/blob/master/README.md)…
-
lots of different backends i.e. koboldcpp has openai compatible url for their api
-
The instructions didn't tell that you need to install phyton in Termux. Well I found out how to do it after the missing phyton3 message.
But I have still troubles running altaera.
I get the error …
-
This project has mostly been abandoned. In case you want a community-driven fork of RVC - use [fumiama/Retrieval-based-Voice-Conversion-WebUI](https://github.com/fumiama/Retrieval-based-Voice-Conversi…
-
Hi, can you please include perplexity evaluation from llama.cpp to koboldcpp? There is a separate script for that called perplexity in llama.cpp. Currently looks like this script is not present comple…
-
The asset name for [1.64.1](https://github.com/LostRuins/koboldcpp/releases/tag/v1.64.1) has the asset named `koboldcpp-linux-x64-cuda1150` instead of the usual `koboldcpp-linux-x64`. This breaks scri…