-
**Describe the Issue**
Running build https://github.com/LostRuins/koboldcpp/commit/b6f9aaa9ab4f951b21c90de7fb324fd4f7f00168 with Vulkan backend causes it to generate repeat garbage, however running w…
-
We're developing a new UI for KoboldAI ( and have run into an issue when we added loguru.
For some reason when running a logger.debug(message) inside a tpool.execute function I get the following erro…
-
Using koboldcpp-linux-x64-nocuda, Vulkan, Linux Mint, RX 580.
Steps to reproduce:
Run the -nocuda version
Select any SDXL based model, include VAE or use the VAE fix option
Wait until the…
t4paN updated
2 months ago
-
# Docs
* https://github.com/LostRuins/koboldcpp/wiki#can-i-use-ssl
* https://lite.koboldai.net/koboldcpp_api#/v1/post_v1_chat_completions
# What do
1. Ruby server gets translate command
- A…
-
Hi there, was just curious if we could get most/all of this upstreamed to nixpkgs.
Haven't had a thorough look around yet, but at least a bunch of the python packages should be able to be upstreamed.…
-
Sorry that I can't fork this repository due to some GitHub glitch.
This patch:
```
--- koboldcpp.py.orig 2024-09-01 15:51:59 UTC
+++ koboldcpp.py
@@ -4159,8 +4159,9 @@ def main(launch_args,st…
-
[Edit 7/20/23]: Let's use Llama 2. AWS / Azure might have hosted versions too, so no local needed.
If there's any ticket I need engagement from the community, it's this one. Adding the ability for …
-
```Downloading (…)lve/main/config.json: 100%|████████████████████████| 4.56k/4.56k [00:00
-
I see there are some options, but no ComfyUI in the list
There are some instructions on using ComfyUI in such way:
https://9elements.com/blog/hosting-a-comfyui-workflow-via-api/
Basically, it boi…
-
**Why should this feature be added?**
Since tabby has batching, it should be able to safely act as a KoboldAI horde worker. However, adding support requires understanding the Kobold API and adding a …