-
I want to use KoboldCpp or Ollama to provide translation services, believing that many LLM models can offer better results than existing online translation websites. What are the ways to achieve this?…
-
```
bash -x play.sh
ESC[?2004l^M+ '[' '!' -f runtime/envs/koboldai/bin/python ']'
+ bin/micromamba run -r runtime -n koboldai python aiserver.py
Traceback (most recent call last):
File "/opt/ko…
-
**Describe the solution you'd like**
I want an option to be able to use the KoboldAI API to allow a way of local use.
**Describe alternatives you've considered**
The problems with cloud hosted so…
-
How do we use the openai/chatgpt prompt system with koboldai or textgen webui api's?
-
**Describe the Issue**
```
Load Text Model OK: True
Embedded KoboldAI Lite loaded.
Embedded API docs loaded.
Downloading Cloudflare Tunnel for Windows...
Remote Tunnel Failed!
Command 'curl -fL…
-
Hello, I wish to add a feature to the front end HTML...
I don't find it in the repository...
I wish to add a print button, I already have the code to print the chat in a nice way.
-
Hey, i have built my own docker container based on the standalone and the rocm container from here and it is working so far, but i would really like to run this without cloudflare, just locally.
If i…
-
Whenever I try to load 4bit models I recieve this message. I'm using the latest version of code and can load normal models just fine. I'm using a 6600xt.
``
DEVICE ID | LAYERS | DEVICE NAM…
-
Not sure if this is meant to work at present, but I got a `RuntimeError: Internal: src/sentencepiece_processor.cc(1102) [model_proto->ParseFromArray(serialized.data(), serialized.size())]` loading `ht…
-
Everything seems to work fine via the embedded klite interface, but when I pointed horde at it, it started throwing these:
It seems to kinda sorta maybe still serve horde requests?
```
INFO 01-…
ycros updated
9 months ago