Docker Image always uses cloudflare

LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

https://github.com/lostruins/koboldcpp

GNU Affero General Public License v3.0

5.29k stars 361 forks source link

Docker Image always uses cloudflare #1098

Open DroidCoil opened 2 months ago

DroidCoil commented 2 months ago

Describe the Issue When using the docker image it will always use cloudflare regardless of what arguments are given.

Additional Information: Even without --remotetunnel added and even with --host 127.0.0.1 added the docker image always uses cloudflare tunnel. For references this is on a linux rocm system.

LostRuins commented 2 months ago

Tagging @henk717

henk717 commented 2 months ago

KCPP_DONT_TUNNEL=true was added but we only support cuda at the moment for rocm you want to use the binaries given by the rocm fork on windows or self compile on Linux.