search

LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
5.35k stars 364 forks source link

cloudflare tunnel management does not work correctly. #1163

Open 0wwafa opened 1 month ago

0wwafa commented 1 month ago

If I use --remotetunnel, it downloads cloudflared (even if I have it already in my system,

anyway, running with --remotetunnel, the tunnel breaks after a while (few minutes).

if instead I do:

#!/bin/bash
./koboldcpp-linux-x64-nocuda --model llama3 &>ai.log &
sleep 3
cloudflared tunnel --url http://localhost:5001 &>cft.log &
disown -a
while ! grep -q "  https" cft.log; do sleep 0.5; done
echo "Connect to:"
grep "  https" cft.log |cut -d " " -f 5

everything works. I don't know exactly what is wrong but that is the way I use.

LostRuins commented 1 month ago

It'll download cloudflared if it can't find the file. I'm not sure why the tunnel would break

0wwafa commented 1 month ago

It'll download cloudflared if it can't find the file. I'm not sure why the tunnel would break

It might have to do in the way you manage the output. Cloudlfared must output data as a stream and not be interrupted or stopped.