LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
5.26k stars 360 forks source link

An issue and a solution (tunnel timeouts) #1162

Open 0wwafa opened 1 month ago

0wwafa commented 1 month ago

When using --remotetunnel, sometimes the tunnels timeout on inactivity.

Solution add something like this in the web client:

setInterval(async ()=>await fetch("/api/v1/model").then(r=>r.text()),20000);

LostRuins commented 1 month ago

You can probably add a third party script to do that. But it's more likely an issue with your network setup, other people don't have a problem