SillyTavern / SillyTavern

LLM Frontend for Power Users.
https://sillytavern.app
GNU Affero General Public License v3.0
8.22k stars 2.42k forks source link

Add remote options via LocalTunnel or Cloudflare #108

Closed Mu2u closed 1 year ago

Mu2u commented 1 year ago

Is your feature request related to a problem? Please describe. Right now we don't have an easy way to make a hosted version of TavernAI specifically for mobile.

Describe the solution you'd like This would create both the local and public versions every time the service is booted up. Many colab notebooks have this feature so this could be the same. This would be an optional but default on mode that would be created on startup

RossAscends commented 1 year ago

Please explain more. Currently you can make the server visible to external connections by changing the config.conf file:

Whitelist = true To Whitelist = false

This will allow connections for anyone who knows the IP and port.

Mu2u commented 1 year ago

how can you set the port to use?

if you look at some of the collab notebooks this includes using localtunnel as a remote option without having to do anything with IP address

https://colab.research.google.com/github/Cohee1207/SillyTavern/blob/main/colab/GPU.ipynb#scrollTo=lVftocpwCoYw

RossAscends commented 1 year ago

the port can also be specified in the config.conf file.

If you want to run two instances of the sillyTavern server (one for local, and one for remote?), you will need to do so by having two separate installations of SillyTavern in their own folders, and make sure they run on different ports.

Mu2u commented 1 year ago

Just to follow up, this is easily solved by adding Cloudflare Tunnel as part of the requirements and making it an optional param. eg '--remote' and the tunnel service will expose that port to the internet. it can be done in a separate step but its super easy to enable.

Cohee1207 commented 1 year ago

Replaced localtunnel to cloudflare on colab. Localtunnel kept crashing anyway,

Cohee1207 commented 1 year ago

Colab hosting support has been removed