search

thisserand / llama2_local

MIT License
82 stars 35 forks source link

Run after tunnelling #1

Open m3rg-repo opened 1 year ago

m3rg-repo commented 1 year ago

I ran the code according to the instructions on a Ubuntu 22.04.2 LTS-based workstation. Then I created a ssh tunnel from my MacBook to this workstation using the command sudo ssh -N -L 7860:127.0.0.1:7860 user@workstation_ip.

The GUI opens up in my browser on mac, but when I enter the prompt, I get the following error:

Expecting value: line 1 column 1 (char 0)

Can you please help what am I doing wrong?

thisserand commented 1 year ago

By default the UI will be already exposed by a publicly available URL. In the log there should be one line stating: "Running on public URL:". You can access the UI using that link.

zakidotai commented 1 year ago

I also tried the same and facing similar issue. There is no public URL being displayed in output. Can you please look into this?

image
thisserand commented 1 year ago

Interesting, by default it is definitely setup to also create a public URL. Could there be any kind of proxy in your network blocking the connection to Gradio endpoints? Another alternative could be to use ngrok. But yeah, the best option obviously would be to use a ssh tunnel to not rely on third-party vendors.