turboderp / exui

Web UI for ExLlamaV2
MIT License
397 stars 32 forks source link

exui not able to connect to server from Win10 browser - WSL2 Debian #28

Open mindkrypted opened 6 months ago

mindkrypted commented 6 months ago

Installed using (WSL side)

git clone https://github.com/turboderp/exui
cd exui
pip install -r requirements.txt

Running using (WSL side)

python server.py --host 127.0.0.1:5000

Issue:

"connection timed out" message when trying to load from the same machine or one from LAN

Tested:
    http://127.0.0.1:5000
    http://localhost:5000

Using netsh interface portproxy add v4tov4 (Win10 side)

Listen on ipv4:             Connect to ipv4:

Address         Port        Address         Port
--------------- ----------  --------------- ----------
0.0.0.0         7860        172.19.209.170  7860
0.0.0.0         5000        172.19.209.170  5000

Server is listening on port 5000 (WSL side)

python  125 username    7u  IPv4   1491      0t0  TCP 127.0.0.1:5000 (LISTEN)

I'm no linux/networking expert but text-generation-webui works flawlessly either locally or through LAN

Does someone reported to be able to run it?

fatality14 commented 1 week ago

well, its been like 6 months sinse post, but it still may be helpful for someone... i did run server on 0.0.0.0:5000 address (except i'm using windows 11) and port forward in router