search

rsxdalv / tts-generation-webui

TTS Generation Web UI (Bark, MusicGen + AudioGen, Tortoise, RVC, Vocos, Demucs, SeamlessM4T, MAGNet, StyleTTS2, MMS)
https://rsxdalv.github.io/tts-generation-webui/
MIT License
1.68k stars 180 forks source link

Doesn't seem to be a way to add --listen args #198

Closed skittixch closed 11 months ago

skittixch commented 11 months ago

Maybe it's me, but I'm not finding it anywhere. I'd love to make this available outside my network, but without --listen, I'm stuck

rsxdalv commented 11 months ago

Either config.json directly or by editing the settings within the UI settings tab (which is saved in config.json)

skittixch commented 11 months ago

This is my list of options. I don't see any reference to the --listen argument.

image

When poking around, I find that enabling the "share" option immediately disconnects me and throws the following error in the log. (Running in Docker)

2023-10-18 22:12:38 Loading extensions: 2023-10-18 22:12:38 Loaded extension: callback_save_generation_ffmpeg 2023-10-18 22:12:38 Loaded extension: callback_save_generation_musicgen_ffmpeg 2023-10-18 22:12:38 Loaded extension: empty_extension 2023-10-18 22:12:38 Loaded 2 callback_save_generation extensions. 2023-10-18 22:12:38 Loaded 1 callback_save_generation_musicgen extensions. 2023-10-18 22:12:38 Starting Gradio server... 2023-10-18 22:12:38 Gradio interface options: 2023-10-18 22:12:38 inline: True 2023-10-18 22:12:38 inbrowser: True 2023-10-18 22:12:38 share: True 2023-10-18 22:12:38 debug: False 2023-10-18 22:12:38 enable_queue: True 2023-10-18 22:12:38 max_threads: 40 2023-10-18 22:12:38 auth: None 2023-10-18 22:12:38 auth_message: None 2023-10-18 22:12:38 prevent_thread_lock: False 2023-10-18 22:12:38 show_error: False 2023-10-18 22:12:38 server_name: 0.0.0.0 2023-10-18 22:12:38 server_port: 0 2023-10-18 22:12:38 show_tips: False 2023-10-18 22:12:38 height: 500 2023-10-18 22:12:38 width: 100% 2023-10-18 22:12:38 favicon_path: None 2023-10-18 22:12:38 ssl_keyfile: None 2023-10-18 22:12:38 ssl_certfile: None 2023-10-18 22:12:38 ssl_keyfile_password: None 2023-10-18 22:12:38 ssl_verify: True 2023-10-18 22:12:38 quiet: False 2023-10-18 22:12:38 show_api: True 2023-10-18 22:12:38 file_directories: None 2023-10-18 22:12:38 _frontend: True 2023-10-18 22:12:39 Traceback (most recent call last): 2023-10-18 22:12:39 File "/venv/lib/python3.10/site-packages/urllib3/connection.py", line 174, in _new_conn 2023-10-18 22:12:39 conn = connection.create_connection( 2023-10-18 22:12:39 File "/venv/lib/python3.10/site-packages/urllib3/util/connection.py", line 95, in create_connection 2023-10-18 22:12:39 raise err 2023-10-18 22:12:39 File "/venv/lib/python3.10/site-packages/urllib3/util/connection.py", line 85, in create_connection 2023-10-18 22:12:39 sock.connect(sa) 2023-10-18 22:12:39 ConnectionRefusedError: [Errno 111] Connection refused 2023-10-18 22:12:39 2023-10-18 22:12:39 During handling of the above exception, another exception occurred: 2023-10-18 22:12:39 2023-10-18 22:12:39 Traceback (most recent call last): 2023-10-18 22:12:39 File "/venv/lib/python3.10/site-packages/urllib3/connectionpool.py", line 714, in urlopen 2023-10-18 22:12:39 httplib_response = self._make_request( 2023-10-18 22:12:39 File "/venv/lib/python3.10/site-packages/urllib3/connectionpool.py", line 415, in _make_request 2023-10-18 22:12:39 conn.request(method, url, **httplib_request_kw) 2023-10-18 22:12:39 File "/venv/lib/python3.10/site-packages/urllib3/connection.py", line 244, in request 2023-10-18 22:12:39 super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-18 22:12:39 File "/usr/lib/python3.10/http/client.py", line 1283, in request 2023-10-18 22:12:39 self._send_request(method, url, body, headers, encode_chunked) 2023-10-18 22:12:39 File "/usr/lib/python3.10/http/client.py", line 1329, in _send_request 2023-10-18 22:12:39 self.endheaders(body, encode_chunked=encode_chunked) 2023-10-18 22:12:39 File "/usr/lib/python3.10/http/client.py", line 1278, in endheaders 2023-10-18 22:12:39 self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-18 22:12:39 File "/usr/lib/python3.10/http/client.py", line 1038, in _send_output 2023-10-18 22:12:39 self.send(msg) 2023-10-18 22:12:39 File "/usr/lib/python3.10/http/client.py", line 976, in send 2023-10-18 22:12:39 self.connect() 2023-10-18 22:12:39 File "/venv/lib/python3.10/site-packages/urllib3/connection.py", line 205, in connect 2023-10-18 22:12:39 conn = self._new_conn() 2023-10-18 22:12:39 File "/venv/lib/python3.10/site-packages/urllib3/connection.py", line 186, in _new_conn 2023-10-18 22:12:39 raise NewConnectionError( 2023-10-18 22:12:39 urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f170e480d00>: Failed to establish a new connection: [Errno 111] Connection refused 2023-10-18 22:12:39 2023-10-18 22:12:39 During handling of the above exception, another exception occurred: 2023-10-18 22:12:39 2023-10-18 22:12:39 Traceback (most recent call last): 2023-10-18 22:12:39 File "/venv/lib/python3.10/site-packages/requests/adapters.py", line 486, in send 2023-10-18 22:12:39 resp = conn.urlopen( 2023-10-18 22:12:39 File "/venv/lib/python3.10/site-packages/urllib3/connectionpool.py", line 798, in urlopen 2023-10-18 22:12:39 retries = retries.increment( 2023-10-18 22:12:39 File "/venv/lib/python3.10/site-packages/urllib3/util/retry.py", line 592, in increment 2023-10-18 22:12:39 raise MaxRetryError(_pool, url, error or ResponseError(cause)) 2023-10-18 22:12:39 urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=80): Max retries exceeded with url: /startup-events (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f170e480d00>: Failed to establish a new connection: [Errno 111] Connection refused')) 2023-10-18 22:12:39 2023-10-18 22:12:39 During handling of the above exception, another exception occurred: 2023-10-18 22:12:39 2023-10-18 22:12:39 Traceback (most recent call last): 2023-10-18 22:12:39 File "/app/tts-generation-webui/server.py", line 160, in <module> 2023-10-18 22:12:39 start_server() 2023-10-18 22:12:39 File "/app/tts-generation-webui/server.py", line 154, in start_server 2023-10-18 22:12:39 demo.queue( 2023-10-18 22:12:39 File "/venv/lib/python3.10/site-packages/gradio/blocks.py", line 1807, in launch 2023-10-18 22:12:39 requests.get(f"{self.local_url}startup-events", verify=ssl_verify) 2023-10-18 22:12:39 File "/venv/lib/python3.10/site-packages/requests/api.py", line 73, in get 2023-10-18 22:12:39 return request("get", url, params=params, **kwargs) 2023-10-18 22:12:39 File "/venv/lib/python3.10/site-packages/requests/api.py", line 59, in request 2023-10-18 22:12:39 return session.request(method=method, url=url, **kwargs) 2023-10-18 22:12:39 File "/venv/lib/python3.10/site-packages/requests/sessions.py", line 589, in request 2023-10-18 22:12:39 resp = self.send(prep, **send_kwargs) 2023-10-18 22:12:39 File "/venv/lib/python3.10/site-packages/requests/sessions.py", line 703, in send 2023-10-18 22:12:39 r = adapter.send(request, **kwargs) 2023-10-18 22:12:39 File "/venv/lib/python3.10/site-packages/requests/adapters.py", line 519, in send 2023-10-18 22:12:39 raise ConnectionError(e, request=request) 2023-10-18 22:12:39 requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=80): Max retries exceeded with url: /startup-events (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f170e480d00>: Failed to establish a new connection: [Errno 111] Connection refused'))

skittixch commented 11 months ago

scratch all this, I guess it was a problem with my nginx setup. Sorry about that!

for anyone interested, here's my .conf file that ended up fixing my issue

server {
    listen 80;
    server_name subdomain.mydomain.com;

    location / {
        proxy_pass http://192.168.##.#:7860;

        proxy_set_header Host $host;
        proxy_set_header X-Real-IP $remote_addr;
        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
        proxy_set_header X-Forwarded-Proto $scheme;

        # Additional settings for WebSocket
        proxy_http_version 1.1;
        proxy_set_header Upgrade $http_upgrade;
        proxy_set_header Connection "upgrade";
    }
}

That seems to have done it!

rsxdalv commented 11 months ago

scratch all this, I guess it was a problem with my nginx setup. Sorry about that!

for anyone interested, here's my .conf file that ended up fixing my issue

server {
    listen 80;
    server_name subdomain.mydomain.com;

    location / {
        proxy_pass http://192.168.##.#:7860;

        proxy_set_header Host $host;
        proxy_set_header X-Real-IP $remote_addr;
        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
        proxy_set_header X-Forwarded-Proto $scheme;

        # Additional settings for WebSocket
        proxy_http_version 1.1;
        proxy_set_header Upgrade $http_upgrade;
        proxy_set_header Connection "upgrade";
    }
}

That seems to have done it!

Yes, proxying with Nginx will also do it! Good job! In the case you have a server, the 7680 port is probably closed and you would need to use ufw or iptables to unblock it.

ozymoz commented 8 months ago

This is my list of options. I don't see any reference to the --listen argument.

Hello, were you able to add the --listen argument? I can't activate HTTP requests.

rsxdalv commented 8 months ago

If you are using the web UI I recommend finding the listen setting there, in the settings > gradio settings tab. Also it can be done in the config.json file.

On Thu, Jan 11, 2024, 7:10 AM ozymoz @.***> wrote:

This is my list of options. I don't see any reference to the --listen argument.

Hello, were you able to add the --listen argument? I can't activate HTTP requests.

— Reply to this email directly, view it on GitHub https://github.com/rsxdalv/tts-generation-webui/issues/198#issuecomment-1886253488, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABTRXIZGDKZ6CYLDONG5FILYN5X33AVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWGI2TGNBYHA . You are receiving this because you commented.Message ID: @.***>

ozymoz commented 8 months ago

If you are using the web UI I recommend finding the listen setting there, in the settings > gradio settings tab. Also it can be done in the config.json file. … On Thu, Jan 11, 2024, 7:10 AM ozymoz @.> wrote: This is my list of options. I don't see any reference to the --listen argument. Hello, were you able to add the --listen argument? I can't activate HTTP requests. — Reply to this email directly, view it on GitHub <#198 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABTRXIZGDKZ6CYLDONG5FILYN5X33AVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWGI2TGNBYHA . You are receiving this because you commented.Message ID: @.>

I looked in the config file but I didn't understand where to add --listen. Sorry I'm an amateur.

settings > gradio settings tab There is no arg field here

Config File

2

WebUI Settings

1_page-0001

rsxdalv commented 8 months ago

Server name being 0.0.0.0 should be the same as listen. Can you open it on the same PC? There should be two IP addresses like 127.0.0.1 and 192.0.0.X

On Thu, Jan 11, 2024, 11:45 AM ozymoz @.***> wrote:

If you are using the web UI I recommend finding the listen setting there, in the settings > gradio settings tab. Also it can be done in the config.json file. … <#m-8618955826006939589> On Thu, Jan 11, 2024, 7:10 AM ozymoz @.> wrote: This is my list of options. I don't see any reference to the --listen argument. Hello, were you able to add the --listen argument? I can't activate HTTP requests. — Reply to this email directly, view it on GitHub <#198 (comment) https://github.com/rsxdalv/tts-generation-webui/issues/198#issuecomment-1886253488>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABTRXIZGDKZ6CYLDONG5FILYN5X33AVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWGI2TGNBYHA https://github.com/notifications/unsubscribe-auth/ABTRXIZGDKZ6CYLDONG5FILYN5X33AVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWGI2TGNBYHA . You are receiving this because you commented.Message ID: @.>

I looked in the config file but I didn't understand where to add --listen. Sorry I'm an amateur.

settings > gradio settings tab There is no arg field here

Config File

{ "model": { "text_use_gpu": true, "text_use_small": true, "coarse_use_gpu": true, "coarse_use_small": true, "fine_use_gpu": true, "fine_use_small": true, "codec_use_gpu": true, "load_models_on_startup": false }, "gradio_interface_options": { "inline": false, "inbrowser": true, "share": false, "debug": false, "enable_queue": true, "max_threads": 40, "auth": null, "auth_message": null, "prevent_thread_lock": false, "show_error": false, "server_name": "0.0.0.0", "server_port": null, "show_tips": false, "height": 500, "width": "100%", "favicon_path": null, "ssl_keyfile": null, "ssl_certfile": null, "ssl_keyfile_password": null, "ssl_verify": true, "quiet": true, "show_api": true, "file_directories": null, "_frontend": true }, "load_models_on_startup": false }

WebUI Settings

1_page-0001.jpg (view on web) https://github.com/rsxdalv/tts-generation-webui/assets/41089719/496d5322-3a92-49d9-b1ba-098cc28d6a82

— Reply to this email directly, view it on GitHub https://github.com/rsxdalv/tts-generation-webui/issues/198#issuecomment-1886735093, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABTRXIYEXNASUMXT3VJJMXLYN6YFFAVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWG4ZTKMBZGM . You are receiving this because you commented.Message ID: @.***>

ozymoz commented 8 months ago

Server name being 0.0.0.0 should be the same as listen. Can you open it on the same PC? There should be two IP addresses like 127.0.0.1 and 192.0.0.X … On Thu, Jan 11, 2024, 11:45 AM ozymoz @.> wrote: If you are using the web UI I recommend finding the listen setting there, in the settings > gradio settings tab. Also it can be done in the config.json file. … <#m-8618955826006939589> On Thu, Jan 11, 2024, 7:10 AM ozymoz @.> wrote: This is my list of options. I don't see any reference to the --listen argument. Hello, were you able to add the --listen argument? I can't activate HTTP requests. — Reply to this email directly, view it on GitHub <#198 (comment) <#198 (comment)>>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABTRXIZGDKZ6CYLDONG5FILYN5X33AVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWGI2TGNBYHA https://github.com/notifications/unsubscribe-auth/ABTRXIZGDKZ6CYLDONG5FILYN5X33AVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWGI2TGNBYHA . You are receiving this because you commented.Message ID: @.> I looked in the config file but I didn't understand where to add --listen. Sorry I'm an amateur. settings > gradio settings tab There is no arg field here Config File { "model": { "text_use_gpu": true, "text_use_small": true, "coarse_use_gpu": true, "coarse_use_small": true, "fine_use_gpu": true, "fine_use_small": true, "codec_use_gpu": true, "load_models_on_startup": false }, "gradio_interface_options": { "inline": false, "inbrowser": true, "share": false, "debug": false, "enable_queue": true, "max_threads": 40, "auth": null, "auth_message": null, "prevent_thread_lock": false, "show_error": false, "server_name": "0.0.0.0", "server_port": null, "show_tips": false, "height": 500, "width": "100%", "favicon_path": null, "ssl_keyfile": null, "ssl_certfile": null, "ssl_keyfile_password": null, "ssl_verify": true, "quiet": true, "show_api": true, "file_directories": null, "_frontend": true }, "load_models_on_startup": false } WebUI Settings 1_page-0001.jpg (view on web) https://github.com/rsxdalv/tts-generation-webui/assets/41089719/496d5322-3a92-49d9-b1ba-098cc28d6a82 — Reply to this email directly, view it on GitHub <#198 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABTRXIYEXNASUMXT3VJJMXLYN6YFFAVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWG4ZTKMBZGM . You are receiving this because you commented.Message ID: @.>

I opened webui in all three ways but it works with rvc, musicgen and audiogen ws. I couldn't see the HTTP requests in dev tools.

127.0.0.1 localhost 192.0.0.x

rsxdalv commented 8 months ago

Gradio doesn't use HTTP, and that doesn't change with --listen

On Thu, Jan 11, 2024, 12:15 PM ozymoz @.***> wrote:

Server name being 0.0.0.0 should be the same as listen. Can you open it on the same PC? There should be two IP addresses like 127.0.0.1 and 192.0.0.X … <#m-1618380796915822891> On Thu, Jan 11, 2024, 11:45 AM ozymoz @.*> wrote: If you are using the web UI I recommend finding the listen setting there, in the settings > gradio settings tab. Also it can be done in the config.json file. … <#m-8618955826006939589> On Thu, Jan 11, 2024, 7:10 AM ozymoz @.> wrote: This is my list of options. I don't see any reference to the --listen argument. Hello, were you able to add the --listen argument? I can't activate HTTP requests. — Reply to this email directly, view it on GitHub <#198 https://github.com/rsxdalv/tts-generation-webui/issues/198 (comment) <#198 (comment) https://github.com/rsxdalv/tts-generation-webui/issues/198#issuecomment-1886253488>>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABTRXIZGDKZ6CYLDONG5FILYN5X33AVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWGI2TGNBYHA https://github.com/notifications/unsubscribe-auth/ABTRXIZGDKZ6CYLDONG5FILYN5X33AVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWGI2TGNBYHA https://github.com/notifications/unsubscribe-auth/ABTRXIZGDKZ6CYLDONG5FILYN5X33AVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWGI2TGNBYHA https://github.com/notifications/unsubscribe-auth/ABTRXIZGDKZ6CYLDONG5FILYN5X33AVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWGI2TGNBYHA . You are receiving this because you commented.Message ID: @.> I looked in the config file but I didn't understand where to add --listen. Sorry I'm an amateur. settings > gradio settings tab There is no arg field here Config File { "model": { "text_use_gpu": true, "text_use_small": true, "coarse_use_gpu": true, "coarse_use_small": true, "fine_use_gpu": true, "fine_use_small": true, "codec_use_gpu": true, "load_models_on_startup": false }, "gradio_interface_options": { "inline": false, "inbrowser": true, "share": false, "debug": false, "enable_queue": true, "max_threads": 40, "auth": null, "auth_message": null, "prevent_thread_lock": false, "show_error": false, "server_name": "0.0.0.0", "server_port": null, "show_tips": false, "height": 500, "width": "100%", "favicon_path": null, "ssl_keyfile": null, "ssl_certfile": null, "ssl_keyfile_password": null, "ssl_verify": true, "quiet": true, "show_api": true, "file_directories": null, "_frontend": true }, "load_models_on_startup": false } WebUI Settings 1_page-0001.jpg (view on web) https://github.com/rsxdalv/tts-generation-webui/assets/41089719/496d5322-3a92-49d9-b1ba-098cc28d6a82 https://github.com/rsxdalv/tts-generation-webui/assets/41089719/496d5322-3a92-49d9-b1ba-098cc28d6a82 — Reply to this email directly, view it on GitHub <#198 (comment) https://github.com/rsxdalv/tts-generation-webui/issues/198#issuecomment-1886735093>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABTRXIYEXNASUMXT3VJJMXLYN6YFFAVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWG4ZTKMBZGM https://github.com/notifications/unsubscribe-auth/ABTRXIYEXNASUMXT3VJJMXLYN6YFFAVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWG4ZTKMBZGM . You are receiving this because you commented.Message ID: @.***>

I opened webui in all three ways but it works with rvc, musicgen and audiogen ws. I couldn't see the HTTP requests in dev tools.

127.0.0.1 localhost 192.0.0.x

— Reply to this email directly, view it on GitHub https://github.com/rsxdalv/tts-generation-webui/issues/198#issuecomment-1886786016, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABTRXI5RDQOQ6FWEVM3QKCLYN63UPAVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWG44DMMBRGY . You are receiving this because you commented.Message ID: @.***>

ozymoz commented 8 months ago

Gradio doesn't use HTTP, and that doesn't change with --listen … On Thu, Jan 11, 2024, 12:15 PM ozymoz @.> wrote: Server name being 0.0.0.0 should be the same as listen. Can you open it on the same PC? There should be two IP addresses like 127.0.0.1 and 192.0.0.X … <#m-1618380796915822891> On Thu, Jan 11, 2024, 11:45 AM ozymoz @.> wrote: If you are using the web UI I recommend finding the listen setting there, in the settings > gradio settings tab. Also it can be done in the config.json file. … <#m-8618955826006939589> On Thu, Jan 11, 2024, 7:10 AM ozymoz @.> wrote: This is my list of options. I don't see any reference to the --listen argument. Hello, were you able to add the --listen argument? I can't activate HTTP requests. — Reply to this email directly, view it on GitHub <#198 <#198> (comment) <#198 (comment) <#198 (comment)>>>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABTRXIZGDKZ6CYLDONG5FILYN5X33AVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWGI2TGNBYHA https://github.com/notifications/unsubscribe-auth/ABTRXIZGDKZ6CYLDONG5FILYN5X33AVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWGI2TGNBYHA https://github.com/notifications/unsubscribe-auth/ABTRXIZGDKZ6CYLDONG5FILYN5X33AVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWGI2TGNBYHA https://github.com/notifications/unsubscribe-auth/ABTRXIZGDKZ6CYLDONG5FILYN5X33AVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWGI2TGNBYHA . You are receiving this because you commented.Message ID: @.> I looked in the config file but I didn't understand where to add --listen. Sorry I'm an amateur. settings > gradio settings tab There is no arg field here Config File { "model": { "text_use_gpu": true, "text_use_small": true, "coarse_use_gpu": true, "coarse_use_small": true, "fine_use_gpu": true, "fine_use_small": true, "codec_use_gpu": true, "load_models_on_startup": false }, "gradio_interface_options": { "inline": false, "inbrowser": true, "share": false, "debug": false, "enable_queue": true, "max_threads": 40, "auth": null, "auth_message": null, "prevent_thread_lock": false, "show_error": false, "server_name": "0.0.0.0", "server_port": null, "show_tips": false, "height": 500, "width": "100%", "favicon_path": null, "ssl_keyfile": null, "ssl_certfile": null, "ssl_keyfile_password": null, "ssl_verify": true, "quiet": true, "show_api": true, "file_directories": null, "_frontend": true }, "load_models_on_startup": false } WebUI Settings 1_page-0001.jpg (view on web) https://github.com/rsxdalv/tts-generation-webui/assets/41089719/496d5322-3a92-49d9-b1ba-098cc28d6a82 https://github.com/rsxdalv/tts-generation-webui/assets/41089719/496d5322-3a92-49d9-b1ba-098cc28d6a82 — Reply to this email directly, view it on GitHub <#198 (comment) <#198 (comment)>>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABTRXIYEXNASUMXT3VJJMXLYN6YFFAVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWG4ZTKMBZGM https://github.com/notifications/unsubscribe-auth/ABTRXIYEXNASUMXT3VJJMXLYN6YFFAVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWG4ZTKMBZGM . You are receiving this because you commented.Message ID: @.**> I opened webui in all three ways but it works with rvc, musicgen and audiogen ws. I couldn't see the HTTP requests in dev tools. 127.0.0.1 localhost 192.0.0.x — Reply to this email directly, view it on GitHub <#198 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABTRXI5RDQOQ6FWEVM3QKCLYN63UPAVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWG44DMMBRGY . You are receiving this because you commented.Message ID: @.>

Can you develop for HTTP? Websocket always creates a mess for the backend.

rsxdalv commented 6 months ago

Gradio doesn't use HTTP, and that doesn't change with --listen … On Thu, Jan 11, 2024, 12:15 PM ozymoz @.> wrote: Server name being 0.0.0.0 should be the same as listen. Can you open it on the same PC? There should be two IP addresses like 127.0.0.1 and 192.0.0.X … <#m-1618380796915822891> On Thu, Jan 11, 2024, 11:45 AM ozymoz @.> wrote: If you are using the web UI I recommend finding the listen setting there, in the settings > gradio settings tab. Also it can be done in the config.json file. … <#m-8618955826006939589> On Thu, Jan 11, 2024, 7:10 AM ozymoz @.> wrote: This is my list of options. I don't see any reference to the --listen argument. Hello, were you able to add the --listen argument? I can't activate HTTP requests. — Reply to this email directly, view it on GitHub <#198 <#198> (comment) <#198 (comment) <#198 (comment)>>>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABTRXIZGDKZ6CYLDONG5FILYN5X33AVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWGI2TGNBYHA https://github.com/notifications/unsubscribe-auth/ABTRXIZGDKZ6CYLDONG5FILYN5X33AVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWGI2TGNBYHA https://github.com/notifications/unsubscribe-auth/ABTRXIZGDKZ6CYLDONG5FILYN5X33AVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWGI2TGNBYHA https://github.com/notifications/unsubscribe-auth/ABTRXIZGDKZ6CYLDONG5FILYN5X33AVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWGI2TGNBYHA . You are receiving this because you commented.Message ID: @.> I looked in the config file but I didn't understand where to add --listen. Sorry I'm an amateur. settings > gradio settings tab There is no arg field here Config File { "model": { "text_use_gpu": true, "text_use_small": true, "coarse_use_gpu": true, "coarse_use_small": true, "fine_use_gpu": true, "fine_use_small": true, "codec_use_gpu": true, "load_models_on_startup": false }, "gradio_interface_options": { "inline": false, "inbrowser": true, "share": false, "debug": false, "enable_queue": true, "max_threads": 40, "auth": null, "auth_message": null, "prevent_thread_lock": false, "show_error": false, "server_name": "0.0.0.0", "server_port": null, "show_tips": false, "height": 500, "width": "100%", "favicon_path": null, "ssl_keyfile": null, "ssl_certfile": null, "ssl_keyfile_password": null, "ssl_verify": true, "quiet": true, "show_api": true, "file_directories": null, "_frontend": true }, "load_models_on_startup": false } WebUI Settings 1_page-0001.jpg (view on web) https://github.com/rsxdalv/tts-generation-webui/assets/41089719/496d5322-3a92-49d9-b1ba-098cc28d6a82 https://github.com/rsxdalv/tts-generation-webui/assets/41089719/496d5322-3a92-49d9-b1ba-098cc28d6a82 — Reply to this email directly, view it on GitHub <#198 (comment) <#198 (comment)>>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABTRXIYEXNASUMXT3VJJMXLYN6YFFAVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWG4ZTKMBZGM https://github.com/notifications/unsubscribe-auth/ABTRXIYEXNASUMXT3VJJMXLYN6YFFAVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWG4ZTKMBZGM . You are receiving this because you commented.Message ID: @.> I opened webui in all three ways but it works with rvc, musicgen and audiogen ws. I couldn't see the HTTP requests in dev tools. 127.0.0.1 localhost 192.0.0.x — Reply to this email directly, view it on GitHub <#198 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABTRXI5RDQOQ6FWEVM3QKCLYN63UPAVCNFSM6AAAAAA6GE3EX6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBWG44DMMBRGY . You are receiving this because you commented.Message ID: @.**>

Can you develop for HTTP? Websocket always creates a mess for the backend.

I don't remember if I answered this elsewhere, but you can use the Next.js/React UI backend as a layer to transform the API to HTTP. Gradio has a lot of custom stuff on top of it, but the Next.js API part is fairly straightforward, and if you monitor the traffic while using the React UI, you can see the calls and results (or check the source).