sd-webui-comfy not loading in webui tab remotely.

[Shadowzeny]

Hey, I am unsure if this is similar to the domain issue from about 2 weeks back but I am having an issue when attempting to load comfyui through the webui remotely. This is within the vlad/SD.Next, windows 11. All installed fine no error outputs in the terminal and it accepts the 0.0.0.0:8189 input for the cli webui argument to point at the ComfyUi.

Screenshot of what occurs:

Terminal output: PS D:\AI Stuff\Vlad1111> .\webui.bat --listen --comfyui-listen Using VENV: D:\AI Stuff\Vlad1111\venv 10:25:03-696502 INFO Starting SD.Next 10:25:03-702502 INFO Python 3.10.6 on Windows 10:25:03-726502 INFO Version: 9d17cf4c Mon Aug 7 19:50:39 2023 +0300 10:25:04-188180 INFO Latest published version: ff2d846667f62bd83a49b85e44e137e97c64727b 2023-08-07T21:51:23Z 10:25:04-191699 INFO nVidia CUDA toolkit detected 10:25:04-269290 WARNING Modified files: ['modules/lora', 'modules/lycoris'] 10:25:04-294546 INFO Disabled extensions: ['sd-webui-agent-scheduler'] 10:25:04-295547 INFO Enabled extensions-builtin: ['a1111-sd-webui-lycoris', 'clip-interrogator-ext', 'LDSR', 'Lora', 'multidiffusion-upscaler-for-automatic1111', 'ScuNET', 'sd-dynamic-thresholding', 'sd-extension-system-info', 'sd-webui-controlnet', 'stable-diffusion-webui-images-browser', 'stable-diffusion-webui-rembg', 'SwinIR'] 10:25:04-297546 INFO Enabled extensions: ['a1111-sd-webui-tagcomplete', 'novelai-2-local-prompt', 'OneButtonPrompt', 'openpose-editor', 'sd-canvas-editor', 'sd-webui-3d-open-pose-editor', 'sd-webui-comfyui', 'sd-webui-infinite-image-browsing', 'sd-webui-inpaint-anything', 'sd-webui-regional-prompter', 'stable-diffusion-webui-aesthetic-image-scorer', 'Stable-Diffusion-Webui-Civitai-Helper'] 10:25:04-301064 INFO Verifying requirements 10:25:04-308064 INFO Verifying packages 10:25:04-313571 INFO Verifying repositories 10:25:08-099765 INFO Verifying submodules 10:25:23-322068 INFO Extensions enabled: ['a1111-sd-webui-lycoris', 'clip-interrogator-ext', 'LDSR', 'Lora', 'multidiffusion-upscaler-for-automatic1111', 'ScuNET', 'sd-dynamic-thresholding', 'sd-extension-system-info', 'sd-webui-controlnet', 'stable-diffusion-webui-images-browser', 'stable-diffusion-webui-rembg', 'SwinIR', 'a1111-sd-webui-tagcomplete', 'novelai-2-local-prompt', 'OneButtonPrompt', 'openpose-editor', 'sd-canvas-editor', 'sd-webui-3d-open-pose-editor', 'sd-webui-comfyui', 'sd-webui-infinite-image-browsing', 'sd-webui-inpaint-anything', 'sd-webui-regional-prompter', 'stable-diffusion-webui-aesthetic-image-scorer', 'Stable-Diffusion-Webui-Civitai-Helper'] 10:25:23-323068 INFO Verifying packages 10:25:23-327068 INFO Extension preload: 0.0s D:\AI Stuff\Vlad1111\extensions-builtin 10:25:23-328068 INFO Extension preload: 0.0s D:\AI Stuff\Vlad1111\extensions 10:25:23-335521 INFO Server arguments: ['--listen', '--comfyui-listen'] No module 'xformers'. Proceeding without it. 10:25:27-056966 INFO Pipeline: Backend.ORIGINAL 10:25:27-419001 INFO Libraries loaded 10:25:27-420002 INFO Using data path: D:\AI Stuff\Vlad1111 10:25:27-423508 INFO Available VAEs: D:\AI Stuff\Model Storage\models\VAE 5 10:25:27-462423 INFO Available models: D:\AI Stuff\Model Storage\models\Stable-diffusion 98 10:25:28-522759 INFO ControlNet v1.1.233 ControlNet v1.1.233 ControlNet preprocessor location: D:\AI Stuff\Vlad1111\extensions-builtin\sd-webui-controlnet\annotator\downloads 10:25:28-601745 INFO ControlNet v1.1.233 ControlNet v1.1.233 Tag Autocomplete: Could not locate model-keyword extension, LORA/LYCO trigger word completion will be unavailable. [sd-webui-comfyui] restoring graceful SIGINT handler for the webui process Civitai Helper: Get Custom Model Folder Civitai Helper: Load setting from: D:\AI Stuff\Vlad1111\extensions\Stable-Diffusion-Webui-Civitai-Helper\setting.json Civitai Helper: No setting file, use default 10:25:34-064803 INFO Loading UI theme: name=gradio/default style=Dark 10:25:34-103894 INFO Extra network created thumbnails: checkpoints 0 Running on local URL: http://0.0.0.0:7860 10:25:40-360323 INFO Local URL: http://localhost:7860/ 10:25:40-361323 INFO Initializing middleware [sd-webui-comfyui] started callback listeners for process webui Loading weights: D:\AI Stuff\Model Storage\models\Stable-diffusion\bb95FurryMix_v110.safetensors ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/4.3 GB -:--:--10:25:41-246073 INFO Setting Torch parameters: dtype=torch.float16 vae=torch.float16 unet=torch.float16 LatentDiffusion: Running in eps-prediction mode DiffusionWrapper has 859.52 M params. [ComfyUI] [sd-webui-comfyui] started callback listeners for process comfyui [ComfyUI] [sd-webui-comfyui] Injecting custom extensions... [ComfyUI] Total VRAM 24564 MB, total RAM 65277 MB Loading weights: D:\AI Stuff\Model Storage\models\VAE\vae-ft-mse-840000-ema-pruned.safetensors ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/334.6 MB -:--:--10:25:42-759007 INFO Applying scaled dot product cross attention optimization 10:25:42-790859 INFO Embeddings: loaded=28 skipped=5 10:25:42-795859 INFO Model loaded in 1.8s (load=0.3s create=0.2s apply=0.5s vae=0.5s move=0.4s) 10:25:42-984319 INFO Model load finished: {'ram': {'used': 5.32, 'total': 63.75}, 'gpu': {'used': 4.19, 'total': 23.99}, 'retries': 0, 'oom': 0} cached=0 10:25:43-449493 INFO Startup time: 20.1s (torch=2.6s gradio=0.5s libraries=1.0s scripts=6.3s onchange=0.3s ui-txt2img=0.3s ui-img2img=0.1s ui-settings=0.2s ui-extensions=1.4s launch=4.3s app-started=0.2s checkpoint=2.8s) [ComfyUI] Set vram state to: NORMAL_VRAM [ComfyUI] Device: cuda:0 NVIDIA GeForce RTX 3090 Ti : native [ComfyUI] Using pytorch cross attention [ComfyUI] [sd-webui-comfyui] Launching ComfyUI with arguments: --listen 0.0.0.0 --port 8189 [ComfyUI] Import times for custom nodes: [ComfyUI] 0.0 seconds: D:\AI Stuff\Vlad1111\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_save_image.py [ComfyUI] 0.0 seconds: D:\AI Stuff\Vlad1111\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_io.py [ComfyUI] 0.0 seconds: D:\AI Stuff\Vlad1111\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_checkpoint_loader.py [ComfyUI] [ComfyUI] Starting server

11:50:16-276332 INFO Exiting [sd-webui-comfyui] stopped callback listeners for process webui Terminate batch job (Y/N)? y PS D:\AI Stuff\Vlad1111> .\webui.bat --listen --comfyui-listen --webui-comfyui-client-address 0.0.0.0:8189 Using VENV: D:\AI Stuff\Vlad1111\venv 11:50:55-809512 INFO Starting SD.Next 11:50:55-815061 INFO Python 3.10.6 on Windows 11:50:55-844743 INFO Version: 9d17cf4c Mon Aug 7 19:50:39 2023 +0300 11:50:56-548215 INFO Latest published version: ff2d846667f62bd83a49b85e44e137e97c64727b 2023-08-07T21:51:23Z 11:50:56-552263 INFO nVidia CUDA toolkit detected 11:50:56-614961 WARNING Modified files: ['modules/lora', 'modules/lycoris'] 11:50:56-640775 INFO Disabled extensions: ['sd-webui-agent-scheduler'] 11:50:56-641777 INFO Enabled extensions-builtin: ['a1111-sd-webui-lycoris', 'clip-interrogator-ext', 'LDSR', 'Lora', 'multidiffusion-upscaler-for-automatic1111', 'ScuNET', 'sd-dynamic-thresholding', 'sd-extension-system-info', 'sd-webui-controlnet', 'stable-diffusion-webui-images-browser', 'stable-diffusion-webui-rembg', 'SwinIR'] 11:50:56-643861 INFO Enabled extensions: ['a1111-sd-webui-tagcomplete', 'novelai-2-local-prompt', 'OneButtonPrompt', 'openpose-editor', 'sd-canvas-editor', 'sd-webui-3d-open-pose-editor', 'sd-webui-comfyui', 'sd-webui-infinite-image-browsing', 'sd-webui-inpaint-anything', 'sd-webui-regional-prompter', 'stable-diffusion-webui-aesthetic-image-scorer', 'Stable-Diffusion-Webui-Civitai-Helper'] 11:50:56-647312 INFO Verifying requirements 11:50:56-656827 INFO Verifying packages 11:50:56-662827 INFO Verifying repositories 11:51:00-550719 INFO Verifying submodules 11:51:20-808695 INFO Extensions enabled: ['a1111-sd-webui-lycoris', 'clip-interrogator-ext', 'LDSR', 'Lora', 'multidiffusion-upscaler-for-automatic1111', 'ScuNET', 'sd-dynamic-thresholding', 'sd-extension-system-info', 'sd-webui-controlnet', 'stable-diffusion-webui-images-browser', 'stable-diffusion-webui-rembg', 'SwinIR', 'a1111-sd-webui-tagcomplete', 'novelai-2-local-prompt', 'OneButtonPrompt', 'openpose-editor', 'sd-canvas-editor', 'sd-webui-3d-open-pose-editor', 'sd-webui-comfyui', 'sd-webui-infinite-image-browsing', 'sd-webui-inpaint-anything', 'sd-webui-regional-prompter', 'stable-diffusion-webui-aesthetic-image-scorer', 'Stable-Diffusion-Webui-Civitai-Helper'] 11:51:20-810921 INFO Verifying packages 11:51:20-814007 INFO Extension preload: 0.0s D:\AI Stuff\Vlad1111\extensions-builtin 11:51:20-815007 INFO Extension preload: 0.0s D:\AI Stuff\Vlad1111\extensions 11:51:20-839614 INFO Server arguments: ['--listen', '--comfyui-listen', '--webui-comfyui-client-address', '0.0.0.0:8189'] No module 'xformers'. Proceeding without it. 11:51:25-556295 INFO Pipeline: Backend.ORIGINAL 11:51:26-390568 INFO Libraries loaded 11:51:26-391568 INFO Using data path: D:\AI Stuff\Vlad1111 11:51:26-395568 INFO Available VAEs: D:\AI Stuff\Model Storage\models\VAE 5 11:51:27-169707 INFO Available models: D:\AI Stuff\Model Storage\models\Stable-diffusion 98 11:51:28-303101 INFO ControlNet v1.1.233 ControlNet v1.1.233 ControlNet preprocessor location: D:\AI Stuff\Vlad1111\extensions-builtin\sd-webui-controlnet\annotator\downloads 11:51:28-512422 INFO ControlNet v1.1.233 ControlNet v1.1.233 Tag Autocomplete: Could not locate model-keyword extension, LORA/LYCO trigger word completion will be unavailable. [sd-webui-comfyui] restoring graceful SIGINT handler for the webui process Civitai Helper: Get Custom Model Folder Civitai Helper: Load setting from: D:\AI Stuff\Vlad1111\extensions\Stable-Diffusion-Webui-Civitai-Helper\setting.json Civitai Helper: No setting file, use default 11:51:34-704611 INFO Loading UI theme: name=gradio/default style=Dark 11:51:35-031390 INFO Extra network created thumbnails: checkpoints 0 Running on local URL: http://0.0.0.0:7860 11:51:41-982860 INFO Local URL: http://localhost:7860/ 11:51:41-984867 INFO Initializing middleware [sd-webui-comfyui] started callback listeners for process webui Loading weights: D:\AI Stuff\Model Storage\models\Stable-diffusion\bb95FurryMix_v110.safe… 11:51:42-875012 INFO Setting Torch parameters: dtype=torch.float16 vae=torch.float16 unet=torch.float16 LatentDiffusion: Running in eps-prediction mode DiffusionWrapper has 859.52 M params. [ComfyUI] [sd-webui-comfyui] started callback listeners for process comfyui [ComfyUI] [sd-webui-comfyui] Injecting custom extensions... [ComfyUI] Total VRAM 24564 MB, total RAM 65277 MB Loading weights: D:\AI Stuff\Model Storage\models\VAE\vae-ft-mse-840000-ema-pruned.safete… 11:51:44-449731 INFO Applying scaled dot product cross attention optimization 11:51:44-982107 INFO Embeddings: loaded=28 skipped=5 11:51:44-986107 INFO Model loaded in 2.4s (load=0.3s create=0.2s apply=0.5s vae=0.5s move=0.4s embeddings=0.5s) 11:51:45-176018 INFO Model load finished: {'ram': {'used': 5.31, 'total': 63.75}, 'gpu': {'used': 4.19, 'total': 23.99}, 'retries': 0, 'oom': 0} cached=0 [ComfyUI] Set vram state to: NORMAL_VRAM [ComfyUI] Device: cuda:0 NVIDIA GeForce RTX 3090 Ti : native [ComfyUI] Using pytorch cross attention [ComfyUI] [sd-webui-comfyui] Launching ComfyUI with arguments: --listen 0.0.0.0 --port 8189 11:51:45-658939 INFO Startup time: 24.8s (torch=2.6s gradio=1.0s libraries=1.9s models=0.8s scripts=7.2s onchange=0.3s ui-txt2img=1.1s ui-img2img=0.1s ui-settings=0.2s ui-extensions=1.6s ui-defaults=0.1s launch=4.3s app-started=0.2s checkpoint=3.4s) [ComfyUI] Import times for custom nodes: [ComfyUI] 0.0 seconds: D:\AI Stuff\Vlad1111\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_save_image.py [ComfyUI] 0.0 seconds: D:\AI Stuff\Vlad1111\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_io.py [ComfyUI] 0.0 seconds: D:\AI Stuff\Vlad1111\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_checkpoint_loader.py [ComfyUI] [ComfyUI] Starting server

[ComfyUI] To see the GUI go to: http://0.0.0.0:8189

No issues with ComfyUI itself when held by SD.Next/Vlad runs perfectly, just the output in the tab does not display while using the --listen hook to push both SD.Next and ComfyUI through VPN. I have tried giving a straight IP for what the pc its hosted on is but no dice. Any help appreciated :).

[ljleb]

I am having an issue when attempting to load comfyui through the webui remotely

Thanks for reporting this, it does seem related to #82.

To be able to resolve these network issues, I need more information. If you could describe your setup in more detail, this would help as I am very unfamiliar with the environment people use in these 2 issues. Without this information, I am having a hard time understanding how to write the code so as to take as many edge cases into account as possible.

For example, do you use a google colab script? If so, could you please share a link to a colab in which I can reproduce the issue? Otherwise, please describe how to setup your environment so that we can reproduce it on a local machine to make debugging possible. For example, are you just using 2 machines where one runs the webui with --listen and the other tries to open the webui from the local network or through another client somewhere else in the world?

[Shadowzeny]

Thanks for getting back ljleb

I will do my best to answer what you ask.

This is purely self hosted, no google collab, I use a VPN tunnel called Tailscale to link between main pc and surface pro when I am out and about, which give/assignes certain IP's.

The --listen hook is just on the single machine effectlivey becoming the server with the address assigned to in the VPN its host name. The 0.0.0.0: is usually sufficent for hosting Sd.Next and Comfy UI since it connects to those.

My Enviroment is setup locally, I run SD.Next with the normal configuation out of box, the only change I make is pointing models, VAE, LoRA and checkpoints to a mass folder on the same drive. The only change to the start up I make is the using the --listen hook while connected to the VPN. Opening on the local network while at home bares the same result of a blank ComfyUI webui tab. Only when its not using the --listen hook does it function correctly.

[ljleb]

Thank you for the details, I believe I will be able to investigate this now. I'll try to reproduce it on my side when I'm done with reworking the comfyui startup mechanism.

[unolee]

I am in similar situation in runpod.io. Hope to add some address, port and domain config. Many thanks

[rookiexjl]

--comfyui-listen --webui-comfyui-client-address 192.168.xx,xx add is ok

[unolee]

--comfyui-listen --webui-comfyui-client-address 192.168.xx,xx add is ok

Well, it doesn't work in runpod.

[rookiexjl]

i can, my all  --xformers --autolaunch --theme dark --api --listen --cors-allow-origins=https://www.painthua.com --comfyui-listen --webui-comfyui-client-address 192.168.xx,xx , you try

------------------ 原始邮件 ------------------ 发件人: "Uno @.>; 发送时间: 2023年8月10日(星期四) 晚上7:37 收件人: @.>; 抄送: @.>; @.>; 主题: Re: [ModelSurge/sd-webui-comfyui] sd-webui-comfy not loading in webui tab remotely. (Issue #107)

--comfyui-listen --webui-comfyui-client-address 192.168.xx,xx add is ok

Well, it doesn't work in runpod.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.***>

[rookiexjl]

--comfyui-listen --webui-comfyui-client-address 192.168.xx,xx add is ok

Well, it doesn't work in runpod. i can, my all  --xformers --autolaunch --theme dark --api --listen --cors-allow-origins=https://www.painthua.com/ --comfyui-listen --webui-comfyui-client-address 192.168.xx,xx , you try

[unolee]

Still, I have a problem on runpod.io

Here is my config. I tried as 0.0.0.0 or 127.0.0.1 ... no luck

[ljleb]

The extension should work when a1111 is started as a reverse proxy now. I also updated the address of --webui-comfyui-client-address to take the protocol and port as input.

Note that the extension needs --api for these cases. It will start a reverse proxy on a route in the fastapi server and let the iframes load from that route.

The extension looks for flags like --share or --ngrok or other flags supported by https://github.com/Bing-su/sd-webui-tunnels and starts the proxy whenever it recognizes a need for it. If you don't like this behavior, you can switch it to always on or always off in the settings.

Comfyui should not need any special online flag like --comfyui-listen or --webui-comfyui-client-address or other similar flags, as the reverse proxy will make requests to the comfyui server directly, which should be on the same machine.

[unolee]

Comfyui should not need any special online flag like --comfyui-listen or --webui-comfyui-client-address similar, as the reverse proxy will make requests to the comfyui server directly, which should be on the same machine.

So, may I leave 2nd and 3rd options as empty? or put 3rd option with https://a34m3gxgxxx-3001.proxy.runpod.net/ like that?

In the log, I can find : [sd-webui-comfyui] Launching ComfyUI with arguments: --listen 127.0.0.1 --port 8189

Anyhow I can't make it working - maybe my config was wrong by misunderstand.

[ljleb]

In the settings, does it work if you try setting "Load ComfyUI iframes through a reverse proxy (requires reload UI. Needs --api. Default is on if webui is remote)" to "Always" and then restart the webui completely?

So, may I leave 2nd and 3rd options as empty? or put 3rd option with https://a34m3gxgxxx-3001.proxy.runpod.net/ like that?

you should leave both the flags and the client address fields empty now, unless you want to specify specific config in the cli args text field. Make sure to pass --api to the webui and select "Always" for the reverse proxy. If you don't see the option, you need to update the extension.

[rookiexjl]

------------------ 原始邮件 ------------------ 发件人: "Uno @.>; 发送时间: 2023年8月17日(星期四) 凌晨1:00 收件人: @.>; 抄送: @.>; @.>; 主题: Re: [ModelSurge/sd-webui-comfyui] sd-webui-comfy not loading in webui tab remotely. (Issue #107)

Still, I have a problem on runpod.io

Here is my config. I tried as 0.0.0.0 or 127.0.0.1 ... no luck

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.***>

[rookiexjl]

you set webui-user.bat

------------------ 原始邮件 ------------------ 发件人: "Uno @.>; 发送时间: 2023年8月17日(星期四) 凌晨4:58 收件人: @.>; 抄送: @.>; @.>; 主题: Re: [ModelSurge/sd-webui-comfyui] sd-webui-comfy not loading in webui tab remotely. (Issue #107)

Comfyui should not need any special online flag like --comfyui-listen or --webui-comfyui-client-address similar, as the reverse proxy will make requests to the comfyui server directly, which should be on the same machine.

So, may I leave 2nd and 3rd options as empty? or put 3rd option with https://a34m3gxgxxx-3001.proxy.runpod.net/ like that?

Anyhow I can't make it working - maybe my config was wrong by misunderstand.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.***>

[ljleb]

@unolee In the log, I can find : [sd-webui-comfyui] Launching ComfyUI with arguments: --listen 127.0.0.1 --port 8189

Can you find a line [sd-webui-comfyui] Created a reverse proxy route to ComfyUI: /sd-webui-comfyui/comfyui as well? If not, the configuration is not correct and the reverse proxy did not start as a result of this. In this case, all you should need to do is:

1. update the extension
2. start the webui with --api
3. select "always" to enable the reverse proxy in the settings
4. reload the server completely

[unolee]

Can you find a line [sd-webui-comfyui] Created a reverse proxy route to ComfyUI: /sd-webui-comfyui/comfyui as well? Ifnot, the configuration is not correct and the reverse proxy did not start as a result of this. In this case, all you should need to do is:

1. update the extension
2. start the webui with --api
3. select "always" to enable the reverse proxy in the settings
4. reload the server completely

Yes, but,

Still No work for me in runpod. Here is my setting

First. I put below in webui-user.bat set COMMANDLINE_ARGS=--autolaunch --theme dark --api --listen --cors-allow-origins=https://proxy.runpod.net --comfyui-listen --webui-comfyui-client-address 127.0.0.1

I tried 0.0.0.0 also.

In the log, I could find

Launching Web UI with arguments: -f --port 3000 --xformers --skip-install --listen --api --enable-insecure-extension-access ... Running on local URL: http://0.0.0.0:3000 ... [sd-webui-comfyui] Started callback listeners for process webui [sd-webui-comfyui] Created a reverse proxy route to ComfyUI: /sd-webui-comfyui/comfyui

[rookiexjl]

127.0.0.1 ipconfig replace

------------------ 原始邮件 ------------------ 发件人: "Uno @.>; 发送时间: 2023年8月17日(星期四) 下午2:12 收件人: @.>; 抄送: @.>; @.>; 主题: Re: [ModelSurge/sd-webui-comfyui] sd-webui-comfy not loading in webui tab remotely. (Issue #107)

Can you find a line [sd-webui-comfyui] Created a reverse proxy route to ComfyUI: /sd-webui-comfyui/comfyui as well? Ifnot, the configuration is not correct and the reverse proxy did not start as a result of this. In this case, all you should need to do is:

update the extension

start the webui with --api

select "always" to enable the reverse proxy in the settings

reload the server completely

Yes, but,

Still No work for me in runpod. Here is my setting

First. I put below in webui-user.bat set COMMANDLINE_ARGS=--autolaunch --theme dark --api --listen --cors-allow-origins=https://proxy.runpod.net --comfyui-listen --webui-comfyui-client-address 127.0.0.1

In the log, I could find

Launching Web UI with arguments: -f --port 3000 --xformers --skip-install --listen --api --enable-insecure-extension-access ... Running on local URL: http://0.0.0.0:3000 ... [sd-webui-comfyui] Started callback listeners for process webui [sd-webui-comfyui] Created a reverse proxy route to ComfyUI: /sd-webui-comfyui/comfyui

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.***>

[ljleb]

set COMMANDLINE_ARGS=--autolaunch --theme dark --api --listen --cors-allow-origins=https://proxy.runpod.net/ --comfyui-listen --webui-comfyui-client-address 127.0.0.1

I tried 0.0.0.0 also.

Hm. What address do the ifrmaes have in their src= in the html page? Are the iframes not loading, or just comfyui not directly reachable? Are there any errors in the web page? Or is the webui itself not available instead?

You should be able to reach the comfyui server under the address of the webui server at http://webui-address.example.com:7860/sd-webui-comfyui/comfyui. if you just open a brewser there you should see comfyui.

Also with this setup, you really don't need --comfyui-listen or --webui-comfyui-client-address

[ljleb]

I tried setting up runpod but it seems that comfyui is simply not starting. You should see a series of logs with [ComfyUI] ... which is the output of comfyui, but on my side I can't see any of that. Is runpod preventing subprocess popens?

[ljleb]

Even when changing models I can't see any logs. Do they stop updating the logs after some point in the init procedure? That would be really bad, we need those logs. This is what I see if I setup comfyui properly the first time:

logs

``` 2023-08-17T13:07:43.174217867Z 2023-08-17T13:07:43.174220592Z --- 2023-08-17T13:07:44.602403807Z Python 3.10.12 (main, Jun 11 2023, 05:26:28) [GCC 11.4.0] 2023-08-17T13:07:44.602432742Z Version: v1.5.1 2023-08-17T13:07:44.602435698Z Commit hash: 68f336bd994bed5442ad95bad6b6ad5564a5409a 2023-08-17T13:07:44.602437682Z 2023-08-17T13:07:44.602439495Z 2023-08-17T13:07:44.602441399Z 2023-08-17T13:07:44.602443302Z Launching Web UI with arguments: -f --api --port 3000 --xformers --skip-install --listen --enable-insecure-extension-access 2023-08-17T13:07:44.602446268Z no module 'xformers'. Processing without... 2023-08-17T13:07:44.602448873Z no module 'xformers'. Processing without... 2023-08-17T13:07:44.602450857Z No module 'xformers'. Proceeding without it. 2023-08-17T13:07:44.602452991Z 2023-08-17 13:07:44,602 - ControlNet - INFO - ControlNet v1.1.234 2023-08-17T13:07:44.690785319Z ControlNet preprocessor location: /workspace/stable-diffusion-webui/extensions/sd-webui-controlnet/annotator/downloads 2023-08-17T13:07:44.690811939Z 2023-08-17 13:07:44,690 - ControlNet - INFO - ControlNet v1.1.234 2023-08-17T13:07:45.915552861Z Loading weights [31e35c80fc] from /workspace/stable-diffusion-webui/models/Stable-diffusion/sd_xl_base_1.0.safetensors 2023-08-17T13:07:45.915581846Z *Deforum ControlNet support: enabled* 2023-08-17T13:07:47.559316741Z Running on local URL: http://0.0.0.0:3000 2023-08-17T13:07:47.559348290Z 2023-08-17T13:07:47.559351026Z To create a public link, set `share=True` in `launch()`. 2023-08-17T13:07:47.559353911Z [sd-webui-comfyui] Started callback listeners for process webui 2023-08-17T13:07:47.559356356Z [sd-webui-comfyui] Created a reverse proxy route to ComfyUI: /sd-webui-comfyui/comfyui 2023-08-17T13:07:47.559359341Z Startup time: 10.8s (launcher: 2.2s, import torch: 2.9s, import gradio: 1.3s, setup paths: 0.9s, other imports: 1.0s, load scripts: 1.0s, create ui: 0.9s, gradio launch: 0.3s, add APIs: 0.1s, app_started_callback: 0.1s). 2023-08-17T13:07:47.559366204Z Creating model from config: /workspace/stable-diffusion-webui/repositories/generative-models/configs/inference/sd_xl_base.yaml 2023-08-17T13:07:47.638503264Z Downloading (…)olve/main/vocab.json: 0%| | 0.00/961k [00:00

comfyui runs in its own process, maybe this is a situation runpod struggles with for some reason. With the previous configuration I made, I ended up in a situation where even restarting the pod didn't kill the comfyui server. The pod was off, but comfyui was still running? This looks like a bug, and if it really does not charge you for gpu usage during that time, well you can maybe exploit this to launch stable diffusion in its own process for free... which isn't good. It is likely they pause the container and then resume it later on, so maybe there's no real issue with that on their side.

[ljleb]

Here is what I get if I try to restart runpod:

logs

``` 2023-08-17T13:26:35.050170548Z ################################################################ 2023-08-17T13:26:35.050172048Z Launching launch.py... 2023-08-17T13:26:35.050173298Z ################################################################ 2023-08-17T13:26:35.051506734Z Using TCMalloc: libtcmalloc_minimal.so.4 2023-08-17T13:26:41.398598620Z *** Cannot import xformers 2023-08-17T13:26:41.398854115Z Traceback (most recent call last): 2023-08-17T13:26:41.398858475Z File "/workspace/stable-diffusion-webui/modules/sd_hijack_optimizations.py", line 156, in 2023-08-17T13:26:41.398860385Z import xformers.ops 2023-08-17T13:26:41.398861815Z ModuleNotFoundError: No module named 'xformers' 2023-08-17T13:26:41.398863016Z 2023-08-17T13:26:41.398863886Z --- 2023-08-17T13:26:42.447037411Z Python 3.10.12 (main, Jun 11 2023, 05:26:28) [GCC 11.4.0] 2023-08-17T13:26:42.447052101Z Version: v1.5.1 2023-08-17T13:26:42.447053821Z Commit hash: 68f336bd994bed5442ad95bad6b6ad5564a5409a 2023-08-17T13:26:42.447054891Z 2023-08-17T13:26:42.447055791Z 2023-08-17T13:26:42.447056711Z 2023-08-17T13:26:42.447057571Z Launching Web UI with arguments: -f --port 3000 --xformers --skip-install --listen --enable-insecure-extension-access 2023-08-17T13:26:42.447060472Z no module 'xformers'. Processing without... 2023-08-17T13:26:42.447061672Z no module 'xformers'. Processing without... 2023-08-17T13:26:42.447062522Z No module 'xformers'. Proceeding without it. 2023-08-17T13:26:42.447063412Z 2023-08-17 13:26:42,446 - ControlNet - INFO - ControlNet v1.1.234 2023-08-17T13:26:42.516434474Z ControlNet preprocessor location: /workspace/stable-diffusion-webui/extensions/sd-webui-controlnet/annotator/downloads 2023-08-17T13:26:42.516441974Z 2023-08-17 13:26:42,516 - ControlNet - INFO - ControlNet v1.1.234 2023-08-17T13:26:43.383867777Z Loading weights [31e35c80fc] from /workspace/stable-diffusion-webui/models/Stable-diffusion/sd_xl_base_1.0.safetensors 2023-08-17T13:26:43.383879927Z *Deforum ControlNet support: enabled* 2023-08-17T13:26:46.112590425Z [ComfyUI] [sd-webui-comfyui] Setting up IPC... 2023-08-17T13:26:46.112611376Z [ComfyUI] [sd-webui-comfyui] Using inter-process communication strategy: File system 2023-08-17T13:26:46.112613756Z [ComfyUI] [sd-webui-comfyui] Started callback listeners for process comfyui 2023-08-17T13:26:46.112615176Z [ComfyUI] [sd-webui-comfyui] Patching ComfyUI... 2023-08-17T13:26:46.112616156Z [ComfyUI] Total VRAM 7971 MB, total RAM 32018 MB 2023-08-17T13:26:46.112617136Z [ComfyUI] Set vram state to: NORMAL_VRAM 2023-08-17T13:26:46.112618146Z [ComfyUI] Device: cuda:0 NVIDIA GeForce RTX 3070 : native 2023-08-17T13:26:46.112619606Z [ComfyUI] Using pytorch cross attention 2023-08-17T13:26:46.112620536Z [ComfyUI] [sd-webui-comfyui] Launching ComfyUI with arguments: --listen 127.0.0.1 --port 8189 2023-08-17T13:26:46.112621556Z [ComfyUI] 2023-08-17T13:26:46.112622656Z Import times for custom nodes: 2023-08-17T13:26:46.112623826Z [ComfyUI] 0.0 seconds: /workspace/stable-diffusion-webui/extensions/sd-webui-comfyui/comfyui_custom_nodes/webui_io.py 2023-08-17T13:26:46.112624976Z [ComfyUI] 0.0 seconds: /workspace/stable-diffusion-webui/extensions/sd-webui-comfyui/comfyui_custom_nodes/webui_save_image.py 2023-08-17T13:26:46.112625956Z [ComfyUI] 0.0 seconds: /workspace/stable-diffusion-webui/extensions/sd-webui-comfyui/comfyui_custom_nodes/webui_proxy_nodes.py 2023-08-17T13:26:46.112627286Z [ComfyUI] 2023-08-17T13:26:46.331565692Z ╭───────────────────── Traceback (most recent call last) ──────────────────────╮ 2023-08-17T13:26:46.331588833Z │ /workspace/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/co │ 2023-08-17T13:26:46.331591073Z │ mfyui/pre_main.py:93 in │ 2023-08-17T13:26:46.331592503Z │ │ 2023-08-17T13:26:46.331593653Z │ 90 │ 2023-08-17T13:26:46.331594543Z │ 91 if __name__ == '__main__': │ 2023-08-17T13:26:46.331601133Z │ 92 │ ipc.current_process_id = 'comfyui' │ 2023-08-17T13:26:46.331605663Z │ ❱ 93 │ main() │ 2023-08-17T13:26:46.331606603Z │ 94 │ 2023-08-17T13:26:46.331607463Z │ │ 2023-08-17T13:26:46.331608343Z │ /workspace/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/ip │ 2023-08-17T13:26:46.331609173Z │ c/__init__.py:41 in wrapper │ 2023-08-17T13:26:46.331610083Z │ │ 2023-08-17T13:26:46.331610923Z │ 38 │ │ │ if process_id != current_process_id: │ 2023-08-17T13:26:46.331611773Z │ 39 │ │ │ │ raise RuntimeError(f'Can only call function {function._ │ 2023-08-17T13:26:46.331612633Z │ 40 │ │ │ │ 2023-08-17T13:26:46.331613513Z │ ❱ 41 │ │ │ return function(*args, **kwargs) │ 2023-08-17T13:26:46.331614353Z │ 42 │ │ │ 2023-08-17T13:26:46.331615203Z │ 43 │ │ return wrapper │ 2023-08-17T13:26:46.331616083Z │ 44 │ 2023-08-17T13:26:46.331616963Z │ │ 2023-08-17T13:26:46.331617833Z │ /workspace/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/co │ 2023-08-17T13:26:46.331619673Z │ mfyui/pre_main.py:26 in main │ 2023-08-17T13:26:46.331620543Z │ │ 2023-08-17T13:26:46.331621393Z │ 23 │ fix_path() │ 2023-08-17T13:26:46.331622263Z │ 24 │ setup_ipc() │ 2023-08-17T13:26:46.331623123Z │ 25 │ patch_comfyui() │ 2023-08-17T13:26:46.331623963Z │ ❱ 26 │ start_comfyui() │ 2023-08-17T13:26:46.331624833Z │ 27 │ 2023-08-17T13:26:46.331625663Z │ 28 │ 2023-08-17T13:26:46.331626543Z │ 29 @ipc.restrict_to_process('comfyui') │ 2023-08-17T13:26:46.331627373Z │ │ 2023-08-17T13:26:46.331628213Z │ /workspace/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/ip │ 2023-08-17T13:26:46.331629043Z │ c/__init__.py:41 in wrapper │ 2023-08-17T13:26:46.331629883Z │ │ 2023-08-17T13:26:46.331630713Z │ 38 │ │ │ if process_id != current_process_id: │ 2023-08-17T13:26:46.331631593Z │ 39 │ │ │ │ raise RuntimeError(f'Can only call function {function._ │ 2023-08-17T13:26:46.331632443Z │ 40 │ │ │ │ 2023-08-17T13:26:46.331633333Z │ ❱ 41 │ │ │ return function(*args, **kwargs) │ 2023-08-17T13:26:46.331634183Z │ 42 │ │ │ 2023-08-17T13:26:46.331635123Z │ 43 │ │ return wrapper │ 2023-08-17T13:26:46.331639014Z │ 44 │ 2023-08-17T13:26:46.331640034Z │ │ 2023-08-17T13:26:46.331640884Z │ /workspace/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/co │ 2023-08-17T13:26:46.331642214Z │ mfyui/pre_main.py:88 in start_comfyui │ 2023-08-17T13:26:46.331643134Z │ │ 2023-08-17T13:26:46.331644434Z │ 85 @ipc.restrict_to_process('comfyui') │ 2023-08-17T13:26:46.331645334Z │ 86 def start_comfyui(): │ 2023-08-17T13:26:46.331646224Z │ 87 │ print('[sd-webui-comfyui]', f'Launching ComfyUI with arguments: {" │ 2023-08-17T13:26:46.331647064Z │ ❱ 88 │ runpy.run_path(os.path.join(os.getcwd(), 'main.py'), {'comfyui_prin │ 2023-08-17T13:26:46.331647984Z │ 89 │ 2023-08-17T13:26:46.331648804Z │ 90 │ 2023-08-17T13:26:46.331649654Z │ 91 if __name__ == '__main__': │ 2023-08-17T13:26:46.331650474Z │ │ 2023-08-17T13:26:46.331651394Z │ /usr/lib/python3.10/runpy.py:289 in run_path │ 2023-08-17T13:26:46.331652254Z │ │ 2023-08-17T13:26:46.331653104Z │ 286 │ │ # Not a valid sys.path entry, so run the code directly │ 2023-08-17T13:26:46.331653944Z │ 287 │ │ # execfile() doesn't help as we want to allow compiled files │ 2023-08-17T13:26:46.331654824Z │ 288 │ │ code, fname = _get_code_from_file(run_name, path_name) │ 2023-08-17T13:26:46.331655664Z │ ❱ 289 │ │ return _run_module_code(code, init_globals, run_name, │ 2023-08-17T13:26:46.331656724Z │ 290 │ │ │ │ │ │ │ │ pkg_name=pkg_name, script_name=fname) │ 2023-08-17T13:26:46.331658254Z │ 291 │ else: │ 2023-08-17T13:26:46.331659084Z │ 292 │ │ # Finder is defined for path, so add it to │ 2023-08-17T13:26:46.331659964Z │ │ 2023-08-17T13:26:46.331660844Z │ /usr/lib/python3.10/runpy.py:96 in _run_module_code │ 2023-08-17T13:26:46.331661764Z │ │ 2023-08-17T13:26:46.331662854Z │ 93 │ fname = script_name if mod_spec is None else mod_spec.origin │ 2023-08-17T13:26:46.331663764Z │ 94 │ with _TempModule(mod_name) as temp_module, _ModifiedArgv0(fname): │ 2023-08-17T13:26:46.331664784Z │ 95 │ │ mod_globals = temp_module.module.__dict__ │ 2023-08-17T13:26:46.331665844Z │ ❱ 96 │ │ _run_code(code, mod_globals, init_globals, │ 2023-08-17T13:26:46.331666794Z │ 97 │ │ │ │ mod_name, mod_spec, pkg_name, script_name) │ 2023-08-17T13:26:46.331667684Z │ 98 │ # Copy the globals of the temporary module, as they │ 2023-08-17T13:26:46.331668614Z │ 99 │ # may be cleared when the temporary module goes away │ 2023-08-17T13:26:46.331669534Z │ │ 2023-08-17T13:26:46.331670444Z │ /usr/lib/python3.10/runpy.py:86 in _run_code │ 2023-08-17T13:26:46.331671274Z │ │ 2023-08-17T13:26:46.331672194Z │ 83 │ │ │ │ │ __loader__ = loader, │ 2023-08-17T13:26:46.331674434Z │ 84 │ │ │ │ │ __package__ = pkg_name, │ 2023-08-17T13:26:46.331675314Z │ 85 │ │ │ │ │ __spec__ = mod_spec) │ 2023-08-17T13:26:46.331676314Z │ ❱ 86 │ exec(code, run_globals) │ 2023-08-17T13:26:46.331677254Z │ 87 │ return run_globals │ 2023-08-17T13:26:46.331678314Z │ 88 │ 2023-08-17T13:26:46.331679214Z │ 89 def _run_module_code(code, init_globals=None, │ 2023-08-17T13:26:46.331680874Z │ │ 2023-08-17T13:26:46.331681874Z │ /workspace/stable-diffusion-webui/extensions/sd-webui-comfyui/ComfyUI/main.p │ 2023-08-17T13:26:46.331682814Z │ y:187 in │ 2023-08-17T13:26:46.331683704Z │ │ 2023-08-17T13:26:46.331684524Z │ 184 │ │ call_on_start = startup_server │ 2023-08-17T13:26:46.331685364Z │ 185 │ │ 2023-08-17T13:26:46.331686394Z │ 186 │ try: │ 2023-08-17T13:26:46.331687264Z │ ❱ 187 │ │ loop.run_until_complete(run(server, address=args.listen, port= │ 2023-08-17T13:26:46.331688114Z │ 188 │ except KeyboardInterrupt: │ 2023-08-17T13:26:46.331689224Z │ 189 │ │ print("\nStopped server") │ 2023-08-17T13:26:46.331690194Z │ 190 │ 2023-08-17T13:26:46.331691105Z │ │ 2023-08-17T13:26:46.331691935Z │ /usr/lib/python3.10/asyncio/base_events.py:649 in run_until_complete │ 2023-08-17T13:26:46.331692775Z │ │ 2023-08-17T13:26:46.331693665Z │ 646 │ │ if not future.done(): │ 2023-08-17T13:26:46.331694585Z │ 647 │ │ │ raise RuntimeError('Event loop stopped before Future comp │ 2023-08-17T13:26:46.331695465Z │ 648 │ │ │ 2023-08-17T13:26:46.331696595Z │ ❱ 649 │ │ return future.result() │ 2023-08-17T13:26:46.331697445Z │ 650 │ │ 2023-08-17T13:26:46.331698285Z │ 651 │ def stop(self): │ 2023-08-17T13:26:46.331699135Z │ 652 │ │ """Stop running the event loop. │ 2023-08-17T13:26:46.331700075Z │ │ 2023-08-17T13:26:46.331701045Z │ /workspace/stable-diffusion-webui/extensions/sd-webui-comfyui/ComfyUI/main.p │ 2023-08-17T13:26:46.331701935Z │ y:102 in run │ 2023-08-17T13:26:46.331702835Z │ │ 2023-08-17T13:26:46.331703715Z │ 99 │ │ comfy.model_management.soft_empty_cache() │ 2023-08-17T13:26:46.331704665Z │ 100 │ 2023-08-17T13:26:46.331705515Z │ 101 async def run(server, address='', port=8188, verbose=True, call_on_sta │ 2023-08-17T13:26:46.331706435Z │ ❱ 102 │ await asyncio.gather(server.start(address, port, verbose, call_on_ │ 2023-08-17T13:26:46.331707265Z │ 103 │ 2023-08-17T13:26:46.331709165Z │ 104 │ 2023-08-17T13:26:46.331710085Z │ 105 def hijack_progress(server): │ 2023-08-17T13:26:46.331710975Z │ in start:518 │ 2023-08-17T13:26:46.331712485Z │ │ 2023-08-17T13:26:46.331713355Z │ /workspace/venv/lib/python3.10/site-packages/aiohttp/web_runner.py:121 in │ 2023-08-17T13:26:46.331714195Z │ start │ 2023-08-17T13:26:46.331715065Z │ │ 2023-08-17T13:26:46.331715915Z │ 118 │ │ loop = asyncio.get_event_loop() │ 2023-08-17T13:26:46.331716775Z │ 119 │ │ server = self._runner.server │ 2023-08-17T13:26:46.331717615Z │ 120 │ │ assert server is not None │ 2023-08-17T13:26:46.331718485Z │ ❱ 121 │ │ self._server = await loop.create_server( │ 2023-08-17T13:26:46.331719365Z │ 122 │ │ │ server, │ 2023-08-17T13:26:46.331720225Z │ 123 │ │ │ self._host, │ 2023-08-17T13:26:46.331721095Z │ 124 │ │ │ self._port, │ 2023-08-17T13:26:46.331721945Z │ │ 2023-08-17T13:26:46.331722805Z │ /usr/lib/python3.10/asyncio/base_events.py:1519 in create_server │ 2023-08-17T13:26:46.331723635Z │ │ 2023-08-17T13:26:46.331724465Z │ 1516 │ │ │ │ │ try: │ 2023-08-17T13:26:46.331725315Z │ 1517 │ │ │ │ │ │ sock.bind(sa) │ 2023-08-17T13:26:46.331726745Z │ 1518 │ │ │ │ │ except OSError as err: │ 2023-08-17T13:26:46.331727635Z │ ❱ 1519 │ │ │ │ │ │ raise OSError(err.errno, 'error while attempt │ 2023-08-17T13:26:46.331728515Z │ 1520 │ │ │ │ │ │ │ │ │ 'to bind on address %r: %s' │ 2023-08-17T13:26:46.331729385Z │ 1521 │ │ │ │ │ │ │ │ │ % (sa, err.strerror.lower())) f │ 2023-08-17T13:26:46.331730245Z │ 1522 │ │ │ │ completed = True │ 2023-08-17T13:26:46.331731315Z ╰──────────────────────────────────────────────────────────────────────────────╯ 2023-08-17T13:26:46.331732435Z OSError: [Errno 98] error while attempting to bind on address ('127.0.0.1', 2023-08-17T13:26:46.331733635Z 8189): address already in use 2023-08-17T13:26:46.846321510Z [ComfyUI] [sd-webui-comfyui] Stopped callback listeners for process comfyui ```

After this, the container just does not stop restarting.

I must say, the interface of runpod is pretty bad. I had to copy the logs one page at a time because they only load what you see on screen, the rest is not loaded until it is on screen, so I can't select all the logs at once.

[ljleb]

And then, if I restart again...

logs

``` 2023-08-17T13:39:17.859272811Z ################################################################ 2023-08-17T13:39:17.859276541Z ERROR: This script must not be launched as root, aborting... 2023-08-17T13:39:17.859278891Z ################################################################ 2023-08-17T13:39:19.866012562Z 2023-08-17T13:39:19.866033242Z ################################################################ 2023-08-17T13:39:19.866036023Z Install script for stable-diffusion + Web UI 2023-08-17T13:39:19.866037793Z Tested on Debian 11 (Bullseye) 2023-08-17T13:39:19.866040513Z ################################################################ 2023-08-17T13:39:19.867277646Z 2023-08-17T13:39:19.867288027Z ################################################################ 2023-08-17T13:39:19.867290817Z ERROR: This script must not be launched as root, aborting... 2023-08-17T13:39:19.867292897Z ################################################################ 2023-08-17T13:39:21.874101486Z 2023-08-17T13:39:21.874122006Z ################################################################ 2023-08-17T13:39:21.874125406Z Install script for stable-diffusion + Web UI 2023-08-17T13:39:21.874127106Z Tested on Debian 11 (Bullseye) 2023-08-17T13:39:21.874128966Z ################################################################ 2023-08-17T13:39:21.875275749Z 2023-08-17T13:39:21.875287229Z ################################################################ 2023-08-17T13:39:21.875290029Z ERROR: This script must not be launched as root, aborting... 2023-08-17T13:39:21.875292119Z ################################################################ 2023-08-17T13:39:23.882109597Z 2023-08-17T13:39:23.882130527Z ################################################################ 2023-08-17T13:39:23.882135147Z Install script for stable-diffusion + Web UI 2023-08-17T13:39:23.882138757Z Tested on Debian 11 (Bullseye) 2023-08-17T13:39:23.882141497Z ################################################################ 2023-08-17T13:39:23.883432142Z 2023-08-17T13:39:23.883442672Z ################################################################ 2023-08-17T13:39:23.883445512Z ERROR: This script must not be launched as root, aborting... 2023-08-17T13:39:23.883447362Z ################################################################ 2023-08-17T13:39:25.890372034Z 2023-08-17T13:39:25.890395745Z ################################################################ 2023-08-17T13:39:25.890398675Z Install script for stable-diffusion + Web UI 2023-08-17T13:39:25.890400455Z Tested on Debian 11 (Bullseye) 2023-08-17T13:39:25.890402165Z ################################################################ 2023-08-17T13:39:25.891498336Z 2023-08-17T13:39:25.891509126Z ################################################################ 2023-08-17T13:39:25.891511856Z ERROR: This script must not be launched as root, aborting... 2023-08-17T13:39:25.891513766Z ################################################################ ```

Maybe the base image is already kind of buggy? I think if anything needs to be done, it would be on the template repo. Maybe we could add a flag --kill-comfyui-address-in-use to kill the comfyui server if it's still running, as the process doesn't have the chance to get killed because of how runpod (or the template?) stops the webui.

[ljleb]

tested on colab, it works: https://colab.research.google.com/drive/18qkmnVASw1-68df156OIWK3CQpNSEtJ3?usp=sharing (patched from cameduru's v1.5 colab)

colab logs

``` /content env: TF_CPP_MIN_LOG_LEVEL=1 29 packages can be upgraded. Run 'apt list --upgradable' to see them. --2023-08-17 14:34:20-- https://github.com/camenduru/gperftools/releases/download/v1.0/libtcmalloc_minimal.so.4 Resolving github.com (github.com)... 140.82.112.3 Connecting to github.com (github.com)|140.82.112.3|:443... connected. HTTP request sent, awaiting response... 302 Found Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/669786276/620e2e64-be9f-4599-904f-18ee3811e159?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20230817%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20230817T143251Z&X-Amz-Expires=300&X-Amz-Signature=730e8084fe4431b7b12589c997018208371c48144d6c7b85a301cbe5da73c8c0&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=669786276&response-content-disposition=attachment%3B%20filename%3Dlibtcmalloc_minimal.so.4&response-content-type=application%2Foctet-stream [following] --2023-08-17 14:34:20-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/669786276/620e2e64-be9f-4599-904f-18ee3811e159?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20230817%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20230817T143251Z&X-Amz-Expires=300&X-Amz-Signature=730e8084fe4431b7b12589c997018208371c48144d6c7b85a301cbe5da73c8c0&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=669786276&response-content-disposition=attachment%3B%20filename%3Dlibtcmalloc_minimal.so.4&response-content-type=application%2Foctet-stream Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.111.133, 185.199.108.133, 185.199.109.133, ... Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.111.133|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 373960 (365K) [application/octet-stream] Saving to: ‘/content/libtcmalloc_minimal.so.4’ /content/libtcmallo 100%[===================>] 365.20K --.-KB/s in 0.03s 2023-08-17 14:34:20 (10.5 MB/s) - ‘/content/libtcmalloc_minimal.so.4’ saved [373960/373960] env: LD_PRELOAD=/content/libtcmalloc_minimal.so.4 pkg-config is already the newest version (0.29.2-1ubuntu3). python3-dev is already the newest version (3.10.6-1~22.04). python3-dev set to manually installed. The following additional packages will be installed: libaria2-0 libblkid-dev libc-ares2 libcairo-script-interpreter2 libffi-dev libglib2.0-dev libglib2.0-dev-bin libice-dev liblzo2-2 libmount-dev libpixman-1-dev libselinux1-dev libsepol-dev libsm-dev libxcb-render0-dev libxcb-shm0-dev Suggested packages: libcairo2-doc libgirepository1.0-dev libglib2.0-doc libgdk-pixbuf2.0-bin | libgdk-pixbuf2.0-dev libxml2-utils libice-doc libsm-doc The following NEW packages will be installed: aria2 libaria2-0 libblkid-dev libc-ares2 libcairo-script-interpreter2 libcairo2-dev libffi-dev libglib2.0-dev libglib2.0-dev-bin libice-dev liblzo2-2 libmount-dev libpixman-1-dev libselinux1-dev libsepol-dev libsm-dev libxcb-render0-dev libxcb-shm0-dev 0 upgraded, 18 newly installed, 0 to remove and 29 not upgraded. Need to get 5,352 kB of archives. After this operation, 25.2 MB of additional disk space will be used. Selecting previously unselected package libc-ares2:amd64. (Reading database ... 120831 files and directories currently installed.) Preparing to unpack .../00-libc-ares2_1.18.1-1ubuntu0.22.04.2_amd64.deb ... Unpacking libc-ares2:amd64 (1.18.1-1ubuntu0.22.04.2) ... Selecting previously unselected package libaria2-0:amd64. Preparing to unpack .../01-libaria2-0_1.36.0-1_amd64.deb ... Unpacking libaria2-0:amd64 (1.36.0-1) ... Selecting previously unselected package aria2. Preparing to unpack .../02-aria2_1.36.0-1_amd64.deb ... Unpacking aria2 (1.36.0-1) ... Selecting previously unselected package liblzo2-2:amd64. Preparing to unpack .../03-liblzo2-2_2.10-2build3_amd64.deb ... Unpacking liblzo2-2:amd64 (2.10-2build3) ... Selecting previously unselected package libcairo-script-interpreter2:amd64. Preparing to unpack .../04-libcairo-script-interpreter2_1.16.0-5ubuntu2_amd64.deb ... Unpacking libcairo-script-interpreter2:amd64 (1.16.0-5ubuntu2) ... Selecting previously unselected package libice-dev:amd64. Preparing to unpack .../05-libice-dev_2%3a1.0.10-1build2_amd64.deb ... Unpacking libice-dev:amd64 (2:1.0.10-1build2) ... Selecting previously unselected package libsm-dev:amd64. Preparing to unpack .../06-libsm-dev_2%3a1.2.3-1build2_amd64.deb ... Unpacking libsm-dev:amd64 (2:1.2.3-1build2) ... Selecting previously unselected package libpixman-1-dev:amd64. Preparing to unpack .../07-libpixman-1-dev_0.40.0-1ubuntu0.22.04.1_amd64.deb ... Unpacking libpixman-1-dev:amd64 (0.40.0-1ubuntu0.22.04.1) ... Selecting previously unselected package libxcb-render0-dev:amd64. Preparing to unpack .../08-libxcb-render0-dev_1.14-3ubuntu3_amd64.deb ... Unpacking libxcb-render0-dev:amd64 (1.14-3ubuntu3) ... Selecting previously unselected package libxcb-shm0-dev:amd64. Preparing to unpack .../09-libxcb-shm0-dev_1.14-3ubuntu3_amd64.deb ... Unpacking libxcb-shm0-dev:amd64 (1.14-3ubuntu3) ... Selecting previously unselected package libffi-dev:amd64. Preparing to unpack .../10-libffi-dev_3.4.2-4_amd64.deb ... Unpacking libffi-dev:amd64 (3.4.2-4) ... Selecting previously unselected package libglib2.0-dev-bin. Preparing to unpack .../11-libglib2.0-dev-bin_2.72.4-0ubuntu2.2_amd64.deb ... Unpacking libglib2.0-dev-bin (2.72.4-0ubuntu2.2) ... Selecting previously unselected package libblkid-dev:amd64. Preparing to unpack .../12-libblkid-dev_2.37.2-4ubuntu3_amd64.deb ... Unpacking libblkid-dev:amd64 (2.37.2-4ubuntu3) ... Selecting previously unselected package libsepol-dev:amd64. Preparing to unpack .../13-libsepol-dev_3.3-1build1_amd64.deb ... Unpacking libsepol-dev:amd64 (3.3-1build1) ... Selecting previously unselected package libselinux1-dev:amd64. Preparing to unpack .../14-libselinux1-dev_3.3-1build2_amd64.deb ... Unpacking libselinux1-dev:amd64 (3.3-1build2) ... Selecting previously unselected package libmount-dev:amd64. Preparing to unpack .../15-libmount-dev_2.37.2-4ubuntu3_amd64.deb ... Unpacking libmount-dev:amd64 (2.37.2-4ubuntu3) ... Selecting previously unselected package libglib2.0-dev:amd64. Preparing to unpack .../16-libglib2.0-dev_2.72.4-0ubuntu2.2_amd64.deb ... Unpacking libglib2.0-dev:amd64 (2.72.4-0ubuntu2.2) ... Selecting previously unselected package libcairo2-dev:amd64. Preparing to unpack .../17-libcairo2-dev_1.16.0-5ubuntu2_amd64.deb ... Unpacking libcairo2-dev:amd64 (1.16.0-5ubuntu2) ... Setting up libglib2.0-dev-bin (2.72.4-0ubuntu2.2) ... Setting up libblkid-dev:amd64 (2.37.2-4ubuntu3) ... Setting up libpixman-1-dev:amd64 (0.40.0-1ubuntu0.22.04.1) ... Setting up libice-dev:amd64 (2:1.0.10-1build2) ... Setting up libsm-dev:amd64 (2:1.2.3-1build2) ... Setting up liblzo2-2:amd64 (2.10-2build3) ... Setting up libc-ares2:amd64 (1.18.1-1ubuntu0.22.04.2) ... Setting up libffi-dev:amd64 (3.4.2-4) ... Setting up libxcb-shm0-dev:amd64 (1.14-3ubuntu3) ... Setting up libsepol-dev:amd64 (3.3-1build1) ... Setting up libxcb-render0-dev:amd64 (1.14-3ubuntu3) ... Setting up libcairo-script-interpreter2:amd64 (1.16.0-5ubuntu2) ... Setting up libaria2-0:amd64 (1.36.0-1) ... Setting up libselinux1-dev:amd64 (3.3-1build2) ... Setting up aria2 (1.36.0-1) ... Setting up libmount-dev:amd64 (2.37.2-4ubuntu3) ... Setting up libglib2.0-dev:amd64 (2.72.4-0ubuntu2.2) ... Processing triggers for libglib2.0-0:amd64 (2.72.4-0ubuntu2.2) ... Processing triggers for libc-bin (2.35-0ubuntu3.1) ... /sbin/ldconfig.real: /usr/local/lib/libtbbbind_2_0.so.3 is not a symbolic link /sbin/ldconfig.real: /usr/local/lib/libtbbbind_2_5.so.3 is not a symbolic link /sbin/ldconfig.real: /usr/local/lib/libtbb.so.12 is not a symbolic link /sbin/ldconfig.real: /usr/local/lib/libtbbmalloc.so.2 is not a symbolic link /sbin/ldconfig.real: /usr/local/lib/libtbbmalloc_proxy.so.2 is not a symbolic link /sbin/ldconfig.real: /usr/local/lib/libtbbbind.so.3 is not a symbolic link Processing triggers for man-db (2.10.2-1) ... Setting up libcairo2-dev:amd64 (1.16.0-5ubuntu2) ... ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.0/2.0 MB 30.2 MB/s eta 0:00:00 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 109.1/109.1 MB 8.5 MB/s eta 0:00:00 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 288.4/288.4 kB 23.8 MB/s eta 0:00:00 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 75.4/75.4 kB 8.5 MB/s eta 0:00:00 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 268.8/268.8 kB 21.8 MB/s eta 0:00:00 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 129.9/129.9 kB 15.4 MB/s eta 0:00:00 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 74.5/74.5 kB 9.8 MB/s eta 0:00:00 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.3/58.3 kB 7.8 MB/s eta 0:00:00 Cloning into 'stable-diffusion-webui'... remote: Enumerating objects: 26020, done. remote: Counting objects: 100% (407/407), done. remote: Compressing objects: 100% (183/183), done. remote: Total 26020 (delta 262), reused 342 (delta 220), pack-reused 25613 Receiving objects: 100% (26020/26020), 31.77 MiB | 29.15 MiB/s, done. Resolving deltas: 100% (18218/18218), done. Cloning into '/content/stable-diffusion-webui/extensions/sd-webui-comfyui'... remote: Enumerating objects: 903, done. remote: Counting objects: 100% (446/446), done. remote: Compressing objects: 100% (269/269), done. remote: Total 903 (delta 281), reused 221 (delta 165), pack-reused 457 Receiving objects: 100% (903/903), 7.82 MiB | 27.42 MiB/s, done. Resolving deltas: 100% (491/491), done. Cloning into '/content/stable-diffusion-webui/extensions/sd-webui-comfyui/ComfyUI'... remote: Enumerating objects: 6412, done. remote: Counting objects: 100% (150/150), done. remote: Compressing objects: 100% (92/92), done. remote: Total 6412 (delta 76), reused 82 (delta 56), pack-reused 6262 Receiving objects: 100% (6412/6412), 3.07 MiB | 15.58 MiB/s, done. Resolving deltas: 100% (4206/4206), done. /content/stable-diffusion-webui Download Results: gid |stat|avg speed |path/URI ======+====+===========+======================================================= 0fadcc|OK | 212MiB/s|/content/stable-diffusion-webui/models/Stable-diffusion/v1-5-pruned-emaonly.ckpt Status Legend: (OK):download completed. Python 3.10.12 (main, Jun 11 2023, 05:26:28) [GCC 11.4.0] Version: v1.5.1 Commit hash: 68f336bd994bed5442ad95bad6b6ad5564a5409a Installing gfpgan Installing clip Installing open_clip Cloning Stable Diffusion into /content/stable-diffusion-webui/repositories/stable-diffusion-stability-ai... Cloning into '/content/stable-diffusion-webui/repositories/stable-diffusion-stability-ai'... remote: Enumerating objects: 574, done. remote: Counting objects: 100% (311/311), done. remote: Compressing objects: 100% (92/92), done. remote: Total 574 (delta 244), reused 219 (delta 219), pack-reused 263 Receiving objects: 100% (574/574), 73.43 MiB | 46.19 MiB/s, done. Resolving deltas: 100% (276/276), done. Cloning Stable Diffusion XL into /content/stable-diffusion-webui/repositories/generative-models... Cloning into '/content/stable-diffusion-webui/repositories/generative-models'... remote: Enumerating objects: 731, done. remote: Counting objects: 100% (554/554), done. remote: Compressing objects: 100% (277/277), done. remote: Total 731 (delta 334), reused 422 (delta 263), pack-reused 177 Receiving objects: 100% (731/731), 22.31 MiB | 29.71 MiB/s, done. Resolving deltas: 100% (372/372), done. Cloning K-diffusion into /content/stable-diffusion-webui/repositories/k-diffusion... Cloning into '/content/stable-diffusion-webui/repositories/k-diffusion'... remote: Enumerating objects: 770, done. remote: Counting objects: 100% (46/46), done. remote: Compressing objects: 100% (25/25), done. remote: Total 770 (delta 25), reused 34 (delta 21), pack-reused 724 Receiving objects: 100% (770/770), 157.76 KiB | 482.00 KiB/s, done. Resolving deltas: 100% (503/503), done. Cloning CodeFormer into /content/stable-diffusion-webui/repositories/CodeFormer... Cloning into '/content/stable-diffusion-webui/repositories/CodeFormer'... remote: Enumerating objects: 594, done. remote: Counting objects: 100% (245/245), done. remote: Compressing objects: 100% (97/97), done. remote: Total 594 (delta 175), reused 170 (delta 148), pack-reused 349 Receiving objects: 100% (594/594), 17.31 MiB | 35.81 MiB/s, done. Resolving deltas: 100% (286/286), done. Cloning BLIP into /content/stable-diffusion-webui/repositories/BLIP... Cloning into '/content/stable-diffusion-webui/repositories/BLIP'... remote: Enumerating objects: 277, done. remote: Counting objects: 100% (165/165), done. remote: Compressing objects: 100% (30/30), done. remote: Total 277 (delta 137), reused 136 (delta 135), pack-reused 112 Receiving objects: 100% (277/277), 7.03 MiB | 24.42 MiB/s, done. Resolving deltas: 100% (153/153), done. Installing requirements for CodeFormer Installing requirements Installing sd-webui-comfyui requirement: portalocker>=2.7.0 Launching Web UI with arguments: --listen --share --api --xformers --enable-insecure-extension-access --theme dark --gradio-queue 2023-08-17 14:36:52.275139: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT Calculating sha256 for /content/stable-diffusion-webui/models/Stable-diffusion/v1-5-pruned-emaonly.ckpt: Running on local URL: http://0.0.0.0:7860/ Running on public URL: https://217933e5c97b6f82f5.gradio.live/ This share link expires in 72 hours. For free permanent hosting and GPU upgrades (NEW!), check out Spaces: https://huggingface.co/spaces [sd-webui-comfyui] Started callback listeners for process webui [sd-webui-comfyui] Created a reverse proxy route to ComfyUI: /sd-webui-comfyui/comfyui Startup time: 116.8s (launcher: 93.9s, import torch: 7.3s, import gradio: 1.0s, setup paths: 2.7s, other imports: 2.1s, setup codeformer: 0.3s, load scripts: 2.0s, create ui: 2.2s, gradio launch: 4.4s, add APIs: 0.3s, app_started_callback: 0.6s). [ComfyUI] [sd-webui-comfyui] Setting up IPC... [ComfyUI] [sd-webui-comfyui] Using inter-process communication strategy: File system [ComfyUI] [sd-webui-comfyui] Started callback listeners for process comfyui [ComfyUI] [sd-webui-comfyui] Patching ComfyUI... [ComfyUI] Total VRAM 15102 MB, total RAM 12983 MB [ComfyUI] Enabling highvram mode because your GPU has more vram than your computer has ram. If you don't want this use: --normalvram [ComfyUI] xformers version: 0.0.20 2023-08-17 14:37:21.344945: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT [ComfyUI] Set vram state to: HIGH_VRAM [ComfyUI] Device: cuda:0 Tesla T4 : native [ComfyUI] Using xformers cross attention [ComfyUI] [sd-webui-comfyui] Launching ComfyUI with arguments: --listen 127.0.0.1 --port 8189 [ComfyUI] Import times for custom nodes: [ComfyUI] 0.0 seconds: /content/stable-diffusion-webui/extensions/sd-webui-comfyui/comfyui_custom_nodes/webui_io.py [ComfyUI] 0.0 seconds: /content/stable-diffusion-webui/extensions/sd-webui-comfyui/comfyui_custom_nodes/webui_save_image.py [ComfyUI] 0.0 seconds: /content/stable-diffusion-webui/extensions/sd-webui-comfyui/comfyui_custom_nodes/webui_proxy_nodes.py [ComfyUI] [ComfyUI] Starting server [ComfyUI] To see the GUI go to: http://127.0.0.1:8189/ cc6cb27103417325ff94f52b7a5d2dde45a7515b25c255d8e396c90014281516 Loading weights [cc6cb27103] from /content/stable-diffusion-webui/models/Stable-diffusion/v1-5-pruned-emaonly.ckpt [ComfyUI] registered ws - sandbox_tab - 9f5070053f694f418aa79a0409236aaf [ComfyUI] registered ws - postprocess_txt2img - bdc08831a3e34397ae5b209efec509c0 [ComfyUI] registered ws - preprocess_img2img - 4362ee2cb89b4477999390399570e923 [ComfyUI] registered ws - postprocess_latent_txt2img - de234613ec464336b7bed530e261e57e [ComfyUI] registered ws - postprocess_img2img - fe7b8338896544449b46d29ee775ce24 [ComfyUI] registered ws - preprocess_latent_img2img - 3a1e3b129e2b44619001988f6405c36b [ComfyUI] registered ws - postprocess_latent_img2img - adfbf991442e4bb0bd5149bebb58c98c Creating model from config: /content/stable-diffusion-webui/configs/v1-inference.yaml LatentDiffusion: Running in eps-prediction mode DiffusionWrapper has 859.52 M params. Downloading (…)olve/main/vocab.json: 100% 961k/961k [00:00<00:00, 9.71MB/s] Downloading (…)olve/main/merges.txt: 100% 525k/525k [00:00<00:00, 11.9MB/s] Downloading (…)cial_tokens_map.json: 100% 389/389 [00:00<00:00, 2.56MB/s] Downloading (…)okenizer_config.json: 100% 905/905 [00:00<00:00, 2.11MB/s] Downloading (…)lve/main/config.json: 100% 4.52k/4.52k [00:00<00:00, 20.2MB/s] Applying attention optimization: xformers... done. Model loaded in 51.4s (calculate hash: 31.4s, load weights from disk: 13.8s, create model: 4.3s, apply weights to model: 1.1s, load textual inversion embeddings: 0.1s, calculate empty prompt: 0.5s). 0% 0/20 [00:00

[rookiexjl]

it is ok?

------------------ 原始邮件 ------------------ 发件人: @.>; 发送时间: 2023年8月17日(星期四) 晚上10:42 收件人: @.>; 抄送: @.>; @.>; 主题: Re: [ModelSurge/sd-webui-comfyui] sd-webui-comfy not loading in webui tab remotely. (Issue #107)

tested on colab, it works: https://colab.research.google.com/drive/18qkmnVASw1-68df156OIWK3CQpNSEtJ3?usp=sharing colab logs /content env: TF_CPP_MIN_LOG_LEVEL=1 29 packages can be upgraded. Run 'apt list --upgradable' to see them. --2023-08-17 14:34:20-- https://github.com/camenduru/gperftools/releases/download/v1.0/libtcmalloc_minimal.so.4 Resolving github.com (github.com)... 140.82.112.3 Connecting to github.com (github.com)|140.82.112.3|:443... connected. HTTP request sent, awaiting response... 302 Found Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/669786276/620e2e64-be9f-4599-904f-18ee3811e159?X-Amz-Algorithm=AWS4-HMAC-SHA256&amp;X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20230817%2Fus-east-1%2Fs3%2Faws4_request&amp;X-Amz-Date=20230817T143251Z&amp;X-Amz-Expires=300&amp;X-Amz-Signature=730e8084fe4431b7b12589c997018208371c48144d6c7b85a301cbe5da73c8c0&amp;X-Amz-SignedHeaders=host&amp;actor_id=0&amp;key_id=0&amp;repo_id=669786276&amp;response-content-disposition=attachment%3B%20filename%3Dlibtcmalloc_minimal.so.4&amp;response-content-type=application%2Foctet-stream [following] --2023-08-17 14:34:20-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/669786276/620e2e64-be9f-4599-904f-18ee3811e159?X-Amz-Algorithm=AWS4-HMAC-SHA256&amp;X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20230817%2Fus-east-1%2Fs3%2Faws4_request&amp;X-Amz-Date=20230817T143251Z&amp;X-Amz-Expires=300&amp;X-Amz-Signature=730e8084fe4431b7b12589c997018208371c48144d6c7b85a301cbe5da73c8c0&amp;X-Amz-SignedHeaders=host&amp;actor_id=0&amp;key_id=0&amp;repo_id=669786276&amp;response-content-disposition=attachment%3B%20filename%3Dlibtcmalloc_minimal.so.4&amp;response-content-type=application%2Foctet-stream Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.111.133, 185.199.108.133, 185.199.109.133, ... Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.111.133|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 373960 (365K) [application/octet-stream] Saving to: ‘/content/libtcmalloc_minimal.so.4’ /content/libtcmallo 100%[===================>] 365.20K --.-KB/s in 0.03s 2023-08-17 14:34:20 (10.5 MB/s) - ‘/content/libtcmalloc_minimal.so.4’ saved [373960/373960] env: LD_PRELOAD=/content/libtcmalloc_minimal.so.4 pkg-config is already the newest version (0.29.2-1ubuntu3). python3-dev is already the newest version (3.10.6-1~22.04). python3-dev set to manually installed. The following additional packages will be installed: libaria2-0 libblkid-dev libc-ares2 libcairo-script-interpreter2 libffi-dev libglib2.0-dev libglib2.0-dev-bin libice-dev liblzo2-2 libmount-dev libpixman-1-dev libselinux1-dev libsepol-dev libsm-dev libxcb-render0-dev libxcb-shm0-dev Suggested packages: libcairo2-doc libgirepository1.0-dev libglib2.0-doc libgdk-pixbuf2.0-bin | libgdk-pixbuf2.0-dev libxml2-utils libice-doc libsm-doc The following NEW packages will be installed: aria2 libaria2-0 libblkid-dev libc-ares2 libcairo-script-interpreter2 libcairo2-dev libffi-dev libglib2.0-dev libglib2.0-dev-bin libice-dev liblzo2-2 libmount-dev libpixman-1-dev libselinux1-dev libsepol-dev libsm-dev libxcb-render0-dev libxcb-shm0-dev 0 upgraded, 18 newly installed, 0 to remove and 29 not upgraded. Need to get 5,352 kB of archives. After this operation, 25.2 MB of additional disk space will be used. Selecting previously unselected package libc-ares2:amd64. (Reading database ... 120831 files and directories currently installed.) Preparing to unpack .../00-libc-ares2_1.18.1-1ubuntu0.22.04.2_amd64.deb ... Unpacking libc-ares2:amd64 (1.18.1-1ubuntu0.22.04.2) ... Selecting previously unselected package libaria2-0:amd64. Preparing to unpack .../01-libaria2-0_1.36.0-1_amd64.deb ... Unpacking libaria2-0:amd64 (1.36.0-1) ... Selecting previously unselected package aria2. Preparing to unpack .../02-aria2_1.36.0-1_amd64.deb ... Unpacking aria2 (1.36.0-1) ... Selecting previously unselected package liblzo2-2:amd64. Preparing to unpack .../03-liblzo2-2_2.10-2build3_amd64.deb ... Unpacking liblzo2-2:amd64 (2.10-2build3) ... Selecting previously unselected package libcairo-script-interpreter2:amd64. Preparing to unpack .../04-libcairo-script-interpreter2_1.16.0-5ubuntu2_amd64.deb ... Unpacking libcairo-script-interpreter2:amd64 (1.16.0-5ubuntu2) ... Selecting previously unselected package libice-dev:amd64. Preparing to unpack .../05-libice-dev_2%3a1.0.10-1build2_amd64.deb ... Unpacking libice-dev:amd64 (2:1.0.10-1build2) ... Selecting previously unselected package libsm-dev:amd64. Preparing to unpack .../06-libsm-dev_2%3a1.2.3-1build2_amd64.deb ... Unpacking libsm-dev:amd64 (2:1.2.3-1build2) ... Selecting previously unselected package libpixman-1-dev:amd64. Preparing to unpack .../07-libpixman-1-dev_0.40.0-1ubuntu0.22.04.1_amd64.deb ... Unpacking libpixman-1-dev:amd64 (0.40.0-1ubuntu0.22.04.1) ... Selecting previously unselected package libxcb-render0-dev:amd64. Preparing to unpack .../08-libxcb-render0-dev_1.14-3ubuntu3_amd64.deb ... Unpacking libxcb-render0-dev:amd64 (1.14-3ubuntu3) ... Selecting previously unselected package libxcb-shm0-dev:amd64. Preparing to unpack .../09-libxcb-shm0-dev_1.14-3ubuntu3_amd64.deb ... Unpacking libxcb-shm0-dev:amd64 (1.14-3ubuntu3) ... Selecting previously unselected package libffi-dev:amd64. Preparing to unpack .../10-libffi-dev_3.4.2-4_amd64.deb ... Unpacking libffi-dev:amd64 (3.4.2-4) ... Selecting previously unselected package libglib2.0-dev-bin. Preparing to unpack .../11-libglib2.0-dev-bin_2.72.4-0ubuntu2.2_amd64.deb ... Unpacking libglib2.0-dev-bin (2.72.4-0ubuntu2.2) ... Selecting previously unselected package libblkid-dev:amd64. Preparing to unpack .../12-libblkid-dev_2.37.2-4ubuntu3_amd64.deb ... Unpacking libblkid-dev:amd64 (2.37.2-4ubuntu3) ... Selecting previously unselected package libsepol-dev:amd64. Preparing to unpack .../13-libsepol-dev_3.3-1build1_amd64.deb ... Unpacking libsepol-dev:amd64 (3.3-1build1) ... Selecting previously unselected package libselinux1-dev:amd64. Preparing to unpack .../14-libselinux1-dev_3.3-1build2_amd64.deb ... Unpacking libselinux1-dev:amd64 (3.3-1build2) ... Selecting previously unselected package libmount-dev:amd64. Preparing to unpack .../15-libmount-dev_2.37.2-4ubuntu3_amd64.deb ... Unpacking libmount-dev:amd64 (2.37.2-4ubuntu3) ... Selecting previously unselected package libglib2.0-dev:amd64. Preparing to unpack .../16-libglib2.0-dev_2.72.4-0ubuntu2.2_amd64.deb ... Unpacking libglib2.0-dev:amd64 (2.72.4-0ubuntu2.2) ... Selecting previously unselected package libcairo2-dev:amd64. Preparing to unpack .../17-libcairo2-dev_1.16.0-5ubuntu2_amd64.deb ... Unpacking libcairo2-dev:amd64 (1.16.0-5ubuntu2) ... Setting up libglib2.0-dev-bin (2.72.4-0ubuntu2.2) ... Setting up libblkid-dev:amd64 (2.37.2-4ubuntu3) ... Setting up libpixman-1-dev:amd64 (0.40.0-1ubuntu0.22.04.1) ... Setting up libice-dev:amd64 (2:1.0.10-1build2) ... Setting up libsm-dev:amd64 (2:1.2.3-1build2) ... Setting up liblzo2-2:amd64 (2.10-2build3) ... Setting up libc-ares2:amd64 (1.18.1-1ubuntu0.22.04.2) ... Setting up libffi-dev:amd64 (3.4.2-4) ... Setting up libxcb-shm0-dev:amd64 (1.14-3ubuntu3) ... Setting up libsepol-dev:amd64 (3.3-1build1) ... Setting up libxcb-render0-dev:amd64 (1.14-3ubuntu3) ... Setting up libcairo-script-interpreter2:amd64 (1.16.0-5ubuntu2) ... Setting up libaria2-0:amd64 (1.36.0-1) ... Setting up libselinux1-dev:amd64 (3.3-1build2) ... Setting up aria2 (1.36.0-1) ... Setting up libmount-dev:amd64 (2.37.2-4ubuntu3) ... Setting up libglib2.0-dev:amd64 (2.72.4-0ubuntu2.2) ... Processing triggers for libglib2.0-0:amd64 (2.72.4-0ubuntu2.2) ... Processing triggers for libc-bin (2.35-0ubuntu3.1) ... /sbin/ldconfig.real: /usr/local/lib/libtbbbind_2_0.so.3 is not a symbolic link /sbin/ldconfig.real: /usr/local/lib/libtbbbind_2_5.so.3 is not a symbolic link /sbin/ldconfig.real: /usr/local/lib/libtbb.so.12 is not a symbolic link /sbin/ldconfig.real: /usr/local/lib/libtbbmalloc.so.2 is not a symbolic link /sbin/ldconfig.real: /usr/local/lib/libtbbmalloc_proxy.so.2 is not a symbolic link /sbin/ldconfig.real: /usr/local/lib/libtbbbind.so.3 is not a symbolic link Processing triggers for man-db (2.10.2-1) ... Setting up libcairo2-dev:amd64 (1.16.0-5ubuntu2) ... ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.0/2.0 MB 30.2 MB/s eta 0:00:00 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 109.1/109.1 MB 8.5 MB/s eta 0:00:00 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 288.4/288.4 kB 23.8 MB/s eta 0:00:00 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 75.4/75.4 kB 8.5 MB/s eta 0:00:00 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 268.8/268.8 kB 21.8 MB/s eta 0:00:00 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 129.9/129.9 kB 15.4 MB/s eta 0:00:00 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 74.5/74.5 kB 9.8 MB/s eta 0:00:00 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.3/58.3 kB 7.8 MB/s eta 0:00:00 Cloning into 'stable-diffusion-webui'... remote: Enumerating objects: 26020, done. remote: Counting objects: 100% (407/407), done. remote: Compressing objects: 100% (183/183), done. remote: Total 26020 (delta 262), reused 342 (delta 220), pack-reused 25613 Receiving objects: 100% (26020/26020), 31.77 MiB | 29.15 MiB/s, done. Resolving deltas: 100% (18218/18218), done. Cloning into '/content/stable-diffusion-webui/extensions/sd-webui-comfyui'... remote: Enumerating objects: 903, done. remote: Counting objects: 100% (446/446), done. remote: Compressing objects: 100% (269/269), done. remote: Total 903 (delta 281), reused 221 (delta 165), pack-reused 457 Receiving objects: 100% (903/903), 7.82 MiB | 27.42 MiB/s, done. Resolving deltas: 100% (491/491), done. Cloning into '/content/stable-diffusion-webui/extensions/sd-webui-comfyui/ComfyUI'... remote: Enumerating objects: 6412, done. remote: Counting objects: 100% (150/150), done. remote: Compressing objects: 100% (92/92), done. remote: Total 6412 (delta 76), reused 82 (delta 56), pack-reused 6262 Receiving objects: 100% (6412/6412), 3.07 MiB | 15.58 MiB/s, done. Resolving deltas: 100% (4206/4206), done. /content/stable-diffusion-webui Download Results: gid |stat|avg speed |path/URI ======+====+===========+======================================================= 0fadcc|OK | 212MiB/s|/content/stable-diffusion-webui/models/Stable-diffusion/v1-5-pruned-emaonly.ckpt Status Legend: (OK):download completed. Python 3.10.12 (main, Jun 11 2023, 05:26:28) [GCC 11.4.0] Version: v1.5.1 Commit hash: 68f336bd994bed5442ad95bad6b6ad5564a5409a Installing gfpgan Installing clip Installing open_clip Cloning Stable Diffusion into /content/stable-diffusion-webui/repositories/stable-diffusion-stability-ai... Cloning into '/content/stable-diffusion-webui/repositories/stable-diffusion-stability-ai'... remote: Enumerating objects: 574, done. remote: Counting objects: 100% (311/311), done. remote: Compressing objects: 100% (92/92), done. remote: Total 574 (delta 244), reused 219 (delta 219), pack-reused 263 Receiving objects: 100% (574/574), 73.43 MiB | 46.19 MiB/s, done. Resolving deltas: 100% (276/276), done. Cloning Stable Diffusion XL into /content/stable-diffusion-webui/repositories/generative-models... Cloning into '/content/stable-diffusion-webui/repositories/generative-models'... remote: Enumerating objects: 731, done. remote: Counting objects: 100% (554/554), done. remote: Compressing objects: 100% (277/277), done. remote: Total 731 (delta 334), reused 422 (delta 263), pack-reused 177 Receiving objects: 100% (731/731), 22.31 MiB | 29.71 MiB/s, done. Resolving deltas: 100% (372/372), done. Cloning K-diffusion into /content/stable-diffusion-webui/repositories/k-diffusion... Cloning into '/content/stable-diffusion-webui/repositories/k-diffusion'... remote: Enumerating objects: 770, done. remote: Counting objects: 100% (46/46), done. remote: Compressing objects: 100% (25/25), done. remote: Total 770 (delta 25), reused 34 (delta 21), pack-reused 724 Receiving objects: 100% (770/770), 157.76 KiB | 482.00 KiB/s, done. Resolving deltas: 100% (503/503), done. Cloning CodeFormer into /content/stable-diffusion-webui/repositories/CodeFormer... Cloning into '/content/stable-diffusion-webui/repositories/CodeFormer'... remote: Enumerating objects: 594, done. remote: Counting objects: 100% (245/245), done. remote: Compressing objects: 100% (97/97), done. remote: Total 594 (delta 175), reused 170 (delta 148), pack-reused 349 Receiving objects: 100% (594/594), 17.31 MiB | 35.81 MiB/s, done. Resolving deltas: 100% (286/286), done. Cloning BLIP into /content/stable-diffusion-webui/repositories/BLIP... Cloning into '/content/stable-diffusion-webui/repositories/BLIP'... remote: Enumerating objects: 277, done. remote: Counting objects: 100% (165/165), done. remote: Compressing objects: 100% (30/30), done. remote: Total 277 (delta 137), reused 136 (delta 135), pack-reused 112 Receiving objects: 100% (277/277), 7.03 MiB | 24.42 MiB/s, done. Resolving deltas: 100% (153/153), done. Installing requirements for CodeFormer Installing requirements Installing sd-webui-comfyui requirement: portalocker>=2.7.0 Launching Web UI with arguments: --listen --share --api --xformers --enable-insecure-extension-access --theme dark --gradio-queue 2023-08-17 14:36:52.275139: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT Calculating sha256 for /content/stable-diffusion-webui/models/Stable-diffusion/v1-5-pruned-emaonly.ckpt: Running on local URL: http://0.0.0.0:7860/ Running on public URL: https://217933e5c97b6f82f5.gradio.live/ This share link expires in 72 hours. For free permanent hosting and GPU upgrades (NEW!), check out Spaces: https://huggingface.co/spaces [sd-webui-comfyui] Started callback listeners for process webui [sd-webui-comfyui] Created a reverse proxy route to ComfyUI: /sd-webui-comfyui/comfyui Startup time: 116.8s (launcher: 93.9s, import torch: 7.3s, import gradio: 1.0s, setup paths: 2.7s, other imports: 2.1s, setup codeformer: 0.3s, load scripts: 2.0s, create ui: 2.2s, gradio launch: 4.4s, add APIs: 0.3s, app_started_callback: 0.6s). [ComfyUI] [sd-webui-comfyui] Setting up IPC... [ComfyUI] [sd-webui-comfyui] Using inter-process communication strategy: File system [ComfyUI] [sd-webui-comfyui] Started callback listeners for process comfyui [ComfyUI] [sd-webui-comfyui] Patching ComfyUI... [ComfyUI] Total VRAM 15102 MB, total RAM 12983 MB [ComfyUI] Enabling highvram mode because your GPU has more vram than your computer has ram. If you don't want this use: --normalvram [ComfyUI] xformers version: 0.0.20 2023-08-17 14:37:21.344945: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT [ComfyUI] Set vram state to: HIGH_VRAM [ComfyUI] Device: cuda:0 Tesla T4 : native [ComfyUI] Using xformers cross attention [ComfyUI] [sd-webui-comfyui] Launching ComfyUI with arguments: --listen 127.0.0.1 --port 8189 [ComfyUI] Import times for custom nodes: [ComfyUI] 0.0 seconds: /content/stable-diffusion-webui/extensions/sd-webui-comfyui/comfyui_custom_nodes/webui_io.py [ComfyUI] 0.0 seconds: /content/stable-diffusion-webui/extensions/sd-webui-comfyui/comfyui_custom_nodes/webui_save_image.py [ComfyUI] 0.0 seconds: /content/stable-diffusion-webui/extensions/sd-webui-comfyui/comfyui_custom_nodes/webui_proxy_nodes.py [ComfyUI] [ComfyUI] Starting server [ComfyUI] To see the GUI go to: http://127.0.0.1:8189/ cc6cb27103417325ff94f52b7a5d2dde45a7515b25c255d8e396c90014281516 Loading weights [cc6cb27103] from /content/stable-diffusion-webui/models/Stable-diffusion/v1-5-pruned-emaonly.ckpt [ComfyUI] registered ws - sandbox_tab - 9f5070053f694f418aa79a0409236aaf [ComfyUI] registered ws - postprocess_txt2img - bdc08831a3e34397ae5b209efec509c0 [ComfyUI] registered ws - preprocess_img2img - 4362ee2cb89b4477999390399570e923 [ComfyUI] registered ws - postprocess_latent_txt2img - de234613ec464336b7bed530e261e57e [ComfyUI] registered ws - postprocess_img2img - fe7b8338896544449b46d29ee775ce24 [ComfyUI] registered ws - preprocess_latent_img2img - 3a1e3b129e2b44619001988f6405c36b [ComfyUI] registered ws - postprocess_latent_img2img - adfbf991442e4bb0bd5149bebb58c98c Creating model from config: /content/stable-diffusion-webui/configs/v1-inference.yaml LatentDiffusion: Running in eps-prediction mode DiffusionWrapper has 859.52 M params. Downloading (…)olve/main/vocab.json: 100% 961k/961k [00:00<00:00, 9.71MB/s] Downloading (…)olve/main/merges.txt: 100% 525k/525k [00:00<00:00, 11.9MB/s] Downloading (…)cial_tokens_map.json: 100% 389/389 [00:00<00:00, 2.56MB/s] Downloading (…)okenizer_config.json: 100% 905/905 [00:00<00:00, 2.11MB/s] Downloading (…)lve/main/config.json: 100% 4.52k/4.52k [00:00<00:00, 20.2MB/s] Applying attention optimization: xformers... done. Model loaded in 51.4s (calculate hash: 31.4s, load weights from disk: 13.8s, create model: 4.3s, apply weights to model: 1.1s, load textual inversion embeddings: 0.1s, calculate empty prompt: 0.5s). 0% 0/20 [00:00<?, ?it/s][ComfyUI] registered ws - sandbox_tab - 12f7f54ab4a345649fa8d96051d3aad5 [ComfyUI] registered ws - postprocess_txt2img - 6c7f2906ab1a460981fe6bc10760cc10 [ComfyUI] registered ws - postprocess_latent_img2img - 8b383dde92504bff8e0436e00f254a04 [ComfyUI] registered ws - postprocess_latent_txt2img - 20397eb7b7c441ab94a8445a07d5e16e [ComfyUI] registered ws - preprocess_img2img - 50c0fc6405b94d278caddd11602baca1 5% 1/20 [00:03<01:04, 3.39s/it] 15% 3/20 [00:03<00:14, 1.16it/s][ComfyUI] registered ws - preprocess_latent_img2img - 5a04c7428a4542c7b2104e8b8fc32a3a 25% 5/20 [00:03<00:06, 2.37it/s] 30% 6/20 [00:04<00:04, 3.07it/s] 35% 7/20 [00:04<00:03, 3.77it/s] 40% 8/20 [00:04<00:02, 4.40it/s] 45% 9/20 [00:04<00:02, 5.00it/s] 50% 10/20 [00:04<00:01, 5.52it/s] 55% 11/20 [00:04<00:01, 5.92it/s] 60% 12/20 [00:04<00:01, 6.25it/s] 65% 13/20 [00:05<00:01, 6.50it/s] 70% 14/20 [00:05<00:00, 6.70it/s][ComfyUI] registered ws - postprocess_img2img - 96e573323e2f486ba1e35805cc9fa3ea 75% 15/20 [00:05<00:00, 6.65it/s] 80% 16/20 [00:05<00:00, 6.62it/s] 85% 17/20 [00:05<00:00, 6.75it/s] 90% 18/20 [00:05<00:00, 6.79it/s] 95% 19/20 [00:05<00:00, 6.78it/s] 100% 20/20 [00:06<00:00, 3.28it/s] Total progress: 100% 20/20 [00:04<00:00, 4.01it/s] 0% 0/20 [00:00<?, ?it/s] 5% 1/20 [00:00<00:04, 4.70it/s] 15% 3/20 [00:00<00:02, 6.34it/s] 20% 4/20 [00:00<00:02, 6.62it/s] 25% 5/20 [00:00<00:02, 6.60it/s] 30% 6/20 [00:00<00:02, 6.81it/s] 35% 7/20 [00:01<00:01, 6.86it/s] 40% 8/20 [00:01<00:01, 6.91it/s] 45% 9/20 [00:01<00:01, 6.93it/s] 50% 10/20 [00:01<00:01, 6.93it/s] 55% 11/20 [00:01<00:01, 6.96it/s] 60% 12/20 [00:01<00:01, 6.98it/s] 65% 13/20 [00:01<00:00, 7.00it/s] 70% 14/20 [00:02<00:00, 6.91it/s] 75% 15/20 [00:02<00:00, 6.98it/s] 80% 16/20 [00:02<00:00, 7.01it/s] 85% 17/20 [00:02<00:00, 6.96it/s] 90% 18/20 [00:02<00:00, 6.98it/s] 95% 19/20 [00:02<00:00, 6.79it/s] 100% 20/20 [00:02<00:00, 6.76it/s] Total progress: 100% 20/20 [00:03<00:00, 6.07it/s] 0% 0/20 [00:00<?, ?it/s] 5% 1/20 [00:00<00:03, 4.92it/s] 15% 3/20 [00:00<00:02, 6.38it/s] 20% 4/20 [00:00<00:02, 6.62it/s] 25% 5/20 [00:00<00:02, 6.73it/s] 30% 6/20 [00:00<00:02, 6.81it/s] 35% 7/20 [00:01<00:01, 6.86it/s] 40% 8/20 [00:01<00:01, 6.88it/s] 45% 9/20 [00:01<00:01, 6.87it/s] 50% 10/20 [00:01<00:01, 6.90it/s] 55% 11/20 [00:01<00:01, 6.92it/s] 60% 12/20 [00:01<00:01, 6.91it/s] 65% 13/20 [00:01<00:01, 6.78it/s] 70% 14/20 [00:02<00:00, 6.84it/s] 75% 15/20 [00:02<00:00, 6.89it/s] 80% 16/20 [00:02<00:00, 6.88it/s] 85% 17/20 [00:02<00:00, 6.73it/s] 90% 18/20 [00:02<00:00, 6.79it/s] 95% 19/20 [00:02<00:00, 6.82it/s] 100% 20/20 [00:02<00:00, 6.75it/s] [ComfyUI] got prompt [ComfyUI] Prompt executed in 0.11 seconds Total progress: 100% 20/20 [00:04<00:00, 4.88it/s] [ComfyUI] [sd-webui-comfyui] Stopped callback listeners for process comfyui
— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.***>

[unolee]

And then, if I restart again...

logs Maybe the base image is already kind of buggy? I think if anything needs to be done, it would be on the template repo. Maybe we could add a flag --kill-comfyui-address-in-use to kill the comfyui server if it's still running, as the process doesn't have the chance to get killed because of how runpod (or the template?) stops the webui.

After, I change the address by 'ip addr show" command, I restart because reloading ui doesn't work, make error - same issue.

2023-08-17T13:26:46.331565692Z ╭───────────────────── Traceback (most recent call last) ──────────────────────╮ 2023-08-17T13:26:46.331588833Z │ /workspace/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/co │ 2023-08-17T13:26:46.331591073Z │ mfyui/pre_main.py:93 in │ 2023-08-17T13:26:46.331592503Z │ │ 2023-08-17T13:26:46.331593653Z │ 90 │ 2023-08-17T13:26:46.331594543Z │ 91 if name == 'main': │ 2023-08-17T13:26:46.331601133Z │ 92 │ ipc.current_process_id = 'comfyui' │ 2023-08-17T13:26:46.331605663Z │ ❱ 93 │ main() │ 2023-08-17T13:26:46.331606603Z │ 94

.....

But after I restart, runpod couldn't keep the ip (I mean almost, ip was changed), it doesn't work.

So, is it possible, start runpod with webui -> check ip address -> manually start comfy?

[ljleb]

That would not work, because runpod does not expose a port for comfyui. It only exposes a port for the webui itself, a jupyter editor thingy and ssh. If you try to find the address of the server with the port of comfyui, well it is not exposed so there is no way for you to reach it directly from your browser.

That is the purpose of the reverse proxy on the api of the webui: to make comfyui available from the exposed port of the webui. If you cannot reach comfyui from the proxy route, which is by default http://webui.example.com:3001/sd-webui-comfyui/comfyui, then you won't be able to see any comfyui iframe work.

I was not able to get the docker image as-is to serve comfyui from the reverse proxy route. However, as noted above, I was able to get it running on colab, so I believe there is something going on with the way the image is setup that prevents comfyui from starting properly.

[rookiexjl]

ip不是固定写死的？ 你固定ip，试一试？

------------------ 原始邮件 ------------------ 发件人: "Uno @.>; 发送时间: 2023年8月20日(星期天) 晚上7:02 收件人: @.>; 抄送: @.>; @.>; 主题: Re: [ModelSurge/sd-webui-comfyui] sd-webui-comfy not loading in webui tab remotely. (Issue #107)

And then, if I restart again...

logs Maybe the base image is already kind of buggy? I think if anything needs to be done, it would be on the template repo. Maybe we could add a flag --kill-comfyui-address-in-use to kill the comfyui server if it's still running, as the process doesn't have the chance to get killed because of how runpod (or the template?) stops the webui.

After, I change the address by 'ip addr show" command, I restart because reloading ui doesn't work, make error - same issue.

2023-08-17T13:26:46.331565692Z ╭───────────────────── Traceback (most recent call last) ──────────────────────╮ 2023-08-17T13:26:46.331588833Z │ /workspace/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/co │ 2023-08-17T13:26:46.331591073Z │ mfyui/pre_main.py:93 in │ 2023-08-17T13:26:46.331592503Z │ │ 2023-08-17T13:26:46.331593653Z │ 90 │ 2023-08-17T13:26:46.331594543Z │ 91 if name == 'main': │ 2023-08-17T13:26:46.331601133Z │ 92 │ ipc.current_process_id = 'comfyui' │ 2023-08-17T13:26:46.331605663Z │ ❱ 93 │ main() │ 2023-08-17T13:26:46.331606603Z │ 94

.....

But after I restart, runpod couldn't keep the ip (I mean almost, ip was changed), it doesn't work.

So, is it possible, start runpod with webui -> check ip address -> manually start comfy?

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.***>