search

mcmonkeyprojects / SwarmUI

SwarmUI (formerly StableSwarmUI), A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible, high performance, and extensibility.
MIT License
1.1k stars 80 forks source link

No module named 'tensorrt_bindings' #139

Closed mfedosov closed 1 month ago

mfedosov commented 1 month ago

Expected Behavior

When I try to create a TensorRT Engine out of SDXL model I expect that the TensorRT module will be installed and the engine will be generated.

Actual Behavior

The mail issue is the errors in the console and no results in the engine generation. Also SwarmUI for some reason doesn't see that TensorRT was not installed in ComfyUI, and it prompts user to generate the engine after the failed installation.

Steps to Reproduce

  1. Click on SDXL model menu and choose Create TensorRT Engine. The following message will appear: image
  2. Click the Install button.
  3. ComfyUI will be reloaded. The error will appeared in the console. See the log
  4. The following dialog will be displayed: image

Debug Logs

2024-08-08 00:22:04.386 [Init] === SwarmUI v0.9.1.1 Starting at 2024-08-08 00:22:04 ===
2024-08-08 00:22:04.408 [Init] Prepping extension: SwarmUI.Builtin_ScorersExtension.ScorersExtension...
2024-08-08 00:22:04.413 [Init] Prepping extension: SwarmUI.Builtin_ImageBatchToolExtension.ImageBatchToolExtension...
2024-08-08 00:22:04.414 [Init] Prepping extension: SwarmUI.Builtin_GridGeneratorExtension.GridGeneratorExtension...
2024-08-08 00:22:04.414 [Init] Prepping extension: SwarmUI.Builtin_DynamicThresholding.DynamicThresholdingExtension...
2024-08-08 00:22:04.414 [Init] Prepping extension: SwarmUI.Builtin_ComfyUIBackend.ComfyUIBackendExtension...
2024-08-08 00:22:04.415 [Init] Prepping extension: SwarmUI.Builtin_AutoWebUIExtension.AutoWebUIBackendExtension...
2024-08-08 00:22:04.435 [Init] Parsing command line...
2024-08-08 00:22:04.436 [Init] Loading settings file...
2024-08-08 00:22:04.449 [Init] Re-saving settings file...
2024-08-08 00:22:04.460 [Init] Applying command line settings...
2024-08-08 00:22:04.475 [Init] Prepping options...
2024-08-08 00:22:04.503 [Init] Current git commit marked as date 2024-08-07 19:26:26
2024-08-08 00:22:04.563 [Init] Loading models list...
2024-08-08 00:22:04.576 [Init] CPU Cores: 28 | RAM: 63.71 GiB total, 52.40 GiB available
2024-08-08 00:22:04.576 [Init] GPU 0: NVIDIA GeForce RTX 4080 SUPER | Temp 49C | Util 9% GPU, 4% Memory | VRAM 15.99 GiB total, 13.29 GiB free, 2.38 GiB used
2024-08-08 00:22:04.578 [Init] Loading backends...
2024-08-08 00:22:04.579 [Init] Loading backends from file...
2024-08-08 00:22:04.581 [Init] Prepping API...
2024-08-08 00:22:04.581 [Init] Initializing backend #0 - ComfyUI Self-Starting...
2024-08-08 00:22:04.582 [Init] Prepping webserver...
2024-08-08 00:22:04.584 [Init] Backend request handler loop ready...
2024-08-08 00:22:04.669 [Init] Scan for web extensions...
2024-08-08 00:22:04.671 [Init] Readying extensions for launch...
2024-08-08 00:22:04.671 [Init] Launching server...
2024-08-08 00:22:04.671 [Init] Starting webserver on http://localhost:7801
2024-08-08 00:22:05.155 [Init] Swarm is up to date! You have version 0.9.1.1, and 0.9.1-Beta is the latest.
2024-08-08 00:22:05.155 [Init] Program is running.
2024-08-08 00:22:05.658 [Init] Launch web browser...
2024-08-08 00:22:05.947 [Info] Creating new admin session 'local' for ::1
2024-08-08 00:22:05.954 [Init] Self-Start ComfyUI-0 on port 7821 is loading...
2024-08-08 00:22:08.105 [Warning] [ComfyUI-0/STDERR] Traceback (most recent call last):
2024-08-08 00:22:08.105 [Warning] [ComfyUI-0/STDERR]   File "E:\Soft\AI\Images\SwarmUI\dlbackend\comfy\ComfyUI\nodes.py", line 1941, in load_custom_node
2024-08-08 00:22:08.106 [Warning] [ComfyUI-0/STDERR]     module_spec.loader.exec_module(module)
2024-08-08 00:22:08.107 [Warning] [ComfyUI-0/STDERR]   File "<frozen importlib._bootstrap_external>", line 940, in exec_module
2024-08-08 00:22:08.107 [Warning] [ComfyUI-0/STDERR]   File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
2024-08-08 00:22:08.107 [Warning] [ComfyUI-0/STDERR]   File "E:\Soft\AI\Images\SwarmUI\dlbackend\comfy\ComfyUI\custom_nodes\ComfyUI_TensorRT\__init__.py", line 1, in <module>
2024-08-08 00:22:08.108 [Warning] [ComfyUI-0/STDERR]     from .tensorrt_convert import DYNAMIC_TRT_MODEL_CONVERSION
2024-08-08 00:22:08.108 [Warning] [ComfyUI-0/STDERR]   File "E:\Soft\AI\Images\SwarmUI\dlbackend\comfy\ComfyUI\custom_nodes\ComfyUI_TensorRT\tensorrt_convert.py", line 7, in <module>
2024-08-08 00:22:08.108 [Warning] [ComfyUI-0/STDERR]     import tensorrt as trt
2024-08-08 00:22:08.109 [Warning] [ComfyUI-0/STDERR]   File "E:\Soft\AI\Images\SwarmUI\dlbackend\comfy\python_embeded\Lib\site-packages\tensorrt\__init__.py", line 18, in <module>
2024-08-08 00:22:08.110 [Warning] [ComfyUI-0/STDERR]     from tensorrt_bindings import *
2024-08-08 00:22:08.110 [Warning] [ComfyUI-0/STDERR] ModuleNotFoundError: No module named 'tensorrt_bindings'
2024-08-08 00:22:08.110 [Warning] [ComfyUI-0/STDERR] 
2024-08-08 00:22:08.111 [Warning] [ComfyUI-0/STDERR] Traceback (most recent call last):
2024-08-08 00:22:08.111 [Warning] [ComfyUI-0/STDERR]   File "E:\Soft\AI\Images\SwarmUI\dlbackend\comfy\ComfyUI\nodes.py", line 1941, in load_custom_node
2024-08-08 00:22:08.111 [Warning] [ComfyUI-0/STDERR]     module_spec.loader.exec_module(module)
2024-08-08 00:22:08.112 [Warning] [ComfyUI-0/STDERR]   File "<frozen importlib._bootstrap_external>", line 940, in exec_module
2024-08-08 00:22:08.112 [Warning] [ComfyUI-0/STDERR]   File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
2024-08-08 00:22:08.112 [Warning] [ComfyUI-0/STDERR]   File "E:\Soft\AI\Images\SwarmUI\src\BuiltinExtensions\ComfyUIBackend\DLNodes\ComfyUI_TensorRT\__init__.py", line 1, in <module>
2024-08-08 00:22:08.113 [Warning] [ComfyUI-0/STDERR]     from .tensorrt_convert import DYNAMIC_TRT_MODEL_CONVERSION
2024-08-08 00:22:08.113 [Warning] [ComfyUI-0/STDERR]   File "E:\Soft\AI\Images\SwarmUI\src\BuiltinExtensions\ComfyUIBackend\DLNodes\ComfyUI_TensorRT\tensorrt_convert.py", line 7, in <module>
2024-08-08 00:22:08.113 [Warning] [ComfyUI-0/STDERR]     import tensorrt as trt
2024-08-08 00:22:08.114 [Warning] [ComfyUI-0/STDERR]   File "E:\Soft\AI\Images\SwarmUI\dlbackend\comfy\python_embeded\Lib\site-packages\tensorrt\__init__.py", line 18, in <module>
2024-08-08 00:22:08.114 [Warning] [ComfyUI-0/STDERR]     from tensorrt_bindings import *
2024-08-08 00:22:08.114 [Warning] [ComfyUI-0/STDERR] ModuleNotFoundError: No module named 'tensorrt_bindings'
2024-08-08 00:22:08.115 [Warning] [ComfyUI-0/STDERR] 
2024-08-08 00:22:09.042 [Init] Self-Start ComfyUI-0 on port 7821 started.
2024-08-08 00:22:43.417 [Info] ComfyUI backend 0 shutting down...
2024-08-08 00:22:43.417 [Info] Shutting down self-start ComfyUI (port=7821) process #6400...
2024-08-08 00:22:43.446 [Info] Self-Start ComfyUI-0 exited properly from disabling.
2024-08-08 00:22:45.181 [Init] Initializing backend #0 - ComfyUI Self-Starting...
2024-08-08 00:22:46.621 [Init] Self-Start ComfyUI-0 on port 7822 is loading...
2024-08-08 00:22:48.744 [Warning] [ComfyUI-0/STDERR] Traceback (most recent call last):
2024-08-08 00:22:48.745 [Warning] [ComfyUI-0/STDERR]   File "E:\Soft\AI\Images\SwarmUI\dlbackend\comfy\ComfyUI\nodes.py", line 1941, in load_custom_node
2024-08-08 00:22:48.746 [Warning] [ComfyUI-0/STDERR]     module_spec.loader.exec_module(module)
2024-08-08 00:22:48.746 [Warning] [ComfyUI-0/STDERR]   File "<frozen importlib._bootstrap_external>", line 940, in exec_module
2024-08-08 00:22:48.746 [Warning] [ComfyUI-0/STDERR]   File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
2024-08-08 00:22:48.746 [Warning] [ComfyUI-0/STDERR]   File "E:\Soft\AI\Images\SwarmUI\dlbackend\comfy\ComfyUI\custom_nodes\ComfyUI_TensorRT\__init__.py", line 1, in <module>
2024-08-08 00:22:48.746 [Warning] [ComfyUI-0/STDERR]     from .tensorrt_convert import DYNAMIC_TRT_MODEL_CONVERSION
2024-08-08 00:22:48.747 [Warning] [ComfyUI-0/STDERR]   File "E:\Soft\AI\Images\SwarmUI\dlbackend\comfy\ComfyUI\custom_nodes\ComfyUI_TensorRT\tensorrt_convert.py", line 7, in <module>
2024-08-08 00:22:48.747 [Warning] [ComfyUI-0/STDERR]     import tensorrt as trt
2024-08-08 00:22:48.747 [Warning] [ComfyUI-0/STDERR]   File "E:\Soft\AI\Images\SwarmUI\dlbackend\comfy\python_embeded\Lib\site-packages\tensorrt\__init__.py", line 18, in <module>
2024-08-08 00:22:48.747 [Warning] [ComfyUI-0/STDERR]     from tensorrt_bindings import *
2024-08-08 00:22:48.748 [Warning] [ComfyUI-0/STDERR] ModuleNotFoundError: No module named 'tensorrt_bindings'
2024-08-08 00:22:48.749 [Warning] [ComfyUI-0/STDERR] 
2024-08-08 00:22:48.750 [Warning] [ComfyUI-0/STDERR] Traceback (most recent call last):
2024-08-08 00:22:48.750 [Warning] [ComfyUI-0/STDERR]   File "E:\Soft\AI\Images\SwarmUI\dlbackend\comfy\ComfyUI\nodes.py", line 1941, in load_custom_node
2024-08-08 00:22:48.750 [Warning] [ComfyUI-0/STDERR]     module_spec.loader.exec_module(module)
2024-08-08 00:22:48.750 [Warning] [ComfyUI-0/STDERR]   File "<frozen importlib._bootstrap_external>", line 940, in exec_module
2024-08-08 00:22:48.751 [Warning] [ComfyUI-0/STDERR]   File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
2024-08-08 00:22:48.751 [Warning] [ComfyUI-0/STDERR]   File "E:\Soft\AI\Images\SwarmUI\src\BuiltinExtensions\ComfyUIBackend\DLNodes\ComfyUI_TensorRT\__init__.py", line 1, in <module>
2024-08-08 00:22:48.751 [Warning] [ComfyUI-0/STDERR]     from .tensorrt_convert import DYNAMIC_TRT_MODEL_CONVERSION
2024-08-08 00:22:48.752 [Warning] [ComfyUI-0/STDERR]   File "E:\Soft\AI\Images\SwarmUI\src\BuiltinExtensions\ComfyUIBackend\DLNodes\ComfyUI_TensorRT\tensorrt_convert.py", line 7, in <module>
2024-08-08 00:22:48.752 [Warning] [ComfyUI-0/STDERR]     import tensorrt as trt
2024-08-08 00:22:48.752 [Warning] [ComfyUI-0/STDERR]   File "E:\Soft\AI\Images\SwarmUI\dlbackend\comfy\python_embeded\Lib\site-packages\tensorrt\__init__.py", line 18, in <module>
2024-08-08 00:22:48.753 [Warning] [ComfyUI-0/STDERR]     from tensorrt_bindings import *
2024-08-08 00:22:48.755 [Warning] [ComfyUI-0/STDERR] ModuleNotFoundError: No module named 'tensorrt_bindings'
2024-08-08 00:22:48.755 [Warning] [ComfyUI-0/STDERR] 
2024-08-08 00:22:49.665 [Init] Self-Start ComfyUI-0 on port 7822 started.
2024-08-08 00:22:04.467 [Debug] [Load Time] Initial settings load took 0.08s (0.08s from start)
2024-08-08 00:22:04.475 [Debug] [Load Time] Extension PreInit took 0s (0.08s from start)
2024-08-08 00:22:04.537 [Debug] [Load Time] Prep Objects took 0.06s (0.14s from start)
2024-08-08 00:22:04.537 [Debug] [Load Time] Web PreInit took 0s (0.14s from start)
2024-08-08 00:22:04.543 [Debug] [Load Time] Extensions Init took 0s (0.14s from start)
2024-08-08 00:22:04.543 [Debug] [Load Time] Prep Utils took 0.02s (0.16s from start)
2024-08-08 00:22:04.563 [Debug] [Load Time] Languages load took 0.02s (0.17s from start)
2024-08-08 00:22:04.578 [Debug] [Load Time] Model listing took 0.02s (0.19s from start)
2024-08-08 00:22:04.580 [Debug] [Load ComfyUI Self-Starting #0] Waiting to load...
2024-08-08 00:22:04.581 [Debug] [Load Time] Backends took 0s (0.19s from start)
2024-08-08 00:22:04.581 [Debug] [Load ComfyUI Self-Starting #0] Will now load...
2024-08-08 00:22:04.582 [Debug] [Load Time] API took 0s (0.19s from start)
2024-08-08 00:22:04.583 [Debug] [Load ComfyUI Self-Starting #0] Starting init...
2024-08-08 00:22:04.583 [Debug] [Load ComfyUI Self-Starting #0] Will emit comfy model paths file...
2024-08-08 00:22:04.583 [Debug] [Load ComfyUI Self-Starting #0] Done emitting comfy model paths file.
2024-08-08 00:22:04.583 [Debug] [Load ComfyUI Self-Starting #0] Will add args:  --extra-model-paths-config E:\Soft\AI\Images\SwarmUI\Data/comfy-auto-model.yaml --preview-method latent2rgb
2024-08-08 00:22:04.583 [Debug] [Load ComfyUI Self-Starting #0] Will track node repo load task...
2024-08-08 00:22:04.583 [Debug] [Load ComfyUI Self-Starting #0] Will track comfy git pull auto-update task...
2024-08-08 00:22:04.583 [Debug] [Load ComfyUI Self-Starting #0] Waiting on git tasks to complete...
2024-08-08 00:22:04.583 [Debug] [Load ComfyUI Self-Starting #0] Running git pull in comfy folder...
2024-08-08 00:22:04.583 [Debug] [Load ComfyUI Self-Starting #0] Will ensure all node repos...
2024-08-08 00:22:04.584 [Debug] [Load ComfyUI Self-Starting #0] Will ensure node repo 'https://github.com/mcmonkeyprojects/sd-dynamic-thresholding'...
2024-08-08 00:22:04.584 [Debug] [Load ComfyUI Self-Starting #0] Will ensure node repo 'https://github.com/Stability-AI/ComfyUI-SAI_API'...
2024-08-08 00:22:04.584 [Debug] [Load ComfyUI Self-Starting #0] Node folder 'sd-dynamic-thresholding' exists, will git pull it...
2024-08-08 00:22:04.584 [Debug] [Load ComfyUI Self-Starting #0] Node folder 'ComfyUI-SAI_API' exists, will git pull it...
2024-08-08 00:22:04.608 [Debug] [Load Time] [Web] WebApp builder prep took 0.03s (0.03s from start)
2024-08-08 00:22:04.637 [Debug] [Load Time] [Web] WebApp build took 0.02s (0.05s from start)
2024-08-08 00:22:04.637 [Debug] [Load Time] [Web] exception handler took 0s (0.05s from start)
2024-08-08 00:22:04.637 [Debug] [Load Time] [Web] StartStop handler took 0s (0.05s from start)
2024-08-08 00:22:04.637 [Debug] [Load Time] [Web] static files took 0s (0.05s from start)
2024-08-08 00:22:04.668 [Debug] [Load Time] [Web] core use calls took 0.03s (0.08s from start)
2024-08-08 00:22:04.669 [Debug] [Load Time] [Web] core maps took 0.02s (0.09s from start)
2024-08-08 00:22:04.671 [Debug] [Load Time] [Web] end took 0s (0.09s from start)
2024-08-08 00:22:04.671 [Debug] [Load Time] Web prep took 0.09s (0.28s from start)
2024-08-08 00:22:04.671 [Debug] [Load Time] Extensions pre-launch took 0s (0.28s from start)
2024-08-08 00:22:04.693 [Debug] [Load Time] Web launch took 0.02s (0.3s from start)
2024-08-08 00:22:05.236 [Debug] [Load ComfyUI Self-Starting #0] Node pull response for ComfyUI-SAI_API: Already up to date.
2024-08-08 00:22:05.237 [Debug] [Load ComfyUI Self-Starting #0] Comfy git pull response: Already up to date.
2024-08-08 00:22:05.246 [Debug] [Load ComfyUI Self-Starting #0] Node pull response for sd-dynamic-thresholding: Already up to date.
2024-08-08 00:22:05.247 [Debug] [Load ComfyUI Self-Starting #0] Ensure node repos - Will git pull for ComfyUI-SAI_API...
2024-08-08 00:22:05.247 [Debug] [Load ComfyUI Self-Starting #0] Ensure node repos - Will git pull for ComfyUI_TensorRT...
2024-08-08 00:22:05.247 [Debug] [Load ComfyUI Self-Starting #0] Ensure node repos - Will git pull for sd-dynamic-thresholding...
2024-08-08 00:22:05.910 [Debug] [Load ComfyUI Self-Starting #0] Node pull response for sd-dynamic-thresholding: Already up to date.
2024-08-08 00:22:05.930 [Debug] [Load ComfyUI Self-Starting #0] Node pull response for ComfyUI-SAI_API: Already up to date.
2024-08-08 00:22:05.949 [Debug] [Load ComfyUI Self-Starting #0] Node pull response for ComfyUI_TensorRT: Already up to date.
2024-08-08 00:22:05.949 [Debug] [Load ComfyUI Self-Starting #0] Done ensuring all node repos.
2024-08-08 00:22:05.949 [Debug] [Load ComfyUI Self-Starting #0] All tasks done.
2024-08-08 00:22:05.949 [Debug] [Load ComfyUI Self-Starting #0] Will validate required libs...
2024-08-08 00:22:05.949 [Debug] [Load ComfyUI Self-Starting #0] Done validating required libs.
2024-08-08 00:22:05.949 [Debug] [Load ComfyUI Self-Starting #0] Starting self-start ComfyUI process...
2024-08-08 00:22:05.950 [Debug] [Load ComfyUI Self-Starting #0] Requested generic launch of dlbackend/comfy/ComfyUI/main.py on GPU 0 from ComfyUI-0
2024-08-08 00:22:05.951 [Debug] (ComfyUI-0 launch) Adding path E:\Soft\AI\Images\SwarmUI\dlbackend\comfy\python_embeded
2024-08-08 00:22:05.952 [Debug] [Load ComfyUI Self-Starting #0] (ComfyUI-0 launch) Will use python: E:\Soft\AI\Images\SwarmUI\dlbackend\comfy\python_embeded\python.exe
2024-08-08 00:22:05.952 [Debug] [Load ComfyUI Self-Starting #0] Will start process...
2024-08-08 00:22:06.922 [Debug] [ComfyUI-0/STDERR] Total VRAM 16376 MB, total RAM 65244 MB
2024-08-08 00:22:06.922 [Debug] [ComfyUI-0/STDERR] pytorch version: 2.3.1+cu121
2024-08-08 00:22:06.922 [Debug] [ComfyUI-0/STDERR] Set vram state to: NORMAL_VRAM
2024-08-08 00:22:06.922 [Debug] [ComfyUI-0/STDERR] Device: cuda:0 NVIDIA GeForce RTX 4080 SUPER : cudaMallocAsync
2024-08-08 00:22:06.959 [Debug] [Load ComfyUI Self-Starting #0] Will attempt to load value set...
2024-08-08 00:22:07.439 [Debug] [ComfyUI-0/STDERR] Using pytorch cross attention
2024-08-08 00:22:07.942 [Debug] [ComfyUI-0/STDERR] [Prompt Server] web root: E:\Soft\AI\Images\SwarmUI\dlbackend\comfy\ComfyUI\web
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path checkpoints E:\Soft\AI\Images\SwarmUI\Models\Stable-Diffusion
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path vae E:\Soft\AI\Images\SwarmUI\Models\VAE
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path vae E:\Soft\AI\Images\SwarmUI\Models\VAE
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path loras E:\Soft\AI\Images\SwarmUI\Models\Lora
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path loras E:\Soft\AI\Images\SwarmUI\Models\Lora
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path loras E:\Soft\AI\Images\SwarmUI\Models\LyCORIS
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path upscale_models E:\Soft\AI\Images\SwarmUI\Models\ESRGAN
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path upscale_models E:\Soft\AI\Images\SwarmUI\Models\RealESRGAN
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path upscale_models E:\Soft\AI\Images\SwarmUI\Models\SwinIR
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path upscale_models E:\Soft\AI\Images\SwarmUI\Models\upscale-models
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path upscale_models E:\Soft\AI\Images\SwarmUI\Models\upscale_models
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path embeddings E:\Soft\AI\Images\SwarmUI\Models\Embeddings
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path embeddings E:\Soft\AI\Images\SwarmUI\Models\embeddings
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path hypernetworks E:\Soft\AI\Images\SwarmUI\Models\hypernetworks
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path controlnet E:\Soft\AI\Images\SwarmUI\Models\controlnet
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path controlnet E:\Soft\AI\Images\SwarmUI\Models\ControlNet
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path clip_vision E:\Soft\AI\Images\SwarmUI\Models\clip_vision
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path clip_vision E:\Soft\AI\Images\SwarmUI\Models\clip_vision
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path clip E:\Soft\AI\Images\SwarmUI\Models\clip
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path unet E:\Soft\AI\Images\SwarmUI\Models\unet
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path gligen E:\Soft\AI\Images\SwarmUI\Models\gligen
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path ipadapter E:\Soft\AI\Images\SwarmUI\Models\ipadapter
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path yolov8 E:\Soft\AI\Images\SwarmUI\Models\yolov8
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path tensorrt E:\Soft\AI\Images\SwarmUI\Models\tensorrt
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path clipseg E:\Soft\AI\Images\SwarmUI\Models\clipseg
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path custom_nodes E:\Soft\AI\Images\SwarmUI\src\BuiltinExtensions\ComfyUIBackend\DLNodes
2024-08-08 00:22:07.944 [Debug] [ComfyUI-0/STDERR] Adding extra search path custom_nodes E:\Soft\AI\Images\SwarmUI\src\BuiltinExtensions\ComfyUIBackend\ExtraNodes
2024-08-08 00:22:08.111 [Debug] [ComfyUI-0/STDERR] Cannot import E:\Soft\AI\Images\SwarmUI\dlbackend\comfy\ComfyUI\custom_nodes\ComfyUI_TensorRT module for custom nodes: No module named 'tensorrt_bindings'
2024-08-08 00:22:08.115 [Debug] [ComfyUI-0/STDERR] Cannot import E:\Soft\AI\Images\SwarmUI\src\BuiltinExtensions\ComfyUIBackend\DLNodes\ComfyUI_TensorRT module for custom nodes: No module named 'tensorrt_bindings'
2024-08-08 00:22:08.808 [Debug] [ComfyUI-0/STDERR] 
2024-08-08 00:22:08.808 [Debug] [ComfyUI-0/STDERR] Import times for custom nodes:
2024-08-08 00:22:08.808 [Debug] [ComfyUI-0/STDERR]    0.0 seconds: E:\Soft\AI\Images\SwarmUI\dlbackend\comfy\ComfyUI\custom_nodes\websocket_image_save.py
2024-08-08 00:22:08.808 [Debug] [ComfyUI-0/STDERR]    0.0 seconds: E:\Soft\AI\Images\SwarmUI\src\BuiltinExtensions\ComfyUIBackend\DLNodes\sd-dynamic-thresholding
2024-08-08 00:22:08.808 [Debug] [ComfyUI-0/STDERR]    0.0 seconds: E:\Soft\AI\Images\SwarmUI\src\BuiltinExtensions\ComfyUIBackend\DLNodes\ComfyUI-SAI_API
2024-08-08 00:22:08.808 [Debug] [ComfyUI-0/STDERR]    0.0 seconds (IMPORT FAILED): E:\Soft\AI\Images\SwarmUI\src\BuiltinExtensions\ComfyUIBackend\DLNodes\ComfyUI_TensorRT
2024-08-08 00:22:08.808 [Debug] [ComfyUI-0/STDERR]    0.0 seconds (IMPORT FAILED): E:\Soft\AI\Images\SwarmUI\dlbackend\comfy\ComfyUI\custom_nodes\ComfyUI_TensorRT
2024-08-08 00:22:08.808 [Debug] [ComfyUI-0/STDERR]    0.1 seconds: E:\Soft\AI\Images\SwarmUI\src\BuiltinExtensions\ComfyUIBackend\ExtraNodes\SwarmComfyCommon
2024-08-08 00:22:08.808 [Debug] [ComfyUI-0/STDERR]    0.6 seconds: E:\Soft\AI\Images\SwarmUI\src\BuiltinExtensions\ComfyUIBackend\ExtraNodes\SwarmComfyExtra
2024-08-08 00:22:08.808 [Debug] [ComfyUI-0/STDERR] 
2024-08-08 00:22:08.810 [Debug] [ComfyUI-0/STDERR] Starting server
2024-08-08 00:22:08.810 [Debug] [ComfyUI-0/STDERR] 
2024-08-08 00:22:08.810 [Debug] [ComfyUI-0/STDERR] To see the GUI go to: http://127.0.0.1:7821
2024-08-08 00:22:09.040 [Debug] [Load ComfyUI Self-Starting #0] Got valid value set, will parse...
2024-08-08 00:22:09.040 [Debug] Comfy backend 0 using model folder format: backslash \ due to model Flux\flux1-dev-fp8.safetensors
2024-08-08 00:22:09.042 [Debug] [Load ComfyUI Self-Starting #0] Done parsing value set.
2024-08-08 00:22:09.042 [Debug] [Load ComfyUI Self-Starting #0] Done! Started!
2024-08-08 00:22:09.042 [Debug] [Load ComfyUI Self-Starting #0] ComfyUI-0 self-start port 7821 loop ending (should now be alive)
2024-08-08 00:22:10.207 [Debug] [Load ComfyUI Self-Starting #0] Got valid value set, will parse...
2024-08-08 00:22:10.207 [Debug] Comfy backend 0 using model folder format: backslash \ due to model Flux\flux1-dev-fp8.safetensors
2024-08-08 00:22:10.207 [Debug] [Load ComfyUI Self-Starting #0] Done parsing value set.
2024-08-08 00:22:10.210 [Debug] Data refreshed!
2024-08-08 00:22:42.796 [Debug] [Load ComfyUI Self-Starting #0] Will ensure node repo 'https://github.com/comfyanonymous/ComfyUI_TensorRT'...
2024-08-08 00:22:42.796 [Debug] [Load ComfyUI Self-Starting #0] Node folder 'ComfyUI_TensorRT' exists, will git pull it...
2024-08-08 00:22:43.415 [Debug] [Load ComfyUI Self-Starting #0] Node pull response for ComfyUI_TensorRT: Already up to date.
2024-08-08 00:22:43.447 [Debug] Status of ComfyUI-0 after process end is DISABLED
2024-08-08 00:22:43.496 [Debug] [Load ComfyUI Self-Starting #0] Waiting to load...
2024-08-08 00:22:45.181 [Debug] [Load ComfyUI Self-Starting #0] Will now load...
2024-08-08 00:22:45.182 [Debug] [Load ComfyUI Self-Starting #0] Starting init...
2024-08-08 00:22:45.182 [Debug] [Load ComfyUI Self-Starting #0] Will add args:  --extra-model-paths-config E:\Soft\AI\Images\SwarmUI\Data/comfy-auto-model.yaml --preview-method latent2rgb
2024-08-08 00:22:45.182 [Debug] [Load ComfyUI Self-Starting #0] Will track node repo load task...
2024-08-08 00:22:45.183 [Debug] [Load ComfyUI Self-Starting #0] Will track comfy git pull auto-update task...
2024-08-08 00:22:45.183 [Debug] [Load ComfyUI Self-Starting #0] Waiting on git tasks to complete...
2024-08-08 00:22:45.183 [Debug] [Load ComfyUI Self-Starting #0] Will ensure all node repos...
2024-08-08 00:22:45.183 [Debug] [Load ComfyUI Self-Starting #0] Running git pull in comfy folder...
2024-08-08 00:22:45.183 [Debug] [Load ComfyUI Self-Starting #0] Will ensure node repo 'https://github.com/Stability-AI/ComfyUI-SAI_API'...
2024-08-08 00:22:45.183 [Debug] [Load ComfyUI Self-Starting #0] Will ensure node repo 'https://github.com/mcmonkeyprojects/sd-dynamic-thresholding'...
2024-08-08 00:22:45.183 [Debug] [Load ComfyUI Self-Starting #0] Node folder 'ComfyUI-SAI_API' exists, will git pull it...
2024-08-08 00:22:45.183 [Debug] [Load ComfyUI Self-Starting #0] Node folder 'sd-dynamic-thresholding' exists, will git pull it...
2024-08-08 00:22:45.887 [Debug] [Load ComfyUI Self-Starting #0] Comfy git pull response: Already up to date.
2024-08-08 00:22:45.912 [Debug] [Load ComfyUI Self-Starting #0] Node pull response for ComfyUI-SAI_API: Already up to date.
2024-08-08 00:22:45.912 [Debug] [Load ComfyUI Self-Starting #0] Node pull response for sd-dynamic-thresholding: Already up to date.
2024-08-08 00:22:45.912 [Debug] [Load ComfyUI Self-Starting #0] Ensure node repos - Will git pull for ComfyUI-SAI_API...
2024-08-08 00:22:45.912 [Debug] [Load ComfyUI Self-Starting #0] Ensure node repos - Will git pull for ComfyUI_TensorRT...
2024-08-08 00:22:45.912 [Debug] [Load ComfyUI Self-Starting #0] Ensure node repos - Will git pull for sd-dynamic-thresholding...
2024-08-08 00:22:46.577 [Debug] [Load ComfyUI Self-Starting #0] Node pull response for ComfyUI-SAI_API: Already up to date.
2024-08-08 00:22:46.611 [Debug] [Load ComfyUI Self-Starting #0] Node pull response for ComfyUI_TensorRT: Already up to date.
2024-08-08 00:22:46.618 [Debug] [Load ComfyUI Self-Starting #0] Node pull response for sd-dynamic-thresholding: Already up to date.
2024-08-08 00:22:46.618 [Debug] [Load ComfyUI Self-Starting #0] Done ensuring all node repos.
2024-08-08 00:22:46.618 [Debug] [Load ComfyUI Self-Starting #0] All tasks done.
2024-08-08 00:22:46.618 [Debug] [Load ComfyUI Self-Starting #0] Will validate required libs...
2024-08-08 00:22:46.618 [Debug] [Load ComfyUI Self-Starting #0] Done validating required libs.
2024-08-08 00:22:46.618 [Debug] [Load ComfyUI Self-Starting #0] Starting self-start ComfyUI process...
2024-08-08 00:22:46.618 [Debug] [Load ComfyUI Self-Starting #0] Requested generic launch of dlbackend/comfy/ComfyUI/main.py on GPU 0 from ComfyUI-0
2024-08-08 00:22:46.619 [Debug] (ComfyUI-0 launch) Adding path E:\Soft\AI\Images\SwarmUI\dlbackend\comfy\python_embeded
2024-08-08 00:22:46.619 [Debug] [Load ComfyUI Self-Starting #0] (ComfyUI-0 launch) Will use python: E:\Soft\AI\Images\SwarmUI\dlbackend\comfy\python_embeded\python.exe
2024-08-08 00:22:46.619 [Debug] [Load ComfyUI Self-Starting #0] Will start process...
2024-08-08 00:22:47.610 [Debug] [ComfyUI-0/STDERR] Total VRAM 16376 MB, total RAM 65244 MB
2024-08-08 00:22:47.610 [Debug] [ComfyUI-0/STDERR] pytorch version: 2.3.1+cu121
2024-08-08 00:22:47.610 [Debug] [ComfyUI-0/STDERR] Set vram state to: NORMAL_VRAM
2024-08-08 00:22:47.610 [Debug] [ComfyUI-0/STDERR] Device: cuda:0 NVIDIA GeForce RTX 4080 SUPER : cudaMallocAsync
2024-08-08 00:22:47.636 [Debug] [Load ComfyUI Self-Starting #0] Will attempt to load value set...
2024-08-08 00:22:48.115 [Debug] [ComfyUI-0/STDERR] Using pytorch cross attention
2024-08-08 00:22:48.593 [Debug] [ComfyUI-0/STDERR] [Prompt Server] web root: E:\Soft\AI\Images\SwarmUI\dlbackend\comfy\ComfyUI\web
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path checkpoints E:\Soft\AI\Images\SwarmUI\Models\Stable-Diffusion
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path vae E:\Soft\AI\Images\SwarmUI\Models\VAE
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path vae E:\Soft\AI\Images\SwarmUI\Models\VAE
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path loras E:\Soft\AI\Images\SwarmUI\Models\Lora
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path loras E:\Soft\AI\Images\SwarmUI\Models\Lora
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path loras E:\Soft\AI\Images\SwarmUI\Models\LyCORIS
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path upscale_models E:\Soft\AI\Images\SwarmUI\Models\ESRGAN
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path upscale_models E:\Soft\AI\Images\SwarmUI\Models\RealESRGAN
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path upscale_models E:\Soft\AI\Images\SwarmUI\Models\SwinIR
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path upscale_models E:\Soft\AI\Images\SwarmUI\Models\upscale-models
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path upscale_models E:\Soft\AI\Images\SwarmUI\Models\upscale_models
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path embeddings E:\Soft\AI\Images\SwarmUI\Models\Embeddings
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path embeddings E:\Soft\AI\Images\SwarmUI\Models\embeddings
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path hypernetworks E:\Soft\AI\Images\SwarmUI\Models\hypernetworks
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path controlnet E:\Soft\AI\Images\SwarmUI\Models\controlnet
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path controlnet E:\Soft\AI\Images\SwarmUI\Models\ControlNet
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path clip_vision E:\Soft\AI\Images\SwarmUI\Models\clip_vision
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path clip_vision E:\Soft\AI\Images\SwarmUI\Models\clip_vision
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path clip E:\Soft\AI\Images\SwarmUI\Models\clip
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path unet E:\Soft\AI\Images\SwarmUI\Models\unet
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path gligen E:\Soft\AI\Images\SwarmUI\Models\gligen
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path ipadapter E:\Soft\AI\Images\SwarmUI\Models\ipadapter
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path yolov8 E:\Soft\AI\Images\SwarmUI\Models\yolov8
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path tensorrt E:\Soft\AI\Images\SwarmUI\Models\tensorrt
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path clipseg E:\Soft\AI\Images\SwarmUI\Models\clipseg
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path custom_nodes E:\Soft\AI\Images\SwarmUI\src\BuiltinExtensions\ComfyUIBackend\DLNodes
2024-08-08 00:22:48.594 [Debug] [ComfyUI-0/STDERR] Adding extra search path custom_nodes E:\Soft\AI\Images\SwarmUI\src\BuiltinExtensions\ComfyUIBackend\ExtraNodes
2024-08-08 00:22:48.750 [Debug] [ComfyUI-0/STDERR] Cannot import E:\Soft\AI\Images\SwarmUI\dlbackend\comfy\ComfyUI\custom_nodes\ComfyUI_TensorRT module for custom nodes: No module named 'tensorrt_bindings'
2024-08-08 00:22:48.755 [Debug] [ComfyUI-0/STDERR] Cannot import E:\Soft\AI\Images\SwarmUI\src\BuiltinExtensions\ComfyUIBackend\DLNodes\ComfyUI_TensorRT module for custom nodes: No module named 'tensorrt_bindings'
2024-08-08 00:22:49.436 [Debug] [ComfyUI-0/STDERR] 
2024-08-08 00:22:49.436 [Debug] [ComfyUI-0/STDERR] Import times for custom nodes:
2024-08-08 00:22:49.436 [Debug] [ComfyUI-0/STDERR]    0.0 seconds: E:\Soft\AI\Images\SwarmUI\dlbackend\comfy\ComfyUI\custom_nodes\websocket_image_save.py
2024-08-08 00:22:49.436 [Debug] [ComfyUI-0/STDERR]    0.0 seconds: E:\Soft\AI\Images\SwarmUI\src\BuiltinExtensions\ComfyUIBackend\DLNodes\sd-dynamic-thresholding
2024-08-08 00:22:49.436 [Debug] [ComfyUI-0/STDERR]    0.0 seconds: E:\Soft\AI\Images\SwarmUI\src\BuiltinExtensions\ComfyUIBackend\DLNodes\ComfyUI-SAI_API
2024-08-08 00:22:49.436 [Debug] [ComfyUI-0/STDERR]    0.0 seconds (IMPORT FAILED): E:\Soft\AI\Images\SwarmUI\src\BuiltinExtensions\ComfyUIBackend\DLNodes\ComfyUI_TensorRT
2024-08-08 00:22:49.436 [Debug] [ComfyUI-0/STDERR]    0.0 seconds (IMPORT FAILED): E:\Soft\AI\Images\SwarmUI\dlbackend\comfy\ComfyUI\custom_nodes\ComfyUI_TensorRT
2024-08-08 00:22:49.436 [Debug] [ComfyUI-0/STDERR]    0.1 seconds: E:\Soft\AI\Images\SwarmUI\src\BuiltinExtensions\ComfyUIBackend\ExtraNodes\SwarmComfyCommon
2024-08-08 00:22:49.436 [Debug] [ComfyUI-0/STDERR]    0.6 seconds: E:\Soft\AI\Images\SwarmUI\src\BuiltinExtensions\ComfyUIBackend\ExtraNodes\SwarmComfyExtra
2024-08-08 00:22:49.436 [Debug] [ComfyUI-0/STDERR] 
2024-08-08 00:22:49.439 [Debug] [ComfyUI-0/STDERR] Starting server
2024-08-08 00:22:49.439 [Debug] [ComfyUI-0/STDERR] 
2024-08-08 00:22:49.439 [Debug] [ComfyUI-0/STDERR] To see the GUI go to: http://127.0.0.1:7822
2024-08-08 00:22:49.665 [Debug] [Load ComfyUI Self-Starting #0] Got valid value set, will parse...
2024-08-08 00:22:49.665 [Debug] Comfy backend 0 using model folder format: backslash \ due to model Flux\flux1-dev-fp8.safetensors
2024-08-08 00:22:49.665 [Debug] [Load ComfyUI Self-Starting #0] Done parsing value set.
2024-08-08 00:22:49.665 [Debug] [Load ComfyUI Self-Starting #0] Done! Started!
2024-08-08 00:22:49.667 [Debug] [Load ComfyUI Self-Starting #0] ComfyUI-0 self-start port 7822 loop ending (should now be alive)
2024-08-08 00:22:51.447 [Debug] [Load ComfyUI Self-Starting #0] Got valid value set, will parse...
2024-08-08 00:22:51.447 [Debug] Comfy backend 0 using model folder format: backslash \ due to model Flux\flux1-dev-fp8.safetensors
2024-08-08 00:22:51.447 [Debug] [Load ComfyUI Self-Starting #0] Done parsing value set.
2024-08-08 00:22:51.449 [Debug] Data refreshed!

Other

No response

mcmonkey4eva commented 1 month ago

This is an upstream error with the tensorrt lib

@maedtb PR'd a fix https://github.com/comfyanonymous/ComfyUI_TensorRT/pull/56 which got pulled but then removed for some reason??

maedtb commented 1 month ago

@mcmonkey4eva : not sure at all, but I'm inferring from subsequent commits that including the extra package index brought in broken ONNX packages from nvidia? 🤷