Gourieff / comfyui-reactor-node

Fast and Simple Face Swap Extension Node for ComfyUI
GNU General Public License v3.0
1.62k stars 161 forks source link

Error occurred when executing ReActorFaceSwap: Input type (torch.FloatTensor) and weight type (PrivateUse1FloatType) should be the same or input should be a MKLDNN tensor and weight is a dense tensor #76

Closed lord-lethris closed 12 months ago

lord-lethris commented 1 year ago

First, confirm

What happened?

I am having the same issue as this, only I'm using ComfyUI -> https://github.com/Gourieff/comfyui-reactor-node/issues/40#issue-1907076642

However, the solution "deleting torch and torchvision from the requirements" did not work for me.

I have tried with the following Models:

These all work with Roop. But I have since removed Roop in favour of ReActor (as roop development has stopped)

ReActor only works as expected if I use "Face_Restore_Model = None", but obviously the quality is naff.

Error Message is:

Error occurred when executing ReActorFaceSwap:

Input type (torch.FloatTensor) and weight type (PrivateUse1FloatType) should be the same or input should be a MKLDNN tensor and weight is a dense tensor

File "D:\apps\SD-WebUI\ComfyUI\execution.py", line 153, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
File "D:\apps\SD-WebUI\ComfyUI\execution.py", line 83, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
File "D:\apps\SD-WebUI\ComfyUI\execution.py", line 76, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
File "D:\apps\SD-WebUI\ComfyUI\custom_nodes\comfyui-reactor-node\nodes.py", line 134, in execute
self.face_helper.get_face_landmarks_5(only_center_face=False, resize=640, eye_dist_threshold=5)
File "E:\ASSETS\AI-TOOLS\COMFY-DATA\custom_nodes\comfyui-reactor-node\r_facelib\utils\face_restoration_helper.py", line 151, in get_face_landmarks_5
bboxes = self.face_det.detect_faces(input_img)
File "E:\ASSETS\AI-TOOLS\COMFY-DATA\custom_nodes\comfyui-reactor-node\r_facelib\detection\retinaface\retinaface.py", line 209, in detect_faces
loc, conf, landmarks, priors = self.__detect_faces(image)
File "E:\ASSETS\AI-TOOLS\COMFY-DATA\custom_nodes\comfyui-reactor-node\r_facelib\detection\retinaface\retinaface.py", line 156, in __detect_faces
loc, conf, landmarks = self(inputs)
File "D:\apps\Python\Python310\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
return forward_call(*args, **kwargs)
File "E:\ASSETS\AI-TOOLS\COMFY-DATA\custom_nodes\comfyui-reactor-node\r_facelib\detection\retinaface\retinaface.py", line 121, in forward
out = self.body(inputs)
File "D:\apps\Python\Python310\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
return forward_call(*args, **kwargs)
File "D:\apps\Python\Python310\lib\site-packages\torchvision\models\_utils.py", line 69, in forward
x = module(x)
File "D:\apps\Python\Python310\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
return forward_call(*args, **kwargs)
File "D:\apps\Python\Python310\lib\site-packages\torch\nn\modules\conv.py", line 463, in forward
return self._conv_forward(input, self.weight, self.bias)
File "D:\apps\Python\Python310\lib\site-packages\torch\nn\modules\conv.py", line 459, in _conv_forward
return F.conv2d(input, weight, bias, self.stride,

Steps to reproduce the problem

Your workflow workflow

Sysinfo

Relevant console log

** ComfyUI start up time: 2023-10-19 17:22:28.652095

Prestartup times for custom nodes:
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\rgthree-comfy
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI-Manager

Using directml with device:
Total VRAM 1024 MB, total RAM 32688 MB
Forcing FP32, if this improves things please report it.
Set vram state to: NORMAL_VRAM
Device: privateuseone
VAE dtype: torch.float32
2023-10-19 17:22:33.227642: I tensorflow/c/logging.cc:34] Successfully opened dynamic library D:\apps\Python\Python310\lib\site-packages\tensorflow-plugins/directml/directml.d6f03b303ac3c4f2eeb8ca631688c9757b361310.dll
2023-10-19 17:22:33.227761: I tensorflow/c/logging.cc:34] Successfully opened dynamic library dxgi.dll
2023-10-19 17:22:33.228038: I tensorflow/c/logging.cc:34] Successfully opened dynamic library d3d12.dll
2023-10-19 17:22:33.356063: I tensorflow/c/logging.cc:34] DirectML device enumeration: found 1 compatible adapters.
Using split optimization for cross attention
Adding extra search path checkpoints E:\ASSETS\AI-TOOLS\MODEL-ASSETS\Stable-diffusion
Adding extra search path configs E:\ASSETS\AI-TOOLS\MODEL-ASSETS\configs
Adding extra search path vae E:\ASSETS\AI-TOOLS\MODEL-ASSETS\VAE
Adding extra search path loras E:\ASSETS\AI-TOOLS\MODEL-ASSETS\Lora
Adding extra search path loras E:\ASSETS\AI-TOOLS\MODEL-ASSETS\LyCORIS
Adding extra search path upscale_models E:\ASSETS\AI-TOOLS\MODEL-ASSETS\ESRGAN
Adding extra search path upscale_models E:\ASSETS\AI-TOOLS\MODEL-ASSETS\RealESRGAN
Adding extra search path upscale_models E:\ASSETS\AI-TOOLS\MODEL-ASSETS\SwinIR
Adding extra search path embeddings E:\ASSETS\AI-TOOLS\MODEL-ASSETS\embeddings
Adding extra search path hypernetworks E:\ASSETS\AI-TOOLS\MODEL-ASSETS\hypernetworks
Adding extra search path controlnet E:\ASSETS\AI-TOOLS\MODEL-ASSETS\ControlNet\
Adding extra search path blip E:\ASSETS\AI-TOOLS\MODEL-ASSETS\BLIP
Adding extra search path blip E:\ASSETS\AI-TOOLS\MODEL-ASSETS\BLIP\checkpoints
Adding extra search path wildcards E:\ASSETS\AI-TOOLS\WILDCARD-ASSETS
D:\apps\Python\Python310\lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py:69: UserWarning: Specified provider 'CUDAExecutionProvider' is not in available provider names.Available providers: 'AzureExecutionProvider, CPUExecutionProvider'
  warnings.warn(
[Allor]: 0 standard nodes was overridden.
[Allor]: 12 modules enabled.
[Allor]: 95 nodes was loaded.
Bmad-DirtyUndoRedo Loaded.
### Loading: ComfyUI-Impact-Pack (V4.25)
### Loading: ComfyUI-Impact-Pack (Subpack: V0.2.4)
### Loading: ComfyUI-Inspire-Pack (V0.32)
### Loading: ComfyUI-Manager (V0.36)
### ComfyUI Revision: 1594 [e6962120] | Released on '2023-10-19'
INFO:comfyui-prompt-control:Use STYLE:weight_interpretation:normalization at the start of a prompt to use advanced encodings
INFO:comfyui-prompt-control:Weight interpretations available: comfy,A1111,compel,comfy++,down_weight,perp
INFO:comfyui-prompt-control:Normalization types available: none,mean,length,length+mean
Using directml with device:
Total VRAM 1024 MB, total RAM 32688 MB
Forcing FP32, if this improves things please report it.
Set vram state to: NORMAL_VRAM
Device: privateuseone
VAE dtype: torch.float32
Torch version: 2.0.0+cpu
Comfyroll Custom Nodes: Loaded
Registered sys.path: ['E:\\ASSETS\\AI-TOOLS\\COMFY-DATA\\custom_nodes\\comfyui_controlnet_aux\\src\\__init__.py', 'E:\\ASSETS\\AI-TOOLS\\COMFY-DATA\\custom_nodes\\comfyui_controlnet_aux\\src\\custom_pycocotools', 'E:\\ASSETS\\AI-TOOLS\\COMFY-DATA\\custom_nodes\\comfyui_controlnet_aux\\src\\custom_oneformer', 'E:\\ASSETS\\AI-TOOLS\\COMFY-DATA\\custom_nodes\\comfyui_controlnet_aux\\src\\custom_mmpkg', 'E:\\ASSETS\\AI-TOOLS\\COMFY-DATA\\custom_nodes\\comfyui_controlnet_aux\\src\\custom_midas_repo', 'E:\\ASSETS\\AI-TOOLS\\COMFY-DATA\\custom_nodes\\comfyui_controlnet_aux\\src\\custom_detectron2', 'E:\\ASSETS\\AI-TOOLS\\COMFY-DATA\\custom_nodes\\comfyui_controlnet_aux\\src\\controlnet_aux', 'E:\\ASSETS\\AI-TOOLS\\COMFY-DATA\\custom_nodes\\comfyui_controlnet_aux\\src', 'E:\\ASSETS\\AI-TOOLS\\COMFY-DATA\\custom_nodes\\ComfyUI_Comfyroll_CustomNodes\\comfy', 'E:\\ASSETS\\AI-TOOLS\\COMFY-DATA\\custom_nodes\\ComfyUI_Comfyroll_CustomNodes\\comfy', 'E:\\ASSETS\\AI-TOOLS\\COMFY-DATA\\custom_nodes\\ComfyUI-WD14-Tagger\\comfy', 'E:\\ASSETS\\AI-TOOLS\\COMFY-DATA\\custom_nodes\\comfyui-prompt-control\\comfy', 'D:\\apps\\SD-WebUI\\ComfyUI\\custom_nodes\\ComfyUI-Custom-Scripts', 'D:\\apps\\Python\\Python310\\lib\\site-packages\\git\\ext\\gitdb', 'E:\\ASSETS\\AI-TOOLS\\COMFY-DATA\\custom_nodes\\comfy', 'D:\\apps\\SD-WebUI\\ComfyUI\\comfy', 'D:\\apps\\SD-WebUI\\ComfyUI', 'D:\\apps\\Python\\Python310\\python310.zip', 'D:\\apps\\Python\\Python310\\DLLs', 'D:\\apps\\Python\\Python310\\lib', 'D:\\apps\\Python\\Python310', 'C:\\Users\\lethris\\AppData\\Roaming\\Python\\Python310\\site-packages', 'D:\\apps\\Python\\Python310\\lib\\site-packages', 'D:\\apps\\Python\\Python310\\lib\\site-packages\\win32', 'D:\\apps\\Python\\Python310\\lib\\site-packages\\win32\\lib', 'D:\\apps\\Python\\Python310\\lib\\site-packages\\Pythonwin', 'D:\\apps\\SD-WebUI\\ComfyUI\\custom_nodes\\ComfyUI-Impact-Pack\\modules', 'D:\\apps\\SD-WebUI\\ComfyUI\\custom_nodes\\ComfyUI-Impact-Pack\\impact_subpack', '../..']
Davemane42 Custom Nodes: Loaded
FizzleDorf Custom Nodes: Loaded
__name__ : ComfyUI_node_Lilly
__file__ : D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_node_Lilly\__init__.py
os.path.basename(__file__) : __init__.py
os.path.splitext(os.path.basename(__file__))[0] : __init__
working directory :  D:\apps\SD-WebUI\ComfyUI
───────────────────────────────────────  init start  ────────────────────────────────────────
__name__ : custom_nodes.ComfyUI_node_Lilly
__file__ : D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_node_Lilly\__init__.py
os.path.basename(__file__) : __init__.py
os.path.splitext(os.path.basename(__file__))[0] : __init__
working directory :  D:\apps\SD-WebUI\ComfyUI
[17:22:47] Load ok   : CheckpointLoaderRandom                                  __init__.py:83
           Load ok   : CheckpointLoaderSimpleText                              __init__.py:83
[17:22:47] wildcards card_path :                                              wildcards.py:36
           D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_node_Lilly\..\..\wil
           dcards\**\*.txt
╭──────────────────────────── Traceback (most recent call last) ────────────────────────────╮
│ D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_node_Lilly\__init__.py:74 in add            │
│                                                                                           │
│    71 │   │   try:                                                                        │
│    72 │   │   │   #pkg = importlib.import_module(f"{md}{name}")                           │
│    73 │   │   │   #eval(f"{md}{name}")                                                    │
│ ❱  74 │   │   │   exec(f"import {md}{name}")                                              │
│    75 │   │   │   if clist is None:                                                       │
│    76 │   │   │   │   NODE_CLASS_MAPPINGS[name]=eval(f"{md}{name}.{name}")                │
│    77 │   │   │   elif type(clist) is str:                                                │
│ in <module>:1                                                                             │
│                                                                                           │
│ D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_node_Lilly\CLIPTextEncodeWildcards.py:10 in │
│ <module>                                                                                  │
│                                                                                           │
│    7 │   from wildcards import wildcards                                                  │
│    8 else:                                                                                │
│    9 │   from .ConsoleColor import print, console                                         │
│ ❱ 10 │   from .wildcards import wildcards                                                 │
│   11 #print(__file__)                                                                     │
│   12 #print(os.path.basename(__file__))                                                   │
│   13                                                                                      │
│                                                                                           │
│ D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_node_Lilly\wildcards.py:218 in <module>     │
│                                                                                           │
│   215 #print("wildcards test : "+wildcards.run("{9$$-$$a|b|c}"))                          │
│   216 #print("wildcards test : "+wildcards.run("{9$$ {and|or} $$a|b|c}"))                 │
│   217 #print("wildcards test : "+wildcards.run("{{slender,|} {nature,|} {curvy,|} {thin,| │
│ ❱ 218 print("wildcards test : "+wildcards.run("__aest__"))                                │
│   219 print("wildcards test : "+wildcards.run("__*test__"))                               │
│   220 print("wildcards test : "+wildcards.run("__?est__"))                                │
│   221 print("wildcards test : "+wildcards.run("__test__"))                                │
│                                                                                           │
│ D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_node_Lilly\wildcards.py:197 in run          │
│                                                                                           │
│   194 │   │   │   print("[red]text is not str : [/red]",text)                             │
│   195 │   │   │   return None                                                             │
│   196 │   │   if not wildcards.is_card_Load or load:                                      │
│ ❱ 197 │   │   │   wildcards.card_load()                                                   │
│   198 │   │                                                                               │
│   199 │   │   #print(f"text : {text}")                                                    │
│   200 │   │   result=wildcards.card_loop(text)                                            │
│                                                                                           │
│ D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_node_Lilly\wildcards.py:177 in card_load    │
│                                                                                           │
│   174 │   │   │   │   raw_data = f.read()                                                 │
│   175 │   │   │   │   encoding = chardet.detect(raw_data)["encoding"]                     │
│   176 │   │   │   with open(file, "r", encoding=encoding) as f:                           │
│ ❱ 177 │   │   │   │   lines = f.readlines()                                               │
│   178 │   │   │   │   for line in lines:                                                  │
│   179 │   │   │   │   │   line=line.strip()                                               │
│   180 │   │   │   │   │   # 주석 빈줄 제외                                                │
│                                                                                           │
│ D:\apps\Python\Python310\lib\encodings\cp1254.py:23 in decode                             │
│                                                                                           │
│    20                                                                                     │
│    21 class IncrementalDecoder(codecs.IncrementalDecoder):                                │
│    22 │   def decode(self, input, final=False):                                           │
│ ❱  23 │   │   return codecs.charmap_decode(input,self.errors,decoding_table)[0]           │
│    24                                                                                     │
│    25 class StreamWriter(Codec,codecs.StreamWriter):                                      │
│    26 │   pass                                                                            │
╰───────────────────────────────────────────────────────────────────────────────────────────╯
UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 55: character maps to
<undefined>
[17:22:48] Load ok   : LoraLoaderText                                          __init__.py:83
           Load ok   : LoraLoaderTextRandom                                    __init__.py:83
           Load ok   : Random_Sampler                                          __init__.py:83
           Load ok   : VAELoaderDecode                                         __init__.py:83
           Load ok   : VAELoaderText                                           __init__.py:83
Using directml with device:
Total VRAM 1024 MB, total RAM 32688 MB
Forcing FP32, if this improves things please report it.
Set vram state to: NORMAL_VRAM
Device: privateuseone
VAE dtype: torch.float32
[17:22:48] wildcards card_path :                                              wildcards.py:36
           D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_node_Lilly\..\..\wil
           dcards\**\*.txt
╭──────────────────────────── Traceback (most recent call last) ────────────────────────────╮
│ D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_node_Lilly\__init__.py:74 in add            │
│                                                                                           │
│    71 │   │   try:                                                                        │
│    72 │   │   │   #pkg = importlib.import_module(f"{md}{name}")                           │
│    73 │   │   │   #eval(f"{md}{name}")                                                    │
│ ❱  74 │   │   │   exec(f"import {md}{name}")                                              │
│    75 │   │   │   if clist is None:                                                       │
│    76 │   │   │   │   NODE_CLASS_MAPPINGS[name]=eval(f"{md}{name}.{name}")                │
│    77 │   │   │   elif type(clist) is str:                                                │
│ in <module>:1                                                                             │
│                                                                                           │
│ D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_node_Lilly\SimpleSampler.py:37 in <module>  │
│                                                                                           │
│    34 │   from wildcards import wildcards                                                 │
│    35 else:                                                                               │
│    36 │   from .ConsoleColor import print, console                                        │
│ ❱  37 │   from .wildcards import wildcards                                                │
│    38 #print(__file__)                                                                    │
│    39 #print(os.path.basename(__file__))                                                  │
│    40                                                                                     │
│                                                                                           │
│ D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_node_Lilly\wildcards.py:218 in <module>     │
│                                                                                           │
│   215 #print("wildcards test : "+wildcards.run("{9$$-$$a|b|c}"))                          │
│   216 #print("wildcards test : "+wildcards.run("{9$$ {and|or} $$a|b|c}"))                 │
│   217 #print("wildcards test : "+wildcards.run("{{slender,|} {nature,|} {curvy,|} {thin,| │
│ ❱ 218 print("wildcards test : "+wildcards.run("__aest__"))                                │
│   219 print("wildcards test : "+wildcards.run("__*test__"))                               │
│   220 print("wildcards test : "+wildcards.run("__?est__"))                                │
│   221 print("wildcards test : "+wildcards.run("__test__"))                                │
│                                                                                           │
│ D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_node_Lilly\wildcards.py:197 in run          │
│                                                                                           │
│   194 │   │   │   print("[red]text is not str : [/red]",text)                             │
│   195 │   │   │   return None                                                             │
│   196 │   │   if not wildcards.is_card_Load or load:                                      │
│ ❱ 197 │   │   │   wildcards.card_load()                                                   │
│   198 │   │                                                                               │
│   199 │   │   #print(f"text : {text}")                                                    │
│   200 │   │   result=wildcards.card_loop(text)                                            │
│                                                                                           │
│ D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_node_Lilly\wildcards.py:177 in card_load    │
│                                                                                           │
│   174 │   │   │   │   raw_data = f.read()                                                 │
│   175 │   │   │   │   encoding = chardet.detect(raw_data)["encoding"]                     │
│   176 │   │   │   with open(file, "r", encoding=encoding) as f:                           │
│ ❱ 177 │   │   │   │   lines = f.readlines()                                               │
│   178 │   │   │   │   for line in lines:                                                  │
│   179 │   │   │   │   │   line=line.strip()                                               │
│   180 │   │   │   │   │   # 주석 빈줄 제외                                                │
│                                                                                           │
│ D:\apps\Python\Python310\lib\encodings\cp1254.py:23 in decode                             │
│                                                                                           │
│    20                                                                                     │
│    21 class IncrementalDecoder(codecs.IncrementalDecoder):                                │
│    22 │   def decode(self, input, final=False):                                           │
│ ❱  23 │   │   return codecs.charmap_decode(input,self.errors,decoding_table)[0]           │
│    24                                                                                     │
│    25 class StreamWriter(Codec,codecs.StreamWriter):                                      │
│    26 │   pass                                                                            │
╰───────────────────────────────────────────────────────────────────────────────────────────╯
UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 55: character maps to
<undefined>
[17:22:49] Load ok   : SaveImageSimple                                         __init__.py:83
[17:22:49] wildcards card_path :                                              wildcards.py:36
           D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_node_Lilly\..\..\wil
           dcards\**\*.txt
╭──────────────────────────── Traceback (most recent call last) ────────────────────────────╮
│ D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_node_Lilly\__init__.py:74 in add            │
│                                                                                           │
│    71 │   │   try:                                                                        │
│    72 │   │   │   #pkg = importlib.import_module(f"{md}{name}")                           │
│    73 │   │   │   #eval(f"{md}{name}")                                                    │
│ ❱  74 │   │   │   exec(f"import {md}{name}")                                              │
│    75 │   │   │   if clist is None:                                                       │
│    76 │   │   │   │   NODE_CLASS_MAPPINGS[name]=eval(f"{md}{name}.{name}")                │
│    77 │   │   │   elif type(clist) is str:                                                │
│ in <module>:1                                                                             │
│                                                                                           │
│ D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_node_Lilly\TextWildcards.py:10 in <module>  │
│                                                                                           │
│    7 │   from wildcards import wildcards                                                  │
│    8 else:                                                                                │
│    9 │   from .ConsoleColor import print, console                                         │
│ ❱ 10 │   from .wildcards import wildcards                                                 │
│   11                                                                                      │
│   12                                                                                      │
│   13 class TextWildcards:                                                                 │
│                                                                                           │
│ D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_node_Lilly\wildcards.py:218 in <module>     │
│                                                                                           │
│   215 #print("wildcards test : "+wildcards.run("{9$$-$$a|b|c}"))                          │
│   216 #print("wildcards test : "+wildcards.run("{9$$ {and|or} $$a|b|c}"))                 │
│   217 #print("wildcards test : "+wildcards.run("{{slender,|} {nature,|} {curvy,|} {thin,| │
│ ❱ 218 print("wildcards test : "+wildcards.run("__aest__"))                                │
│   219 print("wildcards test : "+wildcards.run("__*test__"))                               │
│   220 print("wildcards test : "+wildcards.run("__?est__"))                                │
│   221 print("wildcards test : "+wildcards.run("__test__"))                                │
│                                                                                           │
│ D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_node_Lilly\wildcards.py:197 in run          │
│                                                                                           │
│   194 │   │   │   print("[red]text is not str : [/red]",text)                             │
│   195 │   │   │   return None                                                             │
│   196 │   │   if not wildcards.is_card_Load or load:                                      │
│ ❱ 197 │   │   │   wildcards.card_load()                                                   │
│   198 │   │                                                                               │
│   199 │   │   #print(f"text : {text}")                                                    │
│   200 │   │   result=wildcards.card_loop(text)                                            │
│                                                                                           │
│ D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_node_Lilly\wildcards.py:177 in card_load    │
│                                                                                           │
│   174 │   │   │   │   raw_data = f.read()                                                 │
│   175 │   │   │   │   encoding = chardet.detect(raw_data)["encoding"]                     │
│   176 │   │   │   with open(file, "r", encoding=encoding) as f:                           │
│ ❱ 177 │   │   │   │   lines = f.readlines()                                               │
│   178 │   │   │   │   for line in lines:                                                  │
│   179 │   │   │   │   │   line=line.strip()                                               │
│   180 │   │   │   │   │   # 주석 빈줄 제외                                                │
│                                                                                           │
│ D:\apps\Python\Python310\lib\encodings\cp1254.py:23 in decode                             │
│                                                                                           │
│    20                                                                                     │
│    21 class IncrementalDecoder(codecs.IncrementalDecoder):                                │
│    22 │   def decode(self, input, final=False):                                           │
│ ❱  23 │   │   return codecs.charmap_decode(input,self.errors,decoding_table)[0]           │
│    24                                                                                     │
│    25 class StreamWriter(Codec,codecs.StreamWriter):                                      │
│    26 │   pass                                                                            │
╰───────────────────────────────────────────────────────────────────────────────────────────╯
UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 55: character maps to
<undefined>
────────────────────────────────────────  init end  ─────────────────────────────────────────
[tinyterraNodes] Loaded
[comfy_mtb] | WARNING -> Failed to remove web mtb directory: Cannot call rmtree on a symbolic link
Please manually remove it from disk (D:\apps\SD-WebUI\ComfyUI\web\extensions\mtb) and restart the server.
[comfy_mtb] | STATUS -> loaded 52 nodes successfuly
[comfy_mtb] | STATUS -> Some nodes (3) could not be loaded. This can be ignored, but go to http://127.0.0.1:8188/mtb if you want more information.
D:\apps\SD-WebUI\ComfyUI\custom_nodes\failfast-comfyui-extensions\extensions
D:\apps\SD-WebUI\ComfyUI\web\extensions\failfast-comfyui-extensions
Downloading anime face detector...
Failed to download lbpcascade_animeface.xml so please download it yourself.
Updating: Quality of Life Suit...
done: Quality of Life Suit, updated successfully...
QualityOfLifeSuit_Omar92_DIR: D:\apps\SD-WebUI\ComfyUI\custom_nodes\QualityOfLifeSuit_Omar92

[rgthree] Loaded 15 exciting nodes.
[rgthree] Optimizing ComfyUI recursive execution. If queueing and/or re-queueing seems broken, change "patch_recursive_execution" to false in rgthree_config.json

Searge-SDXL v4.2 in E:\ASSETS\AI-TOOLS\COMFY-DATA\custom_nodes\SeargeSDXL
WAS Node Suite: Importing styles from `D:\apps\SD-WebUI\ComfyUI\styles.csv`.
WAS Node Suite: Styles import complete.
WAS Node Suite: BlenderNeko's Advanced CLIP Text Encode found, attempting to enable `CLIPTextEncode` support.
WAS Node Suite: `CLIPTextEncode (BlenderNeko Advanced + NSP)` node enabled under `WAS Suite/Conditioning` menu.
WARNING: Ignoring invalid distribution -rotobuf (d:\apps\python\python310\lib\site-packages)
WAS Node Suite: OpenCV Python FFMPEG support is enabled
WAS Node Suite: `ffmpeg_bin_path` is set to: D:\apps\SD-WebUI\stable-diffusion-webui-directml\venv\Lib\site-packages
WARNING: Ignoring invalid distribution -rotobuf (d:\apps\python\python310\lib\site-packages)
WAS Node Suite: Finished. Loaded 197 nodes successfully.

        "Art is the mirror that reflects the beauty within us." - Unknown

Import times for custom nodes:
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\imageflip_ally.py
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\gaussian_blur_ally.py
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\SDXLAspectRatio.py
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ksampler_sdxl.py
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\sharpness_ally.py
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\rembg-comfyui-node
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\histogram_equalization.py
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\Pseudo_HDR_ally.py
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\fcSuite.py
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\clip_text_encode_split.py
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\saturation_ally.py
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\conditioning_sizing_for_SDXL.py
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\brightness_contrast_ally.py
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\CLIPTextFromTemplateEncode.py
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_ResolutionSelector
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\sdxl_prompt_styler
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\Mile_High_Styler
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\sdxl-recommended-res-calc
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_SimpleMath
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI-Styles_CSV_Loader
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ControlNet-LLLite-ComfyUI
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\comfy-plasma
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI-post-processing-nodes
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\comfyui-optical-flow
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_Noise
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_ADV_CLIP_emb
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_TiledKSampler
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_Cutoff
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\comfy_clip_blip_node
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI-WD14-Tagger
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\comfy-nodes
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI-Bmad-DirtyUndoRedo
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI-TacoNodes
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_NestedNodeBuilder
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_Dave_CustomNode
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\IPAdapter-ComfyUI
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_FizzNodes
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI-Advanced-ControlNet
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_experiments
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyMath
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\images-grid-comfy-plugin
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI-Inspire-Pack
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyQR-scanning-nodes
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI-Custom-Scripts
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_UltimateSDUpscale
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_Load_Image_With_Metadata
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyQR
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\efficiency-nodes-comfyui
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_Comfyroll_CustomNodes
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\Derfuu_ComfyUI_ModdedNodes
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\failfast-comfyui-extensions
   0.0 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\comfyui_controlnet_aux
   0.1 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\comfyui-prompt-control
   0.1 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\rgthree-comfy
   0.1 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_tinyterraNodes
   0.2 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\comfyui-reactor-node
   0.2 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\comfy_mtb
   0.3 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\SeargeSDXL
   0.3 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\sdxl_prompt_styler-main
   0.4 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\QualityOfLifeSuit_Omar92
   0.5 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\comfyui-dynamicprompts
   0.6 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI-Manager
   0.6 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI-Allor
   0.6 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\abg-comfyui
   2.3 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_Custom_Nodes_AlekPet
   2.4 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\was-node-suite-comfyui
   2.9 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI_node_Lilly
   7.3 seconds: D:\apps\SD-WebUI\ComfyUI\custom_nodes\ComfyUI-Impact-Pack

Starting server

To see the GUI go to: http://127.0.0.1:8188
got prompt
STATUS:comfyui-prompt-control:Resolving wildcards...
model_type EPS
adm 0
Using split attention in VAE
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
Using split attention in VAE
missing {'cond_stage_model.logit_scale', 'cond_stage_model.text_projection'}
left over keys: dict_keys(['alphas_cumprod', 'alphas_cumprod_prev', 'betas', 'log_one_minus_alphas_cumprod', 'model_ema.decay', 'model_ema.num_updates', 'posterior_log_variance_clipped', 'posterior_mean_coef1', 'posterior_mean_coef2', 'posterior_variance', 'sqrt_alphas_cumprod', 'sqrt_one_minus_alphas_cumprod', 'sqrt_recip_alphas_cumprod', 'sqrt_recipm1_alphas_cumprod'])
Requested to load SD1ClipModel
Loading 1 new model
Requested to load BaseModel
Loading 1 new model
100%|███████████████████████████████████████████████████████| 20/20 [01:38<00:00,  4.93s/it]
17:25:31 - ReActor Node - STATUS - Working: source face index [0], target face index [0]
17:25:31 - ReActor Node - STATUS - Analyzing Source Image...
Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}}
find model: D:\apps\SD-WebUI\ComfyUI\models\insightface\models\buffalo_l\1k3d68.onnx landmark_3d_68 ['None', 3, 192, 192] 0.0 1.0
Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}}
find model: D:\apps\SD-WebUI\ComfyUI\models\insightface\models\buffalo_l\2d106det.onnx landmark_2d_106 ['None', 3, 192, 192] 0.0 1.0
Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}}
find model: D:\apps\SD-WebUI\ComfyUI\models\insightface\models\buffalo_l\det_10g.onnx detection [1, 3, '?', '?'] 127.5 128.0
Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}}
find model: D:\apps\SD-WebUI\ComfyUI\models\insightface\models\buffalo_l\genderage.onnx genderage ['None', 3, 96, 96] 0.0 1.0
Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}}
find model: D:\apps\SD-WebUI\ComfyUI\models\insightface\models\buffalo_l\w600k_r50.onnx recognition ['None', 3, 112, 112] 127.5 127.5
set det-size: (640, 640)
17:25:38 - ReActor Node - STATUS - Analyzing Target Image...
set det-size: (640, 640)
Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}}
inswapper-shape: [1, 3, 128, 128]
ERROR:root:!!! Exception during processing !!!
ERROR:root:Traceback (most recent call last):
  File "D:\apps\SD-WebUI\ComfyUI\execution.py", line 153, in recursive_execute
    output_data, output_ui = get_output_data(obj, input_data_all)
  File "D:\apps\SD-WebUI\ComfyUI\execution.py", line 83, in get_output_data
    return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
  File "D:\apps\SD-WebUI\ComfyUI\execution.py", line 76, in map_node_over_list
    results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
  File "D:\apps\SD-WebUI\ComfyUI\custom_nodes\comfyui-reactor-node\nodes.py", line 134, in execute
    self.face_helper.get_face_landmarks_5(only_center_face=False, resize=640, eye_dist_threshold=5)
  File "E:\ASSETS\AI-TOOLS\COMFY-DATA\custom_nodes\comfyui-reactor-node\r_facelib\utils\face_restoration_helper.py", line 151, in get_face_landmarks_5
    bboxes = self.face_det.detect_faces(input_img)
  File "E:\ASSETS\AI-TOOLS\COMFY-DATA\custom_nodes\comfyui-reactor-node\r_facelib\detection\retinaface\retinaface.py", line 209, in detect_faces
    loc, conf, landmarks, priors = self.__detect_faces(image)
  File "E:\ASSETS\AI-TOOLS\COMFY-DATA\custom_nodes\comfyui-reactor-node\r_facelib\detection\retinaface\retinaface.py", line 156, in __detect_faces
    loc, conf, landmarks = self(inputs)
  File "D:\apps\Python\Python310\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "E:\ASSETS\AI-TOOLS\COMFY-DATA\custom_nodes\comfyui-reactor-node\r_facelib\detection\retinaface\retinaface.py", line 121, in forward
    out = self.body(inputs)
  File "D:\apps\Python\Python310\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "D:\apps\Python\Python310\lib\site-packages\torchvision\models\_utils.py", line 69, in forward
    x = module(x)
  File "D:\apps\Python\Python310\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "D:\apps\Python\Python310\lib\site-packages\torch\nn\modules\conv.py", line 463, in forward
    return self._conv_forward(input, self.weight, self.bias)
  File "D:\apps\Python\Python310\lib\site-packages\torch\nn\modules\conv.py", line 459, in _conv_forward
    return F.conv2d(input, weight, bias, self.stride,
RuntimeError: Input type (torch.FloatTensor) and weight type (PrivateUse1FloatType) should be the same or input should be a MKLDNN tensor and weight is a dense tensor

Prompt executed in 116.57 seconds

Additional information

PIP Packages:

Package Version


absl-py 1.4.0 accelerate 0.21.0 addict 2.4.0 aiofiles 23.2.1 aiohttp 3.8.5 aiosignal 1.3.1 albumentations 1.3.1 aliyun-python-sdk-core 2.13.36 aliyun-python-sdk-kms 2.16.1 altair 5.1.1 annotated-types 0.5.0 antlr4-python3-runtime 4.9.3 anyio 3.7.1 asgiref 3.7.2 astunparse 1.6.3 async-timeout 4.0.2 asyncer 0.0.2 attrs 23.1.0 basicsr 1.4.2 beautifulsoup4 4.12.2 boltons 23.0.0 boto3 1.28.44 botocore 1.31.44 cachetools 5.3.1 certifi 2023.7.22 cffi 1.15.1 chardet 3.0.4 charset-normalizer 3.2.0 click 8.1.6 cmake 3.27.0 colorama 0.4.6 coloredlogs 15.0.1 compel 2.0.2 contourpy 1.1.0 controlnet-aux 0.0.7 crcmod 1.7 cryptography 41.0.3 cssselect2 0.7.0 cstr 0.0.1 cycler 0.11.0 Cython 3.0.0 deep-translator 1.11.4 diffusers 0.22.0.dev0 Django 4.2.4 dynamicprompts 0.29.0 easydict 1.10 einops 0.6.1 exceptiongroup 1.1.3 facexlib 0.3.0 fairscale 0.4.4 fastapi 0.103.1 ffmpeg 1.4 ffmpy 0.3.0 filelock 3.12.2 filetype 1.2.0 filterpy 1.4.5 flatbuffers 23.5.26 fonttools 4.42.0 frozenlist 1.4.0 fsspec 2023.6.0 ftfy 6.1.1 future 0.18.3 fvcore 0.1.5.post20221221 gast 0.4.0 gdown 4.7.1 gfpgan 1.3.8 gitdb 4.0.10 GitPython 3.1.32 google-auth 2.22.0 google-auth-oauthlib 0.4.6 google-pasta 0.2.0 googletrans 3.1.0a0 gradio 3.42.0 gradio_client 0.5.0 grpcio 1.56.2 h11 0.9.0 h2 3.2.0 h5py 3.9.0 hpack 3.0.0 hstspreload 2023.1.1 httpcore 0.9.1 httpx 0.13.3 huggingface-hub 0.16.4 humanfriendly 10.0 hyperframe 5.2.0 idna 2.10 image 1.5.33 imageio 2.31.1 imageio-ffmpeg 0.4.9 img2texture 1.0.6 importlib-metadata 6.8.0 importlib-resources 6.0.1 insightface 0.7.3 iopath 0.1.10 Jinja2 3.1.2 jmespath 0.10.0 joblib 1.3.1 jsonschema 4.19.0 jsonschema-specifications 2023.7.1 keras 2.10.0 Keras-Preprocessing 1.1.2 kiwisolver 1.4.4 lark 1.1.7 lazy_loader 0.3 libclang 16.0.6 llvmlite 0.40.1 lmdb 1.4.1 lxml 4.9.3 Markdown 3.4.4 markdown-it-py 3.0.0 MarkupSafe 2.1.3 matplotlib 3.7.2 mdurl 0.1.2 mediapipe 0.10.3 mmcv 2.0.0 mmdet 3.0.0 mmengine 0.7.4 model-index 0.1.11 mpmath 1.3.0 multidict 6.0.4 networkx 3.1 numba 0.57.1 numexpr 2.8.4 numpy 1.23.5 oauthlib 3.2.2 omegaconf 2.3.0 onnx 1.14.0 onnxruntime 1.16.1 onnxruntime-directml 1.16.0 onnxruntime-gpu 1.15.1 openai 0.27.8 opencv-contrib-python 4.8.0.74 opencv-python 4.8.0.76 opencv-python-headless 4.7.0.72 opendatalab 0.0.10 openmim 0.3.9 openxlab 0.0.17 opt-einsum 3.3.0 ordered-set 4.1.0 orjson 3.9.5 oss2 2.17.0 packaging 23.1 pandas 2.0.3 piexif 1.1.3 pilgram 1.2.1 Pillow 9.5.0 pip 23.2.1 platformdirs 3.10.0 pooch 1.7.0 portalocker 2.7.0 prettytable 3.6.0 protobuf 3.20.3 psutil 5.9.5 py-cpuinfo 9.0.0 pyasn1 0.5.0 pyasn1-modules 0.3.0 pycocoevalcap 1.2 pycocotools 2.0.6 pycparser 2.21 pycryptodome 3.18.0 pydantic 2.3.0 pydantic_core 2.6.3 pydub 0.25.1 pygit2 1.12.2 Pygments 2.15.1 PyMatting 1.1.8 pyparsing 3.0.9 pypng 0.20220715.0 pyreadline3 3.4.1 PySocks 1.7.1 python-dateutil 2.8.2 python-multipart 0.0.6 pytz 2023.3 PyWavelets 1.4.1 pywin32 306 PyYAML 6.0.1 pyzbar 0.1.9 qrcode 7.4.2 qudida 0.0.4 referencing 0.30.2 regex 2023.6.3 rembg 2.0.50 reportlab 4.0.4 requests 2.28.2 requests-oauthlib 1.3.1 requirements-parser 0.5.0 rfc3986 1.5.0 rich 13.4.2 rich-argparse 1.3.0 rpds-py 0.10.2 rsa 4.9 s3transfer 0.6.2 safetensors 0.3.1 scikit-image 0.20.0 scikit-learn 1.3.0 scipy 1.11.1 seaborn 0.12.2 segment-anything 1.0 semantic-version 2.10.0 setuptools 60.2.0 shapely 2.0.1 simpleeval 0.9.13 simplejson 3.19.1 six 1.16.0 smmap 5.0.0 sniffio 1.3.0 sounddevice 0.4.6 soupsieve 2.4.1 sqlparse 0.4.4 starlette 0.27.0 svglib 1.5.1 sympy 1.12 tabulate 0.9.0 tb-nightly 2.12.0a20230126 tensorboard 2.10.1 tensorboard-data-server 0.6.1 tensorboard-plugin-wit 1.8.1 tensorflow 2.10.1 tensorflow-cpu 2.10.0 tensorflow-directml-plugin 0.4.0.dev230202 tensorflow-estimator 2.10.0 tensorflow_intel 2.10.0 tensorflow-io-gcs-filesystem 0.31.0 termcolor 2.3.0 terminaltables 3.1.10 threadpoolctl 3.2.0 tifffile 2023.7.18 timm 0.6.13 tinycss2 1.2.1 tokenizers 0.13.3 tomli 2.0.1 toolz 0.12.0 torch 2.0.0 torch-directml 0.2.0.dev230426 torchsde 0.2.5 torchvision 0.15.1 tqdm 4.65.0 trampoline 0.1.2 transformers 4.26.1 types-setuptools 68.1.0.0 typing_extensions 4.7.1 tzdata 2023.3 ultralytics 8.0.147 urllib3 1.26.16 uvicorn 0.23.2 watchdog 3.0.0 wcwidth 0.2.6 webencodings 0.5.1 websockets 11.0.3 Werkzeug 2.3.6 wheel 0.41.2 wrapt 1.15.0 yacs 0.1.8 yapf 0.40.1 yarl 1.9.2 zipp 3.16.2

Gourieff commented 1 year ago

onnxruntime 1.16.1 onnxruntime-directml 1.16.0 onnxruntime-gpu 1.15.1

Only one version of ORT must be installed in one environment ReActor works with onnxruntime You have to uninstall onnxruntime-directml and onnxruntime-gpu and reinstall onnxruntime Perhaps, you have other nodes that can reinstall ORT-GPU or ORT-directm back... Too many nodes you have... 😣 With such amount of nodes you need to edit their requirements to be equal with some packages and versions To make things right in this case you need (from the root directory):

  1. python_embeded\python.exe -m pip uninstall -y onnxruntime onnxruntime-gpu onnxruntime-directml
  2. python_embeded\python.exe -m pip install onnxruntime

opencv-contrib-python 4.8.0.74 opencv-python 4.8.0.76 opencv-python-headless 4.7.0.72

Almost the same here It's not right to have these libs with different versions, they must be equal or ideally only one opencv 4.7.0.72 - good variant

And about torch-directml 0.2.0.dev230426 https://github.com/Gourieff/comfyui-reactor-node/issues/40#issuecomment-1763480126

lord-lethris commented 1 year ago

Unfortunately I have an AMD based machine - so I need directml. I cannot run just onnxruntime

Gourieff commented 1 year ago

Unfortunately I have an AMD based machine - so I need directml. I cannot run just onnxruntime

Why not? ORT works with every platform, it uses CPUExecutionProvider

And as I said above, you have 3 versions of ORT installed at the same time - it's not right. ORT won't be able to work properly. Only one version must be installed.

lord-lethris commented 1 year ago

torch-directml gives me the speed of my GPU and utilises the VRam better. This is the recommended install by Comfyui for AMD based machines. And it really does make a difference - I've tested it.

What I don't understand (and this isn't your fault) is why Pytorch isn't using ROCm for windows. ROCm is up to 5.7.1 on Windows, but Pytorch simply doesn't use it - only the Linux version.

This would solve everything.

image

lord-lethris commented 1 year ago

Right - I did what you suggested, and collated all the nodes "requirement" into one file - removed all the old ones and just installed the nessasery requirements making sure there are no multiple versions.

I sill had to install torch-directml because ComfyUI simply does not work without it. Yes I tried onnxruntime CPU only and it does not work.

I still get the same errors as above.

As a note, I removed all onnxruntime and onnx, but when I installed torch-directml (as its an AMD requirement) it installed :

onnx                         1.15.0
onnxruntime                  1.16.1
onnxruntime-directml         1.16.1

As dependencies. So yeaaaa, 3 Onnx runtimes.

Pip list:

PS C:\Users\lethris> pip list
WARNING: Ignoring invalid distribution -rotobuf (d:\apps\python\python310\lib\site-packages)
Package                      Version
---------------------------- ------------------
absl-py                      1.4.0
accelerate                   0.24.1
addict                       2.4.0
aiofiles                     23.2.1
aiohttp                      3.8.6
aiosignal                    1.3.1
albumentations               1.3.1
aliyun-python-sdk-core       2.13.36
aliyun-python-sdk-kms        2.16.1
altair                       5.1.1
annotated-types              0.5.0
antlr4-python3-runtime       4.9.3
anyio                        3.7.1
asgiref                      3.7.2
astunparse                   1.6.3
async-timeout                4.0.2
asyncer                      0.0.2
attrs                        23.1.0
basicsr                      1.4.2
beautifulsoup4               4.12.2
boltons                      23.0.0
boto3                        1.28.44
botocore                     1.31.44
cachetools                   5.3.1
certifi                      2023.7.22
cffi                         1.15.1
chardet                      3.0.4
charset-normalizer           3.2.0
click                        8.1.6
cmake                        3.27.7
colorama                     0.4.6
coloredlogs                  15.0.1
compel                       2.0.2
contourpy                    1.1.0
controlnet-aux               0.0.7
crcmod                       1.7
cryptography                 41.0.3
cssselect2                   0.7.0
cstr                         0.1.0
cycler                       0.11.0
Cython                       3.0.5
deep-translator              1.11.4
diffusers                    0.22.0.dev0
Django                       4.2.4
dynamicprompts               0.29.0
easydict                     1.10
einops                       0.7.0
exceptiongroup               1.1.3
facexlib                     0.3.0
fairscale                    0.4.13
fastapi                      0.103.1
ffmpeg                       1.4
ffmpy                        0.3.0
filelock                     3.13.1
filetype                     1.2.0
filterpy                     1.4.5
flatbuffers                  23.5.26
fonttools                    4.42.0
frozenlist                   1.4.0
fsspec                       2023.6.0
ftfy                         6.1.1
future                       0.18.3
fvcore                       0.1.5.post20221221
gast                         0.4.0
gdown                        4.7.1
gfpgan                       1.3.8
gitdb                        4.0.10
GitPython                    3.1.40
google-auth                  2.22.0
google-auth-oauthlib         0.4.6
google-pasta                 0.2.0
googletrans                  3.1.0a0
gradio                       3.42.0
gradio_client                0.5.0
grpcio                       1.56.2
h11                          0.9.0
h2                           3.2.0
h5py                         3.9.0
hpack                        3.0.0
hstspreload                  2023.1.1
httpcore                     0.9.1
httpx                        0.13.3
huggingface-hub              0.17.3
humanfriendly                10.0
hyperframe                   5.2.0
idna                         2.10
image                        1.5.33
imageio                      2.31.6
imageio-ffmpeg               0.4.9
img2texture                  1.0.6
importlib-metadata           6.8.0
importlib-resources          6.0.1
insightface                  0.7.3
iopath                       0.1.10
Jinja2                       3.1.2
jmespath                     0.10.0
joblib                       1.3.2
jsonschema                   4.19.0
jsonschema-specifications    2023.7.1
keras                        2.10.0
Keras-Preprocessing          1.1.2
kiwisolver                   1.4.4
lark                         1.1.7
lazy_loader                  0.3
libclang                     16.0.6
llvmlite                     0.41.1
lmdb                         1.4.1
lxml                         4.9.3
Markdown                     3.4.4
markdown-it-py               3.0.0
MarkupSafe                   2.1.3
matplotlib                   3.8.0
mdurl                        0.1.2
mediapipe                    0.10.7
mmcv                         2.0.0
mmdet                        3.0.0
mmengine                     0.7.4
model-index                  0.1.11
mpmath                       1.3.0
multidict                    6.0.4
networkx                     3.1
numba                        0.58.1
numexpr                      2.8.7
numpy                        1.26.1
oauthlib                     3.2.2
omegaconf                    2.3.0
onnx                         1.15.0
onnxruntime                  1.16.1
onnxruntime-directml         1.16.1
openai                       0.27.8
opencv-contrib-python        4.8.1.78
opencv-python                4.8.1.78
opendatalab                  0.0.9
openmim                      0.3.9
openxlab                     0.0.17
opt-einsum                   3.3.0
ordered-set                  4.1.0
orjson                       3.9.5
oss2                         2.17.0
packaging                    23.1
pandas                       2.1.2
piexif                       1.1.3
pilgram                      1.2.1
Pillow                       9.5.0
pip                          23.2.1
platformdirs                 3.10.0
pooch                        1.7.0
portalocker                  2.7.0
prettytable                  3.6.0
protobuf                     3.20.3
psutil                       5.9.6
py-cpuinfo                   9.0.0
pyasn1                       0.5.0
pyasn1-modules               0.3.0
pycocoevalcap                1.2
pycocotools                  2.0.6
pycparser                    2.21
pycryptodome                 3.18.0
pydantic                     2.3.0
pydantic_core                2.6.3
pydub                        0.25.1
pygit2                       1.12.2
Pygments                     2.15.1
PyMatting                    1.1.8
pyparsing                    3.0.9
pypng                        0.20220715.0
pyreadline3                  3.4.1
PySocks                      1.7.1
python-dateutil              2.8.2
python-multipart             0.0.6
pytz                         2023.3
PyWavelets                   1.4.1
pywin32                      306
PyYAML                       6.0.1
pyzbar                       0.1.9
qrcode                       7.4.2
qudida                       0.0.4
referencing                  0.30.2
regex                        2023.6.3
rembg                        2.0.52
reportlab                    4.0.4
requests                     2.28.2
requests-oauthlib            1.3.1
requirements-parser          0.5.0
rfc3986                      1.5.0
rich                         13.6.0
rich-argparse                1.4.0
rpds-py                      0.10.2
rsa                          4.9
s3transfer                   0.6.2
safetensors                  0.4.0
scikit-image                 0.22.0
scikit-learn                 1.3.2
scipy                        1.11.3
seaborn                      0.12.2
segment-anything             1.0
semantic-version             2.10.0
setuptools                   60.2.0
shapely                      2.0.1
simpleeval                   0.9.13
simplejson                   3.19.1
six                          1.16.0
smmap                        5.0.0
sniffio                      1.3.0
sounddevice                  0.4.6
soupsieve                    2.4.1
sqlparse                     0.4.4
starlette                    0.27.0
svglib                       1.5.1
sympy                        1.12
tabulate                     0.9.0
tb-nightly                   2.12.0a20230126
tensorboard                  2.10.1
tensorboard-data-server      0.6.1
tensorboard-plugin-wit       1.8.1
tensorflow                   2.10.1
tensorflow-cpu               2.10.0
tensorflow-directml-plugin   0.4.0.dev230202
tensorflow-estimator         2.10.0
tensorflow_intel             2.10.0
tensorflow-io-gcs-filesystem 0.31.0
termcolor                    2.3.0
terminaltables               3.1.10
threadpoolctl                3.2.0
tifffile                     2023.7.18
timm                         0.9.8
tinycss2                     1.2.1
tokenizers                   0.14.1
tomli                        2.0.1
toolz                        0.12.0
torch                        2.0.0
torch-directml               0.2.0.dev230426
torchaudio                   2.0.0
torchsde                     0.2.6
torchvision                  0.15.1
tqdm                         4.66.1
trampoline                   0.1.2
transformers                 4.34.1
types-setuptools             68.1.0.0
typing_extensions            4.7.1
tzdata                       2023.3
ultralytics                  8.0.147
urllib3                      1.26.16
uvicorn                      0.23.2
watchdog                     3.0.0
wcwidth                      0.2.6
webencodings                 0.5.1
websockets                   11.0.3
Werkzeug                     2.3.6
wheel                        0.41.2
wrapt                        1.15.0
yacs                         0.1.8
yapf                         0.40.2
yarl                         1.9.2
zipp                         3.16.2
lord-lethris commented 1 year ago

After much playing about. it ONLY works for me with this Specific Condition:

image

No other "swap_models" or "face_restore_models" will work.

I am happy to use this for now, as it it somewhat better than it was before :)

Edit:

Spoke to soon - It's stopped working again :( Nothing has changed. No installs, no configs, nothing. it just stopped working.

Error occurred when executing ReActorFaceSwap:

Input type (torch.FloatTensor) and weight type (PrivateUse1FloatType) should be the same or input should be a MKLDNN tensor and weight is a dense tensor
15:56:37 - ReActor Node - STATUS - Working: source face index [0], target face index [0]
15:56:37 - ReActor Node - INFO - Source Image MD5 Hash = add6bcd76dfbbd4449e32bb7c008b34d
15:56:37 - ReActor Node - INFO - Source Image the Same? True
15:56:37 - ReActor Node - STATUS - Using Ready Source Face(s) Model...
15:56:37 - ReActor Node - INFO - Target Image MD5 Hash = 8a153c904aee6ddef74c8be34540a371
15:56:37 - ReActor Node - INFO - Target Image the Same? True
15:56:37 - ReActor Node - STATUS - Using Ready Target Face(s) Model...
15:56:37 - ReActor Node - STATUS - Source Face 0: Detected Gender -F-
15:56:37 - ReActor Node - STATUS - OK - Detected Gender matches Condition
15:56:37 - ReActor Node - STATUS - Target Face 0: Detected Gender -F-
15:56:37 - ReActor Node - STATUS - OK - Detected Gender matches Condition
ERROR:root:!!! Exception during processing !!!
ERROR:root:Traceback (most recent call last):
  File "D:\apps\SD-WebUI\ComfyUI\execution.py", line 153, in recursive_execute
    output_data, output_ui = get_output_data(obj, input_data_all)
  File "D:\apps\SD-WebUI\ComfyUI\execution.py", line 83, in get_output_data
    return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
  File "D:\apps\SD-WebUI\ComfyUI\execution.py", line 76, in map_node_over_list
    results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
  File "D:\apps\SD-WebUI\ComfyUI\custom_nodes\comfyui-reactor-node\nodes.py", line 134, in execute
    self.face_helper.get_face_landmarks_5(only_center_face=False, resize=640, eye_dist_threshold=5)
  File "E:\ASSETS\AI-TOOLS\COMFY-DATA\custom_nodes\comfyui-reactor-node\r_facelib\utils\face_restoration_helper.py", line 151, in get_face_landmarks_5
    bboxes = self.face_det.detect_faces(input_img)
  File "E:\ASSETS\AI-TOOLS\COMFY-DATA\custom_nodes\comfyui-reactor-node\r_facelib\detection\retinaface\retinaface.py", line 215, in detect_faces
    loc, conf, landmarks, priors = self.__detect_faces(image)
  File "E:\ASSETS\AI-TOOLS\COMFY-DATA\custom_nodes\comfyui-reactor-node\r_facelib\detection\retinaface\retinaface.py", line 162, in __detect_faces
    loc, conf, landmarks = self(inputs)
  File "D:\apps\Python\Python310\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "E:\ASSETS\AI-TOOLS\COMFY-DATA\custom_nodes\comfyui-reactor-node\r_facelib\detection\retinaface\retinaface.py", line 127, in forward
    out = self.body(inputs)
  File "D:\apps\Python\Python310\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "D:\apps\Python\Python310\lib\site-packages\torchvision\models\_utils.py", line 69, in forward
    x = module(x)
  File "D:\apps\Python\Python310\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "D:\apps\Python\Python310\lib\site-packages\torch\nn\modules\container.py", line 217, in forward
    input = module(input)
  File "D:\apps\Python\Python310\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "D:\apps\Python\Python310\lib\site-packages\torch\nn\modules\container.py", line 217, in forward
    input = module(input)
  File "D:\apps\Python\Python310\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "D:\apps\Python\Python310\lib\site-packages\torch\nn\modules\conv.py", line 463, in forward
    return self._conv_forward(input, self.weight, self.bias)
  File "D:\apps\Python\Python310\lib\site-packages\torch\nn\modules\conv.py", line 459, in _conv_forward
    return F.conv2d(input, weight, bias, self.stride,
RuntimeError: Input type (torch.FloatTensor) and weight type (PrivateUse1FloatType) should be the same or input should be a MKLDNN tensor and weight is a dense tensor
Gourieff commented 1 year ago

Should work now https://github.com/Gourieff/comfyui-reactor-node/commit/f3b01a474818f6cf5fbd6d963e92a1728918c28b