siliconflow / BizyAir

BizyAir: Comfy Nodes that can run in any environment.
https://siliconflow.github.io/BizyAir/
MIT License
266 stars 17 forks source link

[BUG]Kolors IPAdaptor + Cotrolnet got error #150

Closed doombeaker closed 1 week ago

doombeaker commented 2 weeks ago

Describe the Bug

Error text or screenshot of the error.

设置调试缓解变量后,路由是:

{   'last_node_ids': ['95'],
    'prompt': {   '105': {   'class_type': 'ControlNetLoader',
                             'inputs': {   'control_net_name': 'kolors/Kolors-ControlNet-Canny.safetensors'},
                             'outputs': {'slot_index': 0}},
                  '108': {   'class_type': 'ControlNetApplyAdvanced',
                             'inputs': {   'control_net': ['105', 0],
                                           'end_percent': 1.0,
                                           'image': 'IMAGE:{"0": '
                                                    '"UklGRjY8AABXRUJQVlA4ICo8AACwoQCdASoAA...',
                                           'negative': ['96', 3],
                                           'positive': ['92', 3],
                                           'start_percent': 0.0,
                                           'strength': 0.8},
                             'outputs': {'slot_index': 1}},
                  '92': {   'class_type': 'ComfyAirLoadData',
                            'inputs': {   'conditioning': {   'relay': [   [   'TENSOR:eJzs2f+7DPX/+PFDkiQJSSdJQhLHOcfZ3dnd2d2Z2dk...',
                                                                               {   'pooled_output': 'TENSOR:eJwll3tUVNX7/0nR0PASqSGZopEZIiqXYRjOnDmXvc8...'}]]}},
                            'is_changed': 'ed65ad37900d4dd9ab4fc53063c9310e',
                            'outputs': {'slot_index': 3}},
                  '94': {   'class_type': 'MZ_KolorsUNETLoaderV2',
                            'inputs': {   'unet_name': 'kolors/Kolors-Inpainting.safetensors'},
                            'outputs': {'slot_index': 0}},
                  '95': {   'class_type': 'KSampler',
                            'inputs': {   'cfg': 4.5,
                                          'denoise': 1.0,
                                          'latent_image': {   'samples': 'TENSOR:eJxEnAeYVLX39zNbgKX3tkvvKCBIU5i5uYAiIKjoTxA...'},
                                          'model': ['99', 0],
                                          'negative': ['108', 1],
                                          'positive': ['108', 0],
                                          'sampler_name': 'dpmpp_2m',
                                          'scheduler': 'karras',
                                          'seed': 816408618801347,
                                          'steps': 20},
                            'outputs': {'slot_index': 0}},
                  '96': {   'class_type': 'ComfyAirLoadData',
                            'inputs': {   'conditioning': {   'relay': [   [   'TENSOR:eJwkl3tcFOUb9lHRyEzJiMhIEREROex557wzs7MLKh4...',
                                                                               {   'pooled_output': 'TENSOR:eJwld3l8Ddf/fuyq9iXSIGKPiMhyc3OXuTNnZs7MvQn...'}]]}},
                            'is_changed': '8e041216432a41c68a105b547d48e345',
                            'outputs': {'slot_index': 3}},
                  '97': {   'class_type': 'CLIPVisionLoader',
                            'inputs': {'clip_name': 'kolors/pytorch_model.bin'},
                            'outputs': {'slot_index': 0}},
                  '98': {   'class_type': 'IPAdapterModelLoader',
                            'inputs': {   'ipadapter_file': 'kolors/ip_adapter_plus_general.bin'},
                            'outputs': {'slot_index': 0}},
                  '99': {   'class_type': 'IPAdapterAdvanced',
                            'inputs': {   'clip_vision': ['97', 0],
                                          'combine_embeds': 'concat',
                                          'embeds_scaling': 'V only',
                                          'end_at': 1.0,
                                          'image': 'IMAGE:{"0": '
                                                   '"UklGRiBxAABXRUJQVlA4IBRxAAAwKwGdASoAA...',
                                          'ipadapter': ['98', 0],
                                          'model': ['94', 0],
                                          'start_at': 0.0,
                                          'weight': 0.7000000000000001,
                                          'weight_type': 'linear'},
                            'outputs': {'slot_index': 0}}}}
95->99->108->94->98->97->92->96->105->Generated URL: https://bizyair-api.siliconflow.cn/x/v1/supernode/kolors-bizyair-sdxl-comfy-ksampler
{   'result': {   'data': {   'payload': {   'error': "{'prompt_id': "
                                                      "'40903397-828b-4800-b52c-63bbd7745d3..."}},
                  'status': 'success'}}

Steps to Reproduce

workflow (12).json

打印了以下的 out:

real_out = decode_data(out)

得到:

{'error': '{\'prompt_id\': \'40903397-828b-4800-b52c-63bbd7745d3b\', \'node_id\': \'49\', \'node_type\': \'ControlNetLoader\', \'executed\': [\'264\', \'266\', \'265\'], \'exception_message\': "argument of type \'NoneType\' is not iterable", \'exception_type\': \'TypeError\', \'traceback\': [\'  File "/workspace/app/submodules/ComfyUI/execution.py", line 323, in execute\\n    output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)\\n\', \'  File "/workspace/app/submodules/ComfyUI/execution.py", line 198, in get_output_data\\n    return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)\\n\', \'  File "/workspace/app/submodules/ComfyUI/execution.py", line 169, in _map_node_over_list\\n    process_inputs(input_dict, i)\\n\', \'  File "/workspace/app/submodules/ComfyUI/execution.py", line 158, in process_inputs\\n    results.append(getattr(obj, func)(**inputs))\\n\', \'  File "/workspace/app/submodules/ComfyUI/nodes.py", line 759, in load_controlnet\\n    controlnet = comfy.controlnet.load_controlnet(controlnet_path)\\n\', \'  File "/workspace/app/submodules/ComfyUI/comfy/controlnet.py", line 503, in load_controlnet\\n    diffusers_keys = comfy.utils.unet_to_diffusers(controlnet_config)\\n\', \'  File "/workspace/app/submodules/ComfyUI/comfy/utils.py", line 220, in unet_to_diffusers\\n    if "num_res_blocks" not in unet_config:\\n\'], \'current_inputs\': {\'control_net_name\': [\'kolors/Kolors-ControlNet-Canny.safetensors\']}, \'current_outputs\': [\'1\', \'252\', \'49\', \'264\', \'212\', \'266\', \'253\', \'268\', \'48\', \'265\', \'52\', \'232\', \'267\'], \'timestamp\': 1726907878541}'}

Environment

Additional Context

Add any other context about the problem here.

ccssu commented 2 weeks ago

Kolors Cotrolnet 请使用下图画红框这个节点

image