search

EvilBT / ComfyUI_SLK_joy_caption_two

ComfyUI Node
GNU General Public License v3.0
142 stars 4 forks source link

loading error #16

Open K-O-N-B opened 2 weeks ago

K-O-N-B commented 2 weeks ago

ComfyUI Error Report

Error Details

EvilBT commented 2 weeks ago

ComfyUI Error Report

Error Details

  • Node Type: Joy_caption_two_load
  • Exception Type: AssertionError
  • Exception Message:

Stack Trace

  File "H:\ComfyUI-qiuye\ComfyUI\execution.py", line 323, in execute
    output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
                                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "H:\ComfyUI-qiuye\ComfyUI\execution.py", line 198, in get_output_data
    return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "H:\ComfyUI-qiuye\ComfyUI\execution.py", line 169, in _map_node_over_list
    process_inputs(input_dict, i)

  File "H:\ComfyUI-qiuye\ComfyUI\execution.py", line 158, in process_inputs
    results.append(getattr(obj, func)(**inputs))
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "H:\ComfyUI-qiuye\ComfyUI\custom_nodes\ComfyUI_SLK_joy_caption_two\joy_caption_two_node.py", line 259, in generate
    self.loadModels()

  File "H:\ComfyUI-qiuye\ComfyUI\custom_nodes\ComfyUI_SLK_joy_caption_two\joy_caption_two_node.py", line 254, in loadModels
    self.pipeline.loadModels()

  File "H:\ComfyUI-qiuye\ComfyUI\custom_nodes\ComfyUI_SLK_joy_caption_two\joy_caption_two_node.py", line 223, in loadModels
    self.clip_model = JoyClipVisionModel(self.load_device, self.offload_device)
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "H:\ComfyUI-qiuye\ComfyUI\custom_nodes\ComfyUI_SLK_joy_caption_two\joy_caption_two_node.py", line 50, in __init__
    assert (BASE_MODEL_PATH / "clip_model.pt").exists()

Check if you have downloaded the big model and put it in the right place. Check if your 'google/siglip-so400m-patch14-384' has been downloaded. You can refer to my screenshots.

K-O-N-B commented 2 weeks ago

今天全部检查过了。。。。还是这样，难道要全部重新下一次？

EvilBT commented 2 weeks ago

今天全部检查过了。。。。还是这样，难道要全部重新下一次？

手动下载的会比较好一点，在线有时会中断，然后代码只是判断有没有这个文件夹而已，之前下了一半就不会去下了，所以稳妥点就去国内镜像源下载下来一下

K-O-N-B commented 2 weeks ago

我之前都是手动下载的，但是LLM模型我只下载了Meta-Llama-3.1-8B-Instruct，没有下载Meta-Llama-3.1-8B-Instruct-bnb-4bit，会不会是这个原因？

lilicat127 commented 2 weeks ago

我都下载了，还是有问题 image

EvilBT commented 2 weeks ago

有没有去手动下载原版的 JoyCaptionAlphaTwo的文件下来，然后放到 models/Joy_caption_two 文件夹下，路径具体可以参考reamde.md的截图: QQ20241017-214120

lg8910 commented 2 weeks ago

这个节点不能和其他版本的comfyui共享模型，必须放在当前comfyui目录下。我折腾了2个小时才找到原因

EvilBT commented 2 weeks ago

这个节点不能和其他版本的comfyui共享模型，必须放在当前comfyui目录下。我折腾了2个小时才找到原因

主要是我的代码会动态更新到这个模型里的text_model/adapter_config.json文件，共享模型我怕别人也用不了，不过你指的是在类似在 extra_model_paths.yaml 指定model路径之类的吗？

lg8910 commented 2 weeks ago

是的

K-O-N-B commented 2 weeks ago

extra_model_paths.yam

啊？是连在extra_model_paths.yaml调用SD模型路径也不行？

EvilBT commented 2 weeks ago

extra_model_paths.yam 额外模型路径.yaml

啊？是连在extra_model_paths.yaml调用SD模型路径也不行？

是指Joy_caption依赖的三个模型，也就是readme.md里提到的这三个的路径是写死在原始的models目录下的，我更新一下代码吧