search

kijai / ComfyUI-moondream

ComfyUI node to use the moondream tiny vision language model
80 stars 8 forks source link

Failed to validate prompt for output 17: #10

Closed rafstahelin closed 1 month ago

rafstahelin commented 3 months ago

image

`Prompt executed in 3.83 seconds got prompt Failed to validate prompt for output 17:

Here's the entire error: `Error occurred when executing MoondreamQueryCaptions:

Unknown model (vit_so400m_patch14_siglip_384)

File "E:\comfy_ui\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "E:\comfy_ui\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "E:\comfy_ui\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(*slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "E:\comfy_ui\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-moondream\nodes.py", line 138, in process self.moondream = Moondream.from_pretrained(checkpoint_path).to(device=device, dtype=dtype) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "E:\comfy_ui\ComfyUI_windows_portable\python_embeded\Lib\site-packages\transformers\modeling_utils.py", line 3375, in from_pretrained model = cls(config, model_args, **model_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "E:\comfy_ui\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-moondream\moondream\moondream.py", line 15, in init self.vision_encoder = VisionEncoder() ^^^^^^^^^^^^^^^ File "E:\comfy_ui\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-moondream\moondream\vision_encoder.py", line 98, in init VisualHolder(timm.create_model("vit_so400m_patch14_siglip_384")) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "E:\comfy_ui\ComfyUI_windows_portable\python_embeded\Lib\site-packages\timm\models\factory.py", line 67, in create_model raise RuntimeError('Unknown model (%s)' % model_name)

`

zhongdi commented 3 months ago

fixed it by

pip uninstall timm and pip intall timm>=0.9.0