formulake
commented
3 months ago Same error here
Open T8star1984 opened 4 months ago
formulake
commented
3 months ago Same error here
vikhyat
commented
3 months ago Related issue: https://github.com/vikhyat/moondream/issues/64
This is due to using an old version of timm from before when it added support for SigLIP. You can view the version of timm in your current environment by running pip show timm, and upgrade it by running pip install -U timm.
Leaving this issue open for now; I'm planning to remove the timm dependency so people stop running into this issue.
Puppa666
commented
2 months ago i get the same error
Error occurred when executing MoondreamQuery:
Unknown model (vit_so400m_patch14_siglip_384)
File "D:\ComfyUI-aki\ComfyUI-aki-v1.2\execution.py", line 152, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "D:\ComfyUI-aki\ComfyUI-aki-v1.2\execution.py", line 82, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "D:\ComfyUI-aki\ComfyUI-aki-v1.2\custom_nodes\deforum-comfy-nodes\deforum_nodes\exec_hijack.py", line 59, in map_node_over_list return orig_exec(obj, input_data_all, func, allow_interrupt) File "D:\ComfyUI-aki\ComfyUI-aki-v1.2\execution.py", line 75, in map_node_over_list results.append(getattr(obj, func)(*slice_dict(input_data_all, i))) File "D:\ComfyUI-aki\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-moondream\nodes.py", line 62, in process self.moondream = Moondream.from_pretrained(checkpoint_path).to(device=device, dtype=dtype) File "D:\ComfyUI-aki\ComfyUI-aki-v1.2\python\lib\site-packages\transformers\modeling_utils.py", line 3594, in from_pretrained model = cls(config, model_args, **model_kwargs) File "D:\ComfyUI-aki\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-moondream\moondream\moondream.py", line 15, in init self.vision_encoder = VisionEncoder() File "D:\ComfyUI-aki\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-moondream\moondream\vision_encoder.py", line 98, in init VisualHolder(timm.create_model("vit_so400m_patch14_siglip_384")) File "D:\ComfyUI-aki\ComfyUI-aki-v1.2\python\lib\site-packages\timm\models\factory.py", line 67, in create_model raise RuntimeError('Unknown model (%s)' % model_name)