alenknight
commented
4 months ago i'm having this error too when running intemlm models
Open SoaringTiger opened 4 months ago
alenknight
commented
4 months ago i'm having this error too when running intemlm models
Error occurred when executing LoadImage2TextModel:
You can't move a model that has some modules offloaded to cpu or disk.
File "/opt/ComfyUI/execution.py", line 152, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "/opt/ComfyUI/execution.py", line 82, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "/opt/ComfyUI/execution.py", line 75, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) File "/opt/ComfyUI/custom_nodes/Comfyui_image2prompt/image2text.py", line 28, in get_model return (InternlmVLModle(device=device,low_memory=low_memory),) File "/opt/ComfyUI/custom_nodes/Comfyui_image2prompt/internlm_model.py", line 28, in init self.model_path, self.model, self.tokenizer = self.load_model(device=device, dtype=dtype) File "/opt/ComfyUI/custom_nodes/Comfyui_image2prompt/internlm_model.py", line 54, in load_model ).to(device).eval() File "/opt/micromamba/envs/comfyui/lib/python3.10/site-packages/accelerate/big_modeling.py", line 428, in wrapper raise RuntimeError("You can't move a model that has some modules offloaded to cpu or disk.")
moondream1 + cuda works