search

kijai / ComfyUI-MimicMotionWrapper

Apache License 2.0
333 stars 26 forks source link

Error occurred when executing DownloadAndLoadMimicMotionModel: #20

Open judian17 opened 4 months ago

judian17 commented 4 months ago

Error occurred when executing DownloadAndLoadMimicMotionModel:

Cannot load E:\comfyui\ComfyUI-aki-v1.3\models\diffusers\stable-video-diffusion-img2vid-xt-1-1 because decoder.conv_in.bias expected shape tensor(..., device='meta', size=(64,)), but got torch.Size([512]). If you want to instead overwrite randomly initialized weights, please make sure to pass both low_cpu_mem_usage=False and ignore_mismatched_sizes=True. For more information, see also: https://github.com/huggingface/diffusers/issues/1619#issuecomment-1345604389 as an example.

File "E:\comfyui\ComfyUI-aki-v1.3\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "E:\comfyui\ComfyUI-aki-v1.3\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "E:\comfyui\ComfyUI-aki-v1.3\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(*slice_dict(input_data_all, i))) File "E:\comfyui\ComfyUI-aki-v1.3\custom_nodes\ComfyUI-MimicMotionWrapper\nodes.py", line 124, in loadmodel mimicmotion_models = MimicMotionModel(svd_path, lcm=lcm).to(device=device).eval() File "E:\comfyui\ComfyUI-aki-v1.3\custom_nodes\ComfyUI-MimicMotionWrapper\nodes.py", line 46, in init self.vae = AutoencoderKLTemporalDecoder.from_pretrained( File "E:\comfyui\ComfyUI-aki-v1.3\python\lib\site-packages\huggingface_hub\utils_validators.py", line 114, in _inner_fn return fn(args, **kwargs) File "E:\comfyui\ComfyUI-aki-v1.3\python\lib\site-packages\diffusers\models\modeling_utils.py", line 757, in from_pretrained unexpected_keys = load_model_dict_into_meta( File "E:\comfyui\ComfyUI-aki-v1.3\python\lib\site-packages\diffusers\models\model_loading_utils.py", line 154, in load_model_dict_into_meta raise ValueError(

jarry-LU commented 4 months ago

+1 i have the same question.

gaobatam commented 4 months ago

+1 I have the same issue

judian17 commented 3 months ago

@jarry-LU @gaobatam Today, I resumed using this node and it's functioning normally again. The difference from before is that I have renamed the JSON files in each folder according to the examples to their correct names, and all models are now using fp16 models. This is because the files downloaded from Huggingface get their names changed. I do not know if you have successfully run it or not, but I hope my experience can be of some help.