search

comfyanonymous / ComfyUI

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
https://www.comfy.org/
GNU General Public License v3.0
56.12k stars 5.94k forks source link

Error occurred when executing ADE_AnimateDiffLoaderWithContext: #1840

Open Fillllllllllll opened 1 year ago

Fillllllllllll commented 1 year ago

Hi, i'm using colab and it doesn't matter witch SDXL model i upload i get this message

Error occurred when executing ADE_AnimateDiffLoaderWithContext:

('Motion model mm_sd_v15_v2.ckpt is not compatible with SDXL-based model.', ValueError('No pos_encoder.positional_encoding found in mm_state_dict - mm_sd_v15_v2.ckpt is not a valid HotShotXL motion module!'))

File "/content/drive/MyDrive/ComfyUI/execution.py", line 153, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "/content/drive/MyDrive/ComfyUI/execution.py", line 83, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "/content/drive/MyDrive/ComfyUI/execution.py", line 76, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) File "/content/drive/MyDrive/ComfyUI/custom_nodes/ComfyUI-AnimateDiff-Evolved/animatediff/nodes.py", line 87, in load_mm_and_inject_params mm = load_motion_module(model_name, motion_lora, model=model) File "/content/drive/MyDrive/ComfyUI/custom_nodes/ComfyUI-AnimateDiff-Evolved/animatediff/motion_module.py", line 137, in load_motion_module raise ValueError(f"Motion model {model_name} is not compatible with SDXL-based model.", e)

same with mm_sd_v14.ckpt

How can i fix it? Thanks!

KytraScript commented 1 year ago

both mm_sd_v14.ckpt and mm_sd_v15_v2.ckpt are meant solely for use with SD1.5 models. If you want to use the HotShotXL you can. If you want to use the SD1.5 models with it, make sure that the noise option you selected is the sqrt_linear for AD and not the one for HotShotXL.

Fillllllllllll commented 1 year ago

both mm_sd_v14.ckpt and mm_sd_v15_v2.ckpt are meant solely for use with SD1.5 models. If you want to use the HotShotXL you can. If you want to use the SD1.5 models with it, make sure that the noise option you selected is the sqrt_linear for AD and not the one for HotShotXL.

Thank you for the answer So how can i use SDXL models with AD? Which AD_node should i download? i didn't get it