Sampler crash when using Color Palette and

[lunanane]

Hej :) thanks for the extension, it is really amazing this implementation!

I had really good result using Color Palette and the T2I color adapter (https://civitai.com/models/17220/controlnet-t2i-adapter-models).

But it seems like when doing more than 16 frames with the Animate Diff Sampler, then it crashes. So I thought I leave you the error massage here.

Cheers!

Error occurred when executing AnimateDiffSampler:

index 1 is out of bounds for dimension 0 with size 1

File "E:\stable_diffusion\ComfyUI_windows_portable\ComfyUI\execution.py", line 153, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "E:\stable_diffusion\ComfyUI_windows_portable\ComfyUI\execution.py", line 83, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "E:\stable_diffusion\ComfyUI_windows_portable\ComfyUI\execution.py", line 76, in map_node_over_list results.append(getattr(obj, func)(slice_dict(input_data_all, i))) File "E:\stable_diffusion\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-animatediff\animatediff\sampler.py", line 295, in animatediff_sample return super().sample( File "E:\stable_diffusion\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1237, in sample return common_ksampler(model, seed, steps, cfg, sampler_name, scheduler, positive, negative, latent_image, denoise=denoise) File "E:\stable_diffusion\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1207, in common_ksampler samples = comfy.sample.sample(model, noise, steps, cfg, sampler_name, scheduler, positive, negative, latent_image, File "E:\stable_diffusion\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-animatediff\animatediff\sliding_context_sampling.py", line 74, in sample return orig_comfy_sample(model, args, kwargs, callback=callback) File "E:\stable_diffusion\ComfyUI_windows_portable\ComfyUI\comfy\sample.py", line 97, in sample samples = sampler.sample(noise, positive_copy, negative_copy, cfg=cfg, latent_image=latent_image, start_step=start_step, last_step=last_step, force_full_denoise=force_full_denoise, denoise_mask=noise_mask, sigmas=sigmas, callback=callback, disable_pbar=disable_pbar, seed=seed) File "E:\stable_diffusion\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 781, in sample return sample(self.model, noise, positive, negative, cfg, self.device, sampler(), sigmas, self.model_options, latent_image=latent_image, denoise_mask=denoise_mask, callback=callback, disable_pbar=disable_pbar, seed=seed) File "E:\stable_diffusion\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 686, in sample samples = sampler.sample(model_wrap, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar) File "E:\stable_diffusion\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 638, in sample samples = getattr(k_diffusionsampling, "sample{}".format(sampler_name))(model_k, noise, sigmas, extra_args=extra_args, callback=k_callback, disable=disable_pbar, extra_options) File "E:\stable_diffusion\ComfyUI_windows_portable\python_embeded\lib\site-packages\torch\utils_contextlib.py", line 115, in decorate_context return func(args, kwargs) File "E:\stable_diffusion\ComfyUI_windows_portable\ComfyUI\comfy\k_diffusion\sampling.py", line 137, in sample_euler denoised = model(x, sigma_hat * s_in, extra_args) File "E:\stable_diffusion\ComfyUI_windows_portable\python_embeded\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl return forward_call(*args, *kwargs) File "E:\stable_diffusion\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 326, in forward out = self.inner_model(x, sigma, cond=cond, uncond=uncond, cond_scale=cond_scale, model_options=model_options, seed=seed) File "E:\stable_diffusion\ComfyUI_windows_portable\python_embeded\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl return forward_call(args, kwargs) File "E:\stable_diffusion\ComfyUI_windows_portable\ComfyUI\comfy\k_diffusion\external.py", line 129, in forward eps = self.get_eps(input * c_in, self.sigma_to_t(sigma), *kwargs) File "E:\stable_diffusion\ComfyUI_windows_portable\ComfyUI\comfy\k_diffusion\external.py", line 155, in get_eps return self.inner_model.apply_model(args, **kwargs) File "E:\stable_diffusion\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 314, in apply_model out = sampling_function(self.inner_model.apply_model, x, timestep, uncond, cond, cond_scale, model_options=model_options, seed=seed) File "E:\stable_diffusion\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-animatediff\animatediff\sliding_context_sampling.py", line 466, in sampling_function cond, uncond = sliding_calc_cond_uncond_batch( File "E:\stable_diffusion\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-animatediff\animatediff\sliding_context_sampling.py", line 442, in sliding_calc_cond_uncond_batch sub_cond_out, sub_uncond_out = calc_cond_uncond_batch( File "E:\stable_diffusion\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-animatediff\animatediff\sliding_context_sampling.py", line 314, in calc_cond_uncond_batch c["control"] = control.get_control(inputx, timestep, c, len(cond_or_uncond)) File "E:\stable_diffusion\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Advanced-ControlNet\control\control.py", line 321, in get_control self.cond_hint_original = full_cond_hint_original[self.sub_idxs]

[Kosinkadink]

Hey, the AnimateDiff for comfy that you'd wanna use is AnimateDiff-Evolved, that I am maintaining as well: https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved (in the ComfyUI Manager, it is listed as AnimateDiff Evolved).

You don't need to use any special sampler for that, and can use the vanilla KSampler/Advanced KSampler. See if you get that issue while using AnimateDiff-Evolved.

[Kosinkadink]

Have you been able to resolve your issue?

[lunanane]

okey, thank you, i havent been able to work on it, but ill let you know soon :)