search

Kosinkadink / ComfyUI-AnimateDiff-Evolved

Improved AnimateDiff for ComfyUI and Advanced Sampling Support
Apache License 2.0
2.78k stars 209 forks source link

AnimateDiff producing noise output in Comfyui #484

Open tylerknoll opened 1 month ago

tylerknoll commented 1 month ago

Any workflow that uses AnimateDiff produces a colorful noise like the image included. Ive tried changing every possible setting in the relevant AD nodes. My nodes and Comfyui are up to date. AD was working fine then suddenly everything was just this noise output.

After some testing it seems that the FreeNoise in sample settings for FreeInit is the culprit. I uninstalled and reinstalled AD and it was working as expected. When I changed the noise type in sample settings to FreeNoise the output was starting to resemble the Noise seen in the photo I included but nowhere near as bad. Unfortunately, the damage was done and even after I changed the settings back to default and even created a new AD loader (legacy or new) the outputs slowly get worse until they look like the image. Using mm_sd_v15_v2 btw.

https://github.com/user-attachments/assets/c7d0bb43-edf5-423d-9eac-a88afd4d1b74

Kosinkadink commented 1 month ago

FreeNoise wouldn't cause this issue. Assuming you are using the sweetspot amount of latents at a time (16 latents/more than 16 latents with context_length 16), th n your issue stems from AD not being applied correctly.

I looked to see if ComfyUI had any updates that could potentially break AD, but didn't see anything. Could you post a screenshot of your workflow, as well as the list of custom_nodes you have installed?

Kosinkadink commented 1 month ago

Although, your video being 0 seconds/1 frame long does make me think you are simply not using 16 latents/more than 16 latents with context_length 16, and instead gave it 1 latent.

tylerknoll commented 1 month ago

I was using multiple latents which were also generating the noise after free noise, but I will say that I wasn't increasing the context length with more latents and I wasn't aware that 16 was the sweet spot. With that in mind I created a new workflow from scratch using 16 latents with 16 context length and got no noise but it wasn't working like it was before, it wasn't really doing anything at all. Long story short I played around with some different checkpoints and cfg and eventually got it somewhat close to where it was before and freenoise is no longer causing issues. Thankyou you so much for responding, I'm new to comfy, sorry for the noob question. Ill include a list of my custom nodes as I am still curious to see if anything could be interacting with AD custom nodes