continue-revolution / sd-webui-animatediff

AnimateDiff for AUTOMATIC1111 Stable Diffusion WebUI
Other
3.05k stars 253 forks source link

[Bug]: Brand new install has distorted output (When using JuggernautXL) #548

Open bobba84 opened 1 month ago

bobba84 commented 1 month ago

Is there an existing issue for this?

Have you read FAQ on README?

What happened?

Fresh install of A1111, Controlnet, Animatediff. Tried to make a 16 frame video using JuggernautXL and the output is black and white diagonal lines

Steps to reproduce the problem

As above

What should have happened?

A visible image in the output video

Commit where the problem happens

webui: 1.10.1 extension: b7ce655

What browsers do you use to access the UI ?

No response

Command Line Arguments

None

Console logs

Applying attention optimization: Doggettx... done.
Loading weights [d91d35736d] from D:\stable-diffusion-webui\models\Stable-diffusion\juggernautXL_juggernautX.safetensors
Applying attention optimization: Doggettx... done.
Weights loaded in 6.0s (calculate hash: 3.5s, apply weights to model: 1.1s, move model to device: 1.3s).
2024-08-12 09:30:14,593 - AnimateDiff - INFO - AnimateDiff process start.
2024-08-12 09:30:14,593 - AnimateDiff - INFO - Motion module already injected. Trying to restore.
2024-08-12 09:30:14,594 - AnimateDiff - INFO - Restoring DDIM alpha.
2024-08-12 09:30:14,594 - AnimateDiff - INFO - Removing motion module from SDXL UNet input blocks.
2024-08-12 09:30:14,594 - AnimateDiff - INFO - Removing motion module from SDXL UNet output blocks.
2024-08-12 09:30:14,594 - AnimateDiff - INFO - Restoring SDXL GroupNorm32 forward function.
2024-08-12 09:30:14,594 - AnimateDiff - INFO - Removal finished.
2024-08-12 09:30:14,599 - AnimateDiff - INFO - Hacking SDXL GroupNorm32 forward function.
2024-08-12 09:30:14,599 - AnimateDiff - INFO - Injecting motion module mm_sdxl_hs.safetensors into SDXL UNet input blocks.
2024-08-12 09:30:14,599 - AnimateDiff - INFO - Injecting motion module mm_sdxl_hs.safetensors into SDXL UNet output blocks.
2024-08-12 09:30:14,600 - AnimateDiff - INFO - Setting DDIM alpha.
2024-08-12 09:30:14,601 - AnimateDiff - INFO - Injection finished.
2024-08-12 09:30:14,601 - AnimateDiff - INFO - AnimateDiff + ControlNet will generate 16 frames.
  0%|                                                   | 0/20 [00:00<?, ?it/s]2024-08-12 09:30:14,632 - AnimateDiff - INFO - inner model forward hooked
100%|██████████████████████████████████████████| 20/20 [01:00<00:00,  3.01s/it]
2024-08-12 09:31:17,649 - AnimateDiff - INFO - Restoring DDIM alpha.
2024-08-12 09:31:17,649 - AnimateDiff - INFO - Removing motion module from SDXL UNet input blocks.
2024-08-12 09:31:17,650 - AnimateDiff - INFO - Removing motion module from SDXL UNet output blocks.
2024-08-12 09:31:17,650 - AnimateDiff - INFO - Restoring SDXL GroupNorm32 forward function.
2024-08-12 09:31:17,650 - AnimateDiff - INFO - Removal finished.
2024-08-12 09:31:17,652 - AnimateDiff - INFO - Saving output formats: MP4
Installing sd-webui-animatediff MP4 save requirement: imageio[pyav]
2024-08-12 09:31:21,256 - AnimateDiff - INFO - Saving outputs\txt2img-images\AnimateDiff\2024-08-12\00000-912668801.mp4
2024-08-12 09:31:21,357 - AnimateDiff - INFO - AnimateDiff process end.
Total progress: 40it [02:54,  4.35s/it]
Total progress: 40it [02:54,  3.05s/it]

Additional information

Same issue in my existing installation, but tried a fresh install too