[Bug]: After updating Automatic 1111 to 1.8.0, animations are generated with some noise. What can be done about this?

[Wing13]

Is there an existing issue for this?

• [X] I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

Have you read FAQ on README?

• [X] I have updated WebUI and this extension to the latest version

What happened?

After updating Automatic 1111 to 1.8.0, animations are generated with some noise. What can be done about this?

Steps to reproduce the problem

1. Update Automatic 1111 to 1.8.0
2. Generate animation

What should have happened?

The image should be clear.

Commit where the problem happens

webui: Automatic 1111 to 1.8.0 extension: AnimateDiff

What browsers do you use to access the UI ?

No response

Command Line Arguments

--use-ipex --disable-safe-unpickle

Console logs

2024-03-02 13:23:18,908 - AnimateDiff - INFO - AnimateDiff process start.
2024-03-02 13:23:18,909 - AnimateDiff - INFO - Loading motion module mm_sd15_v2.safetensors from F:\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-animatediff\model\mm_sd15_v2.safetensors
2024-03-02 13:23:19,056 - AnimateDiff - INFO - Guessed mm_sd15_v2.safetensors architecture: MotionModuleType.AnimateDiffV2
2024-03-02 13:23:24,626 - AnimateDiff - WARNING - Missing keys <All keys matched successfully>
Model loaded in 59.8s (load weights from disk: 1.1s, create model: 0.5s, apply weights to model: 14.4s, move model to device: 0.3s, load textual inversion embeddings: 38.0s, calculate empty prompt: 5.5s).
2024-03-02 13:23:39,454 - AnimateDiff - INFO - Injecting motion module mm_sd15_v2.safetensors into SD1.5 UNet middle block.
2024-03-02 13:23:39,455 - AnimateDiff - INFO - Injecting motion module mm_sd15_v2.safetensors into SD1.5 UNet input blocks.
2024-03-02 13:23:39,455 - AnimateDiff - INFO - Injecting motion module mm_sd15_v2.safetensors into SD1.5 UNet output blocks.
2024-03-02 13:23:39,456 - AnimateDiff - INFO - Setting DDIM alpha.
2024-03-02 13:23:39,466 - AnimateDiff - INFO - Injection finished.
2024-03-02 13:23:39,466 - AnimateDiff - INFO - Hacking LoRA module to support motion LoRA
2024-03-02 13:23:39,466 - AnimateDiff - INFO - Hacking CFGDenoiser forward function.
2024-03-02 13:23:39,467 - AnimateDiff - INFO - Hacking ControlNet.
100%|██████████████████████████████████████████████████████████████████████████████████| 20/20 [03:13<00:00,  9.70s/it]
2024-03-02 13:26:59,229 - AnimateDiff - INFO - Restoring ControlNet.███████████████████| 20/20 [02:25<00:00,  7.18s/it]
2024-03-02 13:26:59,229 - AnimateDiff - INFO - Restoring CFGDenoiser forward function.
2024-03-02 13:26:59,230 - AnimateDiff - INFO - Restoring hacked LoRA
2024-03-02 13:26:59,231 - AnimateDiff - INFO - Restoring DDIM alpha.
2024-03-02 13:26:59,231 - AnimateDiff - INFO - Removing motion module from SD1.5 UNet input blocks.
2024-03-02 13:26:59,232 - AnimateDiff - INFO - Removing motion module from SD1.5 UNet output blocks.
2024-03-02 13:26:59,232 - AnimateDiff - INFO - Removing motion module from SD1.5 UNet middle block.
2024-03-02 13:26:59,232 - AnimateDiff - INFO - Removal finished.
2024-03-02 13:26:59,232 - AnimateDiff - INFO - Merging images into GIF.
2024-03-02 13:27:00,529 - AnimateDiff - INFO - AnimateDiff process end.
Total progress: 100%|██████████████████████████████████████████████████████████████████| 20/20 [02:32<00:00,  7.62s/it]
2024-03-02 13:27:38,526 - AnimateDiff - INFO - AnimateDiff process start.██████████████| 20/20 [02:32<00:00,  7.18s/it]
2024-03-02 13:27:38,539 - AnimateDiff - INFO - Injecting motion module mm_sd15_v2.safetensors into SD1.5 UNet middle block.
2024-03-02 13:27:38,540 - AnimateDiff - INFO - Injecting motion module mm_sd15_v2.safetensors into SD1.5 UNet input blocks.
2024-03-02 13:27:38,542 - AnimateDiff - INFO - Injecting motion module mm_sd15_v2.safetensors into SD1.5 UNet output blocks.
2024-03-02 13:27:38,542 - AnimateDiff - INFO - Setting DDIM alpha.
2024-03-02 13:27:38,547 - AnimateDiff - INFO - Injection finished.
2024-03-02 13:27:38,548 - AnimateDiff - INFO - Hacking LoRA module to support motion LoRA
2024-03-02 13:27:38,548 - AnimateDiff - INFO - Hacking CFGDenoiser forward function.
2024-03-02 13:27:38,549 - AnimateDiff - INFO - Hacking ControlNet.
100%|██████████████████████████████████████████████████████████████████████████████████| 20/20 [03:43<00:00, 11.18s/it]
2024-03-02 13:31:26,466 - AnimateDiff - INFO - Restoring ControlNet.███████████████████| 20/20 [03:35<00:00,  7.87s/it]
2024-03-02 13:31:26,466 - AnimateDiff - INFO - Restoring CFGDenoiser forward function.
2024-03-02 13:31:26,468 - AnimateDiff - INFO - Restoring hacked LoRA
2024-03-02 13:31:26,468 - AnimateDiff - INFO - Restoring DDIM alpha.
2024-03-02 13:31:26,468 - AnimateDiff - INFO - Removing motion module from SD1.5 UNet input blocks.
2024-03-02 13:31:26,469 - AnimateDiff - INFO - Removing motion module from SD1.5 UNet output blocks.
2024-03-02 13:31:26,469 - AnimateDiff - INFO - Removing motion module from SD1.5 UNet middle block.
2024-03-02 13:31:26,470 - AnimateDiff - INFO - Removal finished.
2024-03-02 13:31:26,470 - AnimateDiff - INFO - Merging images into GIF.
2024-03-02 13:31:28,410 - AnimateDiff - INFO - AnimateDiff process end.
Total progress: 100%|██████████████████████████████████████████████████████████████████| 20/20 [03:41<00:00, 11.06s/it]
Total progress: 100%|██████████████████████████████████████████████████████████████████| 20/20 [03:41<00:00,  7.87s/it]

Additional information

No response

[continue-revolution]

Please wait for 2.0.0-a. It is expected to be released within 24 hours. I have only some documentation remaining to be done. If you really want to have an early try, you may want to do git checkout conrevo/v1.13.2 (its version tag will not be v1.13.2, but v2.0.0-a instead) in extensions/sd-webui-animatediff.

[Wing13]

Ok, thank you for your work!

[continue-revolution]

I've merged but I cannot update doc along with this update. I have to sleep. The doc will be updatd in 24 hours.

That said, for your issue, you don't have to do anything. Just update your AnimateDiff and ControlNet and you'll be fine.