search

deforum-art / sd-webui-deforum

Deforum extension for AUTOMATIC1111's Stable Diffusion webui
https://deforum.github.io
Other
2.69k stars 389 forks source link

[Bug]: ControlNet 1.1 doesn't affect the Pose #643

Closed emperor1412 closed 1 year ago

emperor1412 commented 1 year ago

Have you read the latest version of the FAQ?

Is there an existing issue for this?

Are you using the latest version of the Deforum extension?

What happened?

ControlNet couldn't affect the frame pose at all.

Steps to reproduce the problem

  1. Enable ControlNet
  2. Use the setting as in this file: https://drive.google.com/file/d/16K78mN8Przq6DM6D7TtiascJt4Wdmb21/view?usp=sharing
  3. Use this video as input to ControlNet: https://drive.google.com/open?id=1DTNaEtaRUF6H4cVmilNU0oxfYA9z2Yk2&authuser=h%40metadogworld.io&usp=drive_fs
  4. Choose OpenPose as Preprocessor and control_v11p_sd15_openpose [cab727d4] as Model
  5. Click generate

Please find my attempt's result here: https://drive.google.com/open?id=1-37I71eMkL5SQACrLPt3cV08hNiiUa37&authuser=h%40metadogworld.io&usp=drive_fs

What should have happened?

Generated frame should have the posed affected by ControlNet

WebUI and Deforum extension Commit IDs

webui commit id - 22bcc7be428c94e9408f589966c2040187245d81 deforum exten commit id - 32c8bc2e072eac95226818f1158139f3661c7472 ControlNet commit id - af4720780f10d912789cbd6db1fbc6d2f0afc533

On which platform are you launching the webui with the extension?

Local PC Windows 10

Deforum settings

https://drive.google.com/file/d/16K78mN8Przq6DM6D7TtiascJt4Wdmb21/view?usp=sharing

Webui core settings

https://drive.google.com/open?id=1DW6xvNKKINx31RtaA_F-7rc6BOC3yNal&authuser=h%40metadogworld.io&usp=drive_fs

Console logs

https://drive.google.com/open?id=1D_ctVUw6fT0tR4WQC1h_3f1Dyl67jTEo&authuser=h%40metadogworld.io&usp=drive_fs

Deforum extension for auto1111 webui, v2.3b Git commit: 7bb40d05 (Sun Apr 30 15:26:13 2023) Unpacking ControlNet 1 base video Exporting Video Frames to F:\stable-diffusion-webui\stable-diffusion-webui\outputs/img2img-images\Deforum_20230430235047\controlnet_1_inputframes... Trying to extract frames from video with input FPS of 30.0. Please wait patiently. Extracted 225 frames from video in 0.24 seconds! Loading 120 input frames from F:\stable-diffusion-webui\stable-diffusion-webui\outputs/img2img-images\Deforum_20230430235047\controlnet_1_inputframes and saving video frames to F:\stable-diffusion-webui\stable-diffusion-webui\outputs/img2img-images\Deforum_20230430235047 ControlNet 1 base video unpacked! Saving animation frames to: F:\stable-diffusion-webui\stable-diffusion-webui\outputs/img2img-images\Deforum_20230430235047 Animation frame: 0/120 Seed: 960147764 Prompt: angel, sequins, silver, diamonds, colorful gemstones, glowing light from behind, complex extremely hyperdetailed, 3d rendering, unreal engine, perfect composition, gorgeously, complex, insanely, detailed, octane rendering, trending on artstation, award-winning photography, masterpiece, 8k, surreal, artistic, unreal engine, octane rendering, highly detailed, cinematic lighting, intricate, ultra hd, sharp photo, trending on artstation Not using an init image (doing pure txt2img) ╭─────┬───┬───────┬─────┬──────┬────┬────╮ │Steps│CFG│Denoise│Angle│ Zoom │Tr X│Tr Y│ ├─────┼───┼───────┼─────┼──────┼────┼────┤ │ 25 │7.0│ None │ 0 │1.0025│ 0 │ 0 │ ╰─────┴───┴───────┴─────┴──────┴────┴────╯ Reading ControlNet 1 base frame #1 at F:\stable-diffusion-webui\stable-diffusion-webui\outputs/img2img-images\Deforum_20230430235047\controlnet_1_inputframes\000000001.jpg Error running process: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\asymmetric-tiling-sd-webui\scripts\asymmetric_tiling.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 417, in process script.process(p, *script_args) TypeError: Script.process() missing 5 required positional arguments: 'active', 'tileX', 'tileY', 'startStep', and 'stopStep'

Error running process: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\prompt_translator\scripts\main.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 417, in process script.process(p, *script_args) TypeError: Script.process() missing 1 required positional argument: 'language'

Error running process: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\sd-webui-llul\scripts\llul.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 417, in process script.process(p, *script_args) TypeError: Script.process() missing 13 required positional arguments: 'enabled', 'multiply', 'weight', 'understand', 'layers', 'apply_to', 'start_steps', 'max_steps', 'up', 'up_aa', 'down', 'down_aa', and 'intp'

Error running process: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\stable-diffusion-webui-aesthetic-gradients\scripts\aesthetic.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 417, in process script.process(p, *script_args) TypeError: AestheticScript.process() missing 8 required positional arguments: 'aesthetic_weight', 'aesthetic_steps', 'aesthetic_lr', 'aesthetic_slerp', 'aesthetic_imgs', 'aesthetic_imgs_text', 'aesthetic_slerp_angle', and 'aesthetic_text_negative'

Error running process_batch: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\sd-webui-additional-networks\scripts\additional_networks.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 435, in process_batch script.process_batch(p, *script_args, **kwargs) File "F:\stable-diffusion-webui\stable-diffusion-webui\extensions\sd-webui-additional-networks\scripts\additional_networks.py", line 189, in process_batch if not args[0]: IndexError: tuple index out of range

100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 25/25 [00:08<00:00, 3.07it/s] Animation frame: 2/120 █████▍ | 25/556 [00:05<01:46, 4.97it/s] Creating in-between cadence frame: 0; tween:0.50; Creating in-between cadence frame: 1; tween:1.00; Seed: 960147765 Prompt: angel, sequins, silver, diamonds, colorful gemstones, glowing light from behind, complex extremely hyperdetailed, 3d rendering, unreal engine, perfect composition, gorgeously, complex, insanely, detailed, octane rendering, trending on artstation, award-winning photography, masterpiece, 8k, surreal, artistic, unreal engine, octane rendering, highly detailed, cinematic lighting, intricate, ultra hd, sharp photo, trending on artstation ╭─────┬───┬───────┬─────┬─────┬────┬────╮ │Steps│CFG│Denoise│Angle│Zoom │Tr X│Tr Y│ ├─────┼───┼───────┼─────┼─────┼────┼────┤ │ 25 │7.0│ 0.35 │ 0 │1.003│ 0 │ 0 │ ╰─────┴───┴───────┴─────┴─────┴────┴────╯ Reading ControlNet 1 base frame #3 at F:\stable-diffusion-webui\stable-diffusion-webui\outputs/img2img-images\Deforum_20230430235047\controlnet_1_inputframes\000000003.jpg Error running process: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\asymmetric-tiling-sd-webui\scripts\asymmetric_tiling.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 417, in process script.process(p, *script_args) TypeError: Script.process() missing 5 required positional arguments: 'active', 'tileX', 'tileY', 'startStep', and 'stopStep'

Error running process: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\prompt_translator\scripts\main.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 417, in process script.process(p, *script_args) TypeError: Script.process() missing 1 required positional argument: 'language'

Error running process: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\sd-webui-llul\scripts\llul.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 417, in process script.process(p, *script_args) TypeError: Script.process() missing 13 required positional arguments: 'enabled', 'multiply', 'weight', 'understand', 'layers', 'apply_to', 'start_steps', 'max_steps', 'up', 'up_aa', 'down', 'down_aa', and 'intp'

Error running process: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\stable-diffusion-webui-aesthetic-gradients\scripts\aesthetic.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 417, in process script.process(p, *script_args) TypeError: AestheticScript.process() missing 8 required positional arguments: 'aesthetic_weight', 'aesthetic_steps', 'aesthetic_lr', 'aesthetic_slerp', 'aesthetic_imgs', 'aesthetic_imgs_text', 'aesthetic_slerp_angle', and 'aesthetic_text_negative'

Error running process_batch: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\sd-webui-additional-networks\scripts\additional_networks.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 435, in process_batch script.process_batch(p, *script_args, **kwargs) File "F:\stable-diffusion-webui\stable-diffusion-webui\extensions\sd-webui-additional-networks\scripts\additional_networks.py", line 189, in process_batch if not args[0]: IndexError: tuple index out of range

100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00, 4.96it/s] Animation frame: 4/120 ███████▋ | 34/556 [00:11<02:30, 3.47it/s] Creating in-between cadence frame: 2; tween:0.50; Creating in-between cadence frame: 3; tween:1.00; Seed: 960147766 Prompt: angel, sequins, silver, diamonds, colorful gemstones, glowing light from behind, complex extremely hyperdetailed, 3d rendering, unreal engine, perfect composition, gorgeously, complex, insanely, detailed, octane rendering, trending on artstation, award-winning photography, masterpiece, 8k, surreal, artistic, unreal engine, octane rendering, highly detailed, cinematic lighting, intricate, ultra hd, sharp photo, trending on artstation ╭─────┬───┬───────┬─────┬──────┬────┬────╮ │Steps│CFG│Denoise│Angle│ Zoom │Tr X│Tr Y│ ├─────┼───┼───────┼─────┼──────┼────┼────┤ │ 25 │7.0│ 0.35 │ 0 │1.0035│ 0 │ 0 │ ╰─────┴───┴───────┴─────┴──────┴────┴────╯ Reading ControlNet 1 base frame #5 at F:\stable-diffusion-webui\stable-diffusion-webui\outputs/img2img-images\Deforum_20230430235047\controlnet_1_inputframes\000000005.jpg Error running process: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\asymmetric-tiling-sd-webui\scripts\asymmetric_tiling.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 417, in process script.process(p, *script_args) TypeError: Script.process() missing 5 required positional arguments: 'active', 'tileX', 'tileY', 'startStep', and 'stopStep'

Error running process: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\prompt_translator\scripts\main.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 417, in process script.process(p, *script_args) TypeError: Script.process() missing 1 required positional argument: 'language'

Error running process: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\sd-webui-llul\scripts\llul.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 417, in process script.process(p, *script_args) TypeError: Script.process() missing 13 required positional arguments: 'enabled', 'multiply', 'weight', 'understand', 'layers', 'apply_to', 'start_steps', 'max_steps', 'up', 'up_aa', 'down', 'down_aa', and 'intp'

Error running process: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\stable-diffusion-webui-aesthetic-gradients\scripts\aesthetic.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 417, in process script.process(p, *script_args) TypeError: AestheticScript.process() missing 8 required positional arguments: 'aesthetic_weight', 'aesthetic_steps', 'aesthetic_lr', 'aesthetic_slerp', 'aesthetic_imgs', 'aesthetic_imgs_text', 'aesthetic_slerp_angle', and 'aesthetic_text_negative'

Error running process_batch: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\sd-webui-additional-networks\scripts\additional_networks.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 435, in process_batch script.process_batch(p, *script_args, **kwargs) File "F:\stable-diffusion-webui\stable-diffusion-webui\extensions\sd-webui-additional-networks\scripts\additional_networks.py", line 189, in process_batch if not args[0]: IndexError: tuple index out of range

67%|████████████████████████████████████████████████████████████████████████████████████████████████████████████▋ | 6/9 [00:01<00:00, 4.99it/s]Civitai Link: Presence update: SD: 106, Clients: 0 | 40/556 [00:13<02:08, 4.01it/s] 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00, 4.98it/s] Animation frame: 6/120 █████████▉ | 43/556 [00:14<01:51, 4.60it/s] Creating in-between cadence frame: 4; tween:0.50; Creating in-between cadence frame: 5; tween:1.00; Seed: 960147767 Prompt: angel, sequins, silver, diamonds, colorful gemstones, glowing light from behind, complex extremely hyperdetailed, 3d rendering, unreal engine, perfect composition, gorgeously, complex, insanely, detailed, octane rendering, trending on artstation, award-winning photography, masterpiece, 8k, surreal, artistic, unreal engine, octane rendering, highly detailed, cinematic lighting, intricate, ultra hd, sharp photo, trending on artstation ╭─────┬───┬───────┬─────┬──────┬────┬────╮ │Steps│CFG│Denoise│Angle│ Zoom │Tr X│Tr Y│ ├─────┼───┼───────┼─────┼──────┼────┼────┤ │ 25 │7.0│ 0.35 │ 0 │1.0039│ 0 │ 0 │ ╰─────┴───┴───────┴─────┴──────┴────┴────╯ Reading ControlNet 1 base frame #7 at F:\stable-diffusion-webui\stable-diffusion-webui\outputs/img2img-images\Deforum_20230430235047\controlnet_1_inputframes\000000007.jpg Error running process: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\asymmetric-tiling-sd-webui\scripts\asymmetric_tiling.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 417, in process script.process(p, *script_args) TypeError: Script.process() missing 5 required positional arguments: 'active', 'tileX', 'tileY', 'startStep', and 'stopStep'

Error running process: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\prompt_translator\scripts\main.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 417, in process script.process(p, *script_args) TypeError: Script.process() missing 1 required positional argument: 'language'

Error running process: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\sd-webui-llul\scripts\llul.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 417, in process script.process(p, *script_args) TypeError: Script.process() missing 13 required positional arguments: 'enabled', 'multiply', 'weight', 'understand', 'layers', 'apply_to', 'start_steps', 'max_steps', 'up', 'up_aa', 'down', 'down_aa', and 'intp'

Error running process: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\stable-diffusion-webui-aesthetic-gradients\scripts\aesthetic.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 417, in process script.process(p, *script_args) TypeError: AestheticScript.process() missing 8 required positional arguments: 'aesthetic_weight', 'aesthetic_steps', 'aesthetic_lr', 'aesthetic_slerp', 'aesthetic_imgs', 'aesthetic_imgs_text', 'aesthetic_slerp_angle', and 'aesthetic_text_negative'

Error running process_batch: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\sd-webui-additional-networks\scripts\additional_networks.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 435, in process_batch script.process_batch(p, *script_args, **kwargs) File "F:\stable-diffusion-webui\stable-diffusion-webui\extensions\sd-webui-additional-networks\scripts\additional_networks.py", line 189, in process_batch if not args[0]: IndexError: tuple index out of range

100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00, 4.98it/s] Animation frame: 8/120 ████████████▎ | 52/556 [00:16<01:47, 4.68it/s] Creating in-between cadence frame: 6; tween:0.50; Creating in-between cadence frame: 7; tween:1.00; Seed: 960147768 Prompt: angel, sequins, silver, diamonds, colorful gemstones, glowing light from behind, complex extremely hyperdetailed, 3d rendering, unreal engine, perfect composition, gorgeously, complex, insanely, detailed, octane rendering, trending on artstation, award-winning photography, masterpiece, 8k, surreal, artistic, unreal engine, octane rendering, highly detailed, cinematic lighting, intricate, ultra hd, sharp photo, trending on artstation ╭─────┬───┬───────┬─────┬──────┬────┬────╮ │Steps│CFG│Denoise│Angle│ Zoom │Tr X│Tr Y│ ├─────┼───┼───────┼─────┼──────┼────┼────┤ │ 25 │7.0│ 0.35 │ 0 │1.0042│ 0 │ 0 │ ╰─────┴───┴───────┴─────┴──────┴────┴────╯ Reading ControlNet 1 base frame #9 at F:\stable-diffusion-webui\stable-diffusion-webui\outputs/img2img-images\Deforum_20230430235047\controlnet_1_inputframes\000000009.jpg Error running process: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\asymmetric-tiling-sd-webui\scripts\asymmetric_tiling.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 417, in process script.process(p, *script_args) TypeError: Script.process() missing 5 required positional arguments: 'active', 'tileX', 'tileY', 'startStep', and 'stopStep'

Error running process: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\prompt_translator\scripts\main.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 417, in process script.process(p, *script_args) TypeError: Script.process() missing 1 required positional argument: 'language'

Error running process: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\sd-webui-llul\scripts\llul.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 417, in process script.process(p, *script_args) TypeError: Script.process() missing 13 required positional arguments: 'enabled', 'multiply', 'weight', 'understand', 'layers', 'apply_to', 'start_steps', 'max_steps', 'up', 'up_aa', 'down', 'down_aa', and 'intp'

Error running process: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\stable-diffusion-webui-aesthetic-gradients\scripts\aesthetic.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 417, in process script.process(p, *script_args) TypeError: AestheticScript.process() missing 8 required positional arguments: 'aesthetic_weight', 'aesthetic_steps', 'aesthetic_lr', 'aesthetic_slerp', 'aesthetic_imgs', 'aesthetic_imgs_text', 'aesthetic_slerp_angle', and 'aesthetic_text_negative'

Error running process_batch: F:\stable-diffusion-webui\stable-diffusion-webui\extensions\sd-webui-additional-networks\scripts\additional_networks.py Traceback (most recent call last): File "F:\stable-diffusion-webui\stable-diffusion-webui\modules\scripts.py", line 435, in process_batch script.process_batch(p, *script_args, **kwargs) File "F:\stable-diffusion-webui\stable-diffusion-webui\extensions\sd-webui-additional-networks\scripts\additional_networks.py", line 189, in process_batch if not args[0]: IndexError: tuple index out of range

100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:01<00:00, 4.97it/s] Animation frame: 10/120 █████████████▌ | 61/556 [00:19<01:45, 4.69it/s] Creating in-between cadence frame: 8; tween:0.50; Creating in-between cadence frame: 9; tween:1.00; Seed: 960147769 Prompt: angel, sequins, silver, diamonds, colorful gemstones, glowing light from behind, complex extremely hyperdetailed, 3d rendering, unreal engine, perfect composition, gorgeously, complex, insanely, detailed, octane rendering, trending on artstation, award-winning photography, masterpiece, 8k, surreal, artistic, unreal engine, octane rendering, highly detailed, cinematic lighting, intricate, ultra hd, sharp photo, trending on artstation ╭─────┬───┬───────┬─────┬──────┬────┬────╮ │Steps│CFG│Denoise│Angle│ Zoom │Tr X│Tr Y│ ├─────┼───┼───────┼─────┼──────┼────┼────┤ │ 25 │7.0│ 0.35 │ 0 │1.0044│ 0 │ 0 │

Additional information

No response

github-actions[bot] commented 1 year ago

This issue has been closed due to incorrect formatting. Please address the following mistakes and reopen the issue (click on the 'Reopen' button below):

emperor1412 commented 1 year ago

please reopen this issue

ApoyPH commented 1 year ago

I have this same errors

Deforum extension for auto1111 webui, v2.4b
Git commit: 7012f55b (Wed May 24 15:53:20 2023)
Unpacking ControlNet 1 base video
Exporting Video Frames to C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811\controlnet_1_inputframes...
Trying to extract frames from video with input FPS of 30.0. Please wait patiently.
Extracted 356 frames from video in 0.98 seconds!
Loading 330 input frames from C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811\controlnet_1_inputframes and saving video frames to C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811
ControlNet 1 base video unpacked!
Unpacking ControlNet 4 base video
Exporting Video Frames to C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811\controlnet_4_inputframes...
Trying to extract frames from video with input FPS of 30.0. Please wait patiently.
Extracted 356 frames from video in 1.02 seconds!
Loading 330 input frames from C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811\controlnet_4_inputframes and saving video frames to C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811
ControlNet 4 base video unpacked!
Unpacking ControlNet 5 base video
Exporting Video Frames to C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811\controlnet_5_inputframes...
Trying to extract frames from video with input FPS of 30.0. Please wait patiently.
Extracted 356 frames from video in 1.00 seconds!
Loading 330 input frames from C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811\controlnet_5_inputframes and saving video frames to C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811
ControlNet 5 base video unpacked!
Saving animation frames to:
C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811
Animation frame: 0/330
Seed: 2364038177
Prompt: neon lights cyberpunk girl dancing
Neg Prompt: nsfw, nude
Not using an init image (doing pure txt2img)
╭─────┬───┬───────┬─────┬────┬────┬────╮
│Steps│CFG│Denoise│Angle│Zoom│Tr X│Tr Y│
├─────┼───┼───────┼─────┼────┼────┼────┤
│ 25  │7.0│   0   │  0  │ 1  │ 0  │ 0  │
╰─────┴───┴───────┴─────┴────┴────┴────╯
Reading ControlNet 1 base frame #0 at C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811\controlnet_1_inputframes\000000000.jpg
Reading ControlNet 4 base frame #0 at C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811\controlnet_4_inputframes\000000000.jpg
Reading ControlNet 5 base frame #0 at C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811\controlnet_5_inputframes\000000000.jpg
Error running process: C:\stable-diffusion-webui\extensions\sd-webui-llul\scripts\llul.py
Traceback (most recent call last):
  File "C:\stable-diffusion-webui\modules\scripts.py", line 418, in process
    script.process(p, *script_args)
TypeError: Script.process() missing 13 required positional arguments: 'enabled', 'multiply', 'weight', 'understand', 'layers', 'apply_to', 'start_steps', 'max_steps', 'up', 'up_aa', 'down', 'down_aa', and 'intp'

  4%|███▎                                                                              | 1/25 [01:57<47:05, 117.75s/it]
Error running postprocess: C:\stable-diffusion-webui\extensions\sd-webui-llul\scripts\llul.py | 0/2986 [00:00<?, ?it/s]
Traceback (most recent call last):
  File "C:\stable-diffusion-webui\modules\scripts.py", line 445, in postprocess
    script.postprocess(p, processed, *script_args)
TypeError: Script.postprocess() missing 13 required positional arguments: 'enabled', 'multiply', 'weight', 'understand', 'layers', 'apply_to', 'start_steps', 'max_steps', 'up', 'up_aa', 'down', 'down_aa', and 'intp'
ApoyPH commented 1 year ago 
Already up to date.
venv "C:\stable-diffusion-webui\venv\Scripts\Python.exe"
Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug  1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Version: v1.2.1
Commit hash: 89f9faa63388756314e8a1d96cf86bf5e0663045
Installing requirements

current transparent-background 1.2.3

If submitting an issue on github, please provide the full startup log for debugging purposes.

Initializing Dreambooth
Dreambooth revision: 926ae204ef5de17efca2059c334b6098492a0641
Successfully installed fastapi-0.94.1 gitpython-3.1.31 google-auth-oauthlib-0.4.6 requests-2.31.0 transformers-4.26.1

Does your project take forever to startup?
Repetitive dependency installation may be the reason.
Automatic1111's base project sets strict requirements on outdated dependencies.
If an extension is using a newer version, the dependency is uninstalled and reinstalled twice every startup.

[+] xformers version 0.0.17 installed.
[+] torch version 2.0.1+cu118 installed.
[+] torchvision version 0.15.2+cu118 installed.
[+] accelerate version 0.18.0 installed.
[+] diffusers version 0.14.0 installed.
[+] transformers version 4.26.1 installed.
[+] bitsandbytes version 0.35.4 installed.

Launching Web UI with arguments: --xformers --medvram
Loading weights [4199bcdd14] from C:\stable-diffusion-webui\models\Stable-diffusion\revAnimated_v122.safetensors
Creating model from config: C:\stable-diffusion-webui\configs\v1-inference.yaml
LatentDiffusion: Running in eps-prediction mode
DiffusionWrapper has 859.52 M params.
Applying xformers cross attention optimization.
Textual inversion embeddings loaded(1): EasyNegative
Model loaded in 9.0s (load weights from disk: 0.3s, create model: 0.6s, apply weights to model: 6.9s, apply half(): 1.2s).
ControlNet v1.1.190
ControlNet v1.1.190
Create LRU cache (max_size=16) for preprocessor results.
Create LRU cache (max_size=16) for preprocessor results.
[VRAMEstimator] Loaded benchmark data.
*Deforum ControlNet support: enabled*
CUDA SETUP: Loading binary C:\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\libbitsandbytes_cudaall.dll...
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Create LRU cache (max_size=16) for preprocessor results.
Startup time: 27.9s (import torch: 4.1s, import gradio: 1.3s, import ldm: 0.5s, other imports: 1.0s, list SD models: 0.3s, setup codeformer: 0.1s, load scripts: 13.1s, create ui: 6.9s, gradio launch: 0.5s).
Saving backup of webui/extension state to C:\stable-diffusion-webui\config_states\2023_05_25-05_03_03_Backup (pre-update).json.
Closing server running on port: 7860
Restarting UI...
ControlNet v1.1.190
Create LRU cache (max_size=16) for preprocessor results.
Create LRU cache (max_size=16) for preprocessor results.
[VRAMEstimator] Loaded benchmark data.
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Create LRU cache (max_size=16) for preprocessor results.
Startup time: 9.0s (load scripts: 2.0s, create ui: 6.7s, gradio launch: 0.3s).
reading custom settings from 2deforum_settings.txt
Deforum extension for auto1111 webui, v2.4b
Git commit: 7012f55b (Wed May 24 15:53:20 2023)
Unpacking ControlNet 2 base video
Exporting Video Frames to C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050440\controlnet_2_inputframes...
Trying to extract frames from video with input FPS of 30.0. Please wait patiently.
Extracted 356 frames from video in 1.03 seconds!
Loading 330 input frames from C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050440\controlnet_2_inputframes and saving video frames to C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050440
ControlNet 2 base video unpacked!
Unpacking ControlNet 3 base video
Exporting Video Frames to C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050440\controlnet_3_inputframes...
Trying to extract frames from video with input FPS of 30.0. Please wait patiently.
Extracted 356 frames from video in 1.15 seconds!
Loading 330 input frames from C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050440\controlnet_3_inputframes and saving video frames to C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050440
ControlNet 3 base video unpacked!
Unpacking ControlNet 4 base video
Exporting Video Frames to C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050440\controlnet_4_inputframes...
Trying to extract frames from video with input FPS of 30.0. Please wait patiently.
Extracted 356 frames from video in 1.07 seconds!
Loading 330 input frames from C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050440\controlnet_4_inputframes and saving video frames to C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050440
ControlNet 4 base video unpacked!
Saving animation frames to:
C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050440
Animation frame: 0/330
Seed: 1596769750
Prompt: neon lights cyberpunk girl dancing
Neg Prompt: nsfw, nude
Not using an init image (doing pure txt2img)
╭─────┬───┬───────┬─────┬────┬────┬────╮
│Steps│CFG│Denoise│Angle│Zoom│Tr X│Tr Y│
├─────┼───┼───────┼─────┼────┼────┼────┤
│ 25  │7.0│   0   │  0  │ 1  │ 0  │ 0  │
╰─────┴───┴───────┴─────┴────┴────┴────╯
Reading ControlNet 2 base frame #0 at C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050440\controlnet_2_inputframes\000000000.jpg
Reading ControlNet 3 base frame #0 at C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050440\controlnet_3_inputframes\000000000.jpg
Reading ControlNet 4 base frame #0 at C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050440\controlnet_4_inputframes\000000000.jpg
Error running process: C:\stable-diffusion-webui\extensions\sd-webui-llul\scripts\llul.py
Traceback (most recent call last):
  File "C:\stable-diffusion-webui\modules\scripts.py", line 418, in process
    script.process(p, *script_args)
TypeError: Script.process() missing 13 required positional arguments: 'enabled', 'multiply', 'weight', 'understand', 'layers', 'apply_to', 'start_steps', 'max_steps', 'up', 'up_aa', 'down', 'down_aa', and 'intp'

  4%|███▎                                                                               | 1/25 [00:05<02:05,  5.23s/it]
Error running postprocess: C:\stable-diffusion-webui\extensions\sd-webui-llul\scripts\llul.py | 0/2986 [00:00<?, ?it/s]
Traceback (most recent call last):
  File "C:\stable-diffusion-webui\modules\scripts.py", line 445, in postprocess
    script.postprocess(p, processed, *script_args)
TypeError: Script.postprocess() missing 13 required positional arguments: 'enabled', 'multiply', 'weight', 'understand', 'layers', 'apply_to', 'start_steps', 'max_steps', 'up', 'up_aa', 'down', 'down_aa', and 'intp'

Animation frame: 1/330
Seed: 1596769751
Prompt: neon lights cyberpunk girl dancing
Neg Prompt: nsfw, nude
Deforum progress:   0%|                                                             | 1/2986 [00:02<2:21:00,  2.83s/it]
Got a request to stitch frames to video using FFmpeg.
Frames:
C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050440\20230525050440_%09d.png
To Video:
C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050440\20230525050440.mp4
Stitching *video*...
Video stitching done in 0.24 seconds!
Deforum extension for auto1111 webui, v2.4b
Git commit: 7012f55b (Wed May 24 15:53:20 2023)
Unpacking ControlNet 1 base video
Exporting Video Frames to C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811\controlnet_1_inputframes...
Trying to extract frames from video with input FPS of 30.0. Please wait patiently.
Extracted 356 frames from video in 0.98 seconds!
Loading 330 input frames from C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811\controlnet_1_inputframes and saving video frames to C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811
ControlNet 1 base video unpacked!
Unpacking ControlNet 4 base video
Exporting Video Frames to C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811\controlnet_4_inputframes...
Trying to extract frames from video with input FPS of 30.0. Please wait patiently.
Extracted 356 frames from video in 1.02 seconds!
Loading 330 input frames from C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811\controlnet_4_inputframes and saving video frames to C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811
ControlNet 4 base video unpacked!
Unpacking ControlNet 5 base video
Exporting Video Frames to C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811\controlnet_5_inputframes...
Trying to extract frames from video with input FPS of 30.0. Please wait patiently.
Extracted 356 frames from video in 1.00 seconds!
Loading 330 input frames from C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811\controlnet_5_inputframes and saving video frames to C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811
ControlNet 5 base video unpacked!
Saving animation frames to:
C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811
Animation frame: 0/330
Seed: 2364038177
Prompt: neon lights cyberpunk girl dancing
Neg Prompt: nsfw, nude
Not using an init image (doing pure txt2img)
╭─────┬───┬───────┬─────┬────┬────┬────╮
│Steps│CFG│Denoise│Angle│Zoom│Tr X│Tr Y│
├─────┼───┼───────┼─────┼────┼────┼────┤
│ 25  │7.0│   0   │  0  │ 1  │ 0  │ 0  │
╰─────┴───┴───────┴─────┴────┴────┴────╯
Reading ControlNet 1 base frame #0 at C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811\controlnet_1_inputframes\000000000.jpg
Reading ControlNet 4 base frame #0 at C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811\controlnet_4_inputframes\000000000.jpg
Reading ControlNet 5 base frame #0 at C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811\controlnet_5_inputframes\000000000.jpg
Error running process: C:\stable-diffusion-webui\extensions\sd-webui-llul\scripts\llul.py
Traceback (most recent call last):
  File "C:\stable-diffusion-webui\modules\scripts.py", line 418, in process
    script.process(p, *script_args)
TypeError: Script.process() missing 13 required positional arguments: 'enabled', 'multiply', 'weight', 'understand', 'layers', 'apply_to', 'start_steps', 'max_steps', 'up', 'up_aa', 'down', 'down_aa', and 'intp'

  4%|███▎                                                                              | 1/25 [01:57<47:05, 117.75s/it]
Error running postprocess: C:\stable-diffusion-webui\extensions\sd-webui-llul\scripts\llul.py | 0/2986 [00:00<?, ?it/s]
Traceback (most recent call last):
  File "C:\stable-diffusion-webui\modules\scripts.py", line 445, in postprocess
    script.postprocess(p, processed, *script_args)
TypeError: Script.postprocess() missing 13 required positional arguments: 'enabled', 'multiply', 'weight', 'understand', 'layers', 'apply_to', 'start_steps', 'max_steps', 'up', 'up_aa', 'down', 'down_aa', and 'intp'

Animation frame: 1/330
Seed: 2364038178
Prompt: neon lights cyberpunk girl dancing
Neg Prompt: nsfw, nude
Deforum progress:   0%|                                                             | 1/2986 [00:02<2:24:08,  2.90s/it]
Got a request to stitch frames to video using FFmpeg.
Frames:
C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811\20230525050811_%09d.png
To Video:
C:\stable-diffusion-webui\outputs/img2img-images\Deforum_20230525050811\20230525050811.mp4
Stitching *video*...
Video stitching done in 0.19 seconds!