deforum-art / sd-webui-deforum

Deforum extension for AUTOMATIC1111's Stable Diffusion webui
https://deforum.github.io
Other
2.71k stars 390 forks source link

[Bug]: #478

Closed NthKevkas closed 1 year ago

NthKevkas commented 1 year ago

Have you read the latest version of the FAQ?

Is there an existing issue for this?

Are you using the latest version of the Deforum extension?

What happened?

There is a bug with video inputs using control net that does not actually update the settings file. I would upload my webm file and then save settings and try to run but was met with " cnet.update_cn_script_in_processing(p, cn_units, is_img2img=is_img2img, is_ui=False) TypeError: update_cn_script_in_processing() got an unexpected keyword argument 'is_img2img' "

Steps to reproduce the problem

  1. Go to Deforum
  2. Go to Controlnet in the deforum tab
  3. Drag a Webm into controlnet
  4. Set and configure preprocessor
  5. Save and apply settings
  6. Hit Generate

What should have happened?

It should have set the filepath for my local file to use controlnet with deforum

WebUI and Deforum extension Commit IDs

webui commit id - e11df39b (Thu Mar 16 11:55:27 2023) deforum exten commit id - d5b833f1 (Thu Mar 16 12:08:23 2023)

On which platform are you launching the webui with the extension?

No response

Deforum settings

{ "W": 910, "H": 512, "tiling": false, "restore_faces": true, "seed": 314366174, "sampler": "DPM++ 2M Karras", "seed_resize_from_w": 0, "seed_resize_from_h": 0, "steps": 39, "ddim_eta": 0.0, "save_settings": true, "save_sample_per_step": false, "batch_name": "DeforumAnimeTest", "seed_behavior": "fixed", "seed_iter_N": 1, "use_init": false, "strength_0_no_init": true, "strength": 0.0, "init_image": null, "use_mask": false, "use_alpha_as_mask": false, "invert_mask": false, "overlay_mask": false, "mask_file": "https://deforum.github.io/a1/M1.jpg", "mask_contrast_adjust": 1.0, "mask_brightness_adjust": 1.0, "mask_overlay_blur": 4, "fill": 1, "full_res_mask": false, "full_res_mask_padding": 4, "reroll_blank_frames": "reroll", "precision": "autocast", "timestring": "20230316155201", "outdir": "C:\ai\stable-diffusion-webui\outputs/img2img-images\DeforumAnimeTest", "prompts": { "0": "(Masterpiece), ((Digital art)), (Illustration), ((cel-shaded)), (((anime art))), 90's anime style, final fantasy vii, Genshin Impact, ((vibrant coloring)), of an adult anime fox girl as a cyberpunk, (((solo))), ((1girl)), (((single subject))), she is heavily tattoed, wearing a ((torn latex bodysuit)), ((torn bikesuit)), with a ((boob window)), (lowered_zipper), (center opening, cleavage cutout, plunging neckline). She is (((riding a motorcycle))), ((sitting on motorcycle)), (((wide shot))) of the city passing behind her, She is posed in the glowing cityscape of Neo-Seattle, (((outdoor urban environment))), outdoors at ((night)), with ((rain)) in the background. 8k UHD, (high contrast), studio quality, (ray-traced lighting), highres. Drawn in the style of ((((anime \(style\)))), full color, final fantasy vii remake, anime coloring, Nanten Yutaka, park sung woo, Hirano Kouta, Tsunako, Sarachi Yomi, Nightow Yasuhiro, Hihei Tsutomu, Okamoto Lynn, Shirow Masamune, Yabuki Kentarou, Shono Kotaro, Tatsu Yukinobu, Sadamoto Yoshiyuki, Kim Kwang Hyun, Sumita Kazasa, Tsuda Mikiyo, Kondou Kazuma, Ayakawa Riku, Satou Shouji, Komi Shinya, LINDA, Jun, Shirabi, Mizuryu Kei, Z-ton, Bibi, Kawamori Shouji, Kusunoki Rin, Yoshioka Sakaki, Mashima Azusa, ShindoL, Asanagi, Kuro, Kagami, Uo Denim, Meru, Machiking, Aaron Schmit, Moistchi, Fueta Kishi, Hiroyuki Tamakoshi, Houtengeki, Kwang-Hyun Kim, Mizuryu Kei, Sasamori Tomoe, Shouji Sato, Shun “Tosh” Saeki, Tomohiro Kai), pinup \(style\), NSFW, hentai, DeviantArt, trending on pixiv, boudoir, [[[colorful]]], streetlevel view, fine art, [[Vivid colors]] tiny cute swamp bunny, highly detailed, intricate, ultra hd, sharp photo, crepuscular rays, in focus, by tomasz alen kopera --neg (((((out of frame))))), (((deformed))), (((grayscale))), ((((((loli)))))), (((child))), manga, ((text)), ((kanji)), (((blurry))), ((((watermark)))), ((((ugly)))), (((duplicate))), ((morbid)), ((mutilated)), out of frame, extra fingers, mutated hands, ((poorly drawn hands)), ((poorly drawn face)), (((mutation))), (((deformed))), ((ugly)), blurry, ((bad anatomy)), (((bad proportions))), ((extra limbs)), cloned face, (((disfigured))), ugly, extra limbs, (bad anatomy), gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), ((censored)), ((fused_crotch)), ((2girls))", "30": "(Masterpiece), ((Digital art)), (Illustration), ((cel-shaded)), (((anime art))), 90's anime style, final fantasy vii, Genshin Impact, ((vibrant coloring)), of an adult anime fox girl as a cyberpunk, (((solo))), ((1girl)), (((single subject))), she is heavily tattoed, wearing a ((torn latex bodysuit)), ((torn bikesuit)), with a ((boob window)), (lowered_zipper), (center opening, cleavage cutout, plunging neckline). She is (((riding a motorcycle))), ((sitting on motorcycle)), (((wide shot))) of the city passing behind her, She is posed in the glowing cityscape of Neo-Seattle, (((outdoor urban environment))), outdoors at ((night)), with ((rain)) in the background. 8k UHD, (high contrast), studio quality, (ray-traced lighting), highres. Drawn in the style of ((((anime \(style\)))), full color, final fantasy vii remake, anime coloring, Nanten Yutaka, park sung woo, Hirano Kouta, Tsunako, Sarachi Yomi, Nightow Yasuhiro, Hihei Tsutomu, Okamoto Lynn, Shirow Masamune, Yabuki Kentarou, Shono Kotaro, Tatsu Yukinobu, Sadamoto Yoshiyuki, Kim Kwang Hyun, Sumita Kazasa, Tsuda Mikiyo, Kondou Kazuma, Ayakawa Riku, Satou Shouji, Komi Shinya, LINDA, Jun, Shirabi, Mizuryu Kei, Z-ton, Bibi, Kawamori Shouji, Kusunoki Rin, Yoshioka Sakaki, Mashima Azusa, ShindoL, Asanagi, Kuro, Kagami, Uo Denim, Meru, Machiking, Aaron Schmit, Moistchi, Fueta Kishi, Hiroyuki Tamakoshi, Houtengeki, Kwang-Hyun Kim, Mizuryu Kei, Sasamori Tomoe, Shouji Sato, Shun “Tosh” Saeki, Tomohiro Kai), pinup \(style\), NSFW, hentai, DeviantArt, trending on pixiv, boudoir, [[[colorful]]], streetlevel view, fine art, [[Vivid colors]] anthropomorphic clean cat, surrounded by fractals, epic angle and pose, symmetrical, 3d, depth of field, ruan jia and fenghua zhong --neg (((((out of frame))))), (((deformed))), (((grayscale))), ((((((loli)))))), (((child))), manga, ((text)), ((kanji)), (((blurry))), ((((watermark)))), ((((ugly)))), (((duplicate))), ((morbid)), ((mutilated)), out of frame, extra fingers, mutated hands, ((poorly drawn hands)), ((poorly drawn face)), (((mutation))), (((deformed))), ((ugly)), blurry, ((bad anatomy)), (((bad proportions))), ((extra limbs)), cloned face, (((disfigured))), ugly, extra limbs, (bad anatomy), gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), ((censored)), ((fused_crotch)), ((2girls))", "60": "(Masterpiece), ((Digital art)), (Illustration), ((cel-shaded)), (((anime art))), 90's anime style, final fantasy vii, Genshin Impact, ((vibrant coloring)), of an adult anime fox girl as a cyberpunk, (((solo))), ((1girl)), (((single subject))), she is heavily tattoed, wearing a ((torn latex bodysuit)), ((torn bikesuit)), with a ((boob window)), (lowered_zipper), (center opening, cleavage cutout, plunging neckline). She is (((riding a motorcycle))), ((sitting on motorcycle)), (((wide shot))) of the city passing behind her, She is posed in the glowing cityscape of Neo-Seattle, (((outdoor urban environment))), outdoors at ((night)), with ((rain)) in the background. 8k UHD, (high contrast), studio quality, (ray-traced lighting), highres. Drawn in the style of ((((anime \(style\)))), full color, final fantasy vii remake, anime coloring, Nanten Yutaka, park sung woo, Hirano Kouta, Tsunako, Sarachi Yomi, Nightow Yasuhiro, Hihei Tsutomu, Okamoto Lynn, Shirow Masamune, Yabuki Kentarou, Shono Kotaro, Tatsu Yukinobu, Sadamoto Yoshiyuki, Kim Kwang Hyun, Sumita Kazasa, Tsuda Mikiyo, Kondou Kazuma, Ayakawa Riku, Satou Shouji, Komi Shinya, LINDA, Jun, Shirabi, Mizuryu Kei, Z-ton, Bibi, Kawamori Shouji, Kusunoki Rin, Yoshioka Sakaki, Mashima Azusa, ShindoL, Asanagi, Kuro, Kagami, Uo Denim, Meru, Machiking, Aaron Schmit, Moistchi, Fueta Kishi, Hiroyuki Tamakoshi, Houtengeki, Kwang-Hyun Kim, Mizuryu Kei, Sasamori Tomoe, Shouji Sato, Shun “Tosh” Saeki, Tomohiro Kai), pinup \(style\), NSFW, hentai, DeviantArt, trending on pixiv, boudoir, [[[colorful]]], streetlevel view, fine art, [[Vivid colors]] a beautiful coconut --neg photo, realistic (((((out of frame))))), (((deformed))), (((grayscale))), ((((((loli)))))), (((child))), manga, ((text)), ((kanji)), (((blurry))), ((((watermark)))), ((((ugly)))), (((duplicate))), ((morbid)), ((mutilated)), out of frame, extra fingers, mutated hands, ((poorly drawn hands)), ((poorly drawn face)), (((mutation))), (((deformed))), ((ugly)), blurry, ((bad anatomy)), (((bad proportions))), ((extra limbs)), cloned face, (((disfigured))), ugly, extra limbs, (bad anatomy), gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), ((censored)), ((fused_crotch)), ((2girls))", "90": "(Masterpiece), ((Digital art)), (Illustration), ((cel-shaded)), (((anime art))), 90's anime style, final fantasy vii, Genshin Impact, ((vibrant coloring)), of an adult anime fox girl as a cyberpunk, (((solo))), ((1girl)), (((single subject))), she is heavily tattoed, wearing a ((torn latex bodysuit)), ((torn bikesuit)), with a ((boob window)), (lowered_zipper), (center opening, cleavage cutout, plunging neckline). She is (((riding a motorcycle))), ((sitting on motorcycle)), (((wide shot))) of the city passing behind her, She is posed in the glowing cityscape of Neo-Seattle, (((outdoor urban environment))), outdoors at ((night)), with ((rain)) in the background. 8k UHD, (high contrast), studio quality, (ray-traced lighting), highres. Drawn in the style of ((((anime \(style\)))), full color, final fantasy vii remake, anime coloring, Nanten Yutaka, park sung woo, Hirano Kouta, Tsunako, Sarachi Yomi, Nightow Yasuhiro, Hihei Tsutomu, Okamoto Lynn, Shirow Masamune, Yabuki Kentarou, Shono Kotaro, Tatsu Yukinobu, Sadamoto Yoshiyuki, Kim Kwang Hyun, Sumita Kazasa, Tsuda Mikiyo, Kondou Kazuma, Ayakawa Riku, Satou Shouji, Komi Shinya, LINDA, Jun, Shirabi, Mizuryu Kei, Z-ton, Bibi, Kawamori Shouji, Kusunoki Rin, Yoshioka Sakaki, Mashima Azusa, ShindoL, Asanagi, Kuro, Kagami, Uo Denim, Meru, Machiking, Aaron Schmit, Moistchi, Fueta Kishi, Hiroyuki Tamakoshi, Houtengeki, Kwang-Hyun Kim, Mizuryu Kei, Sasamori Tomoe, Shouji Sato, Shun “Tosh” Saeki, Tomohiro Kai), pinup \(style\), NSFW, hentai, DeviantArt, trending on pixiv, boudoir, [[[colorful]]], streetlevel view, fine art, [[Vivid colors]] a beautiful durian, trending on Artstation --neg (((((out of frame))))), (((deformed))), (((grayscale))), ((((((loli)))))), (((child))), manga, ((text)), ((kanji)), (((blurry))), ((((watermark)))), ((((ugly)))), (((duplicate))), ((morbid)), ((mutilated)), out of frame, extra fingers, mutated hands, ((poorly drawn hands)), ((poorly drawn face)), (((mutation))), (((deformed))), ((ugly)), blurry, ((bad anatomy)), (((bad proportions))), ((extra limbs)), cloned face, (((disfigured))), ugly, extra limbs, (bad anatomy), gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), ((censored)), ((fused_crotch)), ((2girls))" }, "positive_prompts": "(Masterpiece), ((Digital art)), (Illustration), ((cel-shaded)), (((anime art))), 90's anime style, final fantasy vii, Genshin Impact, ((vibrant coloring)), of an adult anime fox girl as a cyberpunk, (((solo))), ((1girl)), (((single subject))), she is heavily tattoed, wearing a ((torn latex bodysuit)), ((torn bikesuit)), with a ((boob window)), (lowered_zipper), (center opening, cleavage cutout, plunging neckline). She is (((riding a motorcycle))), ((sitting on motorcycle)), (((wide shot))) of the city passing behind her, She is posed in the glowing cityscape of Neo-Seattle, (((outdoor urban environment))), outdoors at ((night)), with ((rain)) in the background. 8k UHD, (high contrast), studio quality, (ray-traced lighting), highres. Drawn in the style of ((((anime \(style\)))), full color, final fantasy vii remake, anime coloring, Nanten Yutaka, park sung woo, Hirano Kouta, Tsunako, Sarachi Yomi, Nightow Yasuhiro, Hihei Tsutomu, Okamoto Lynn, Shirow Masamune, Yabuki Kentarou, Shono Kotaro, Tatsu Yukinobu, Sadamoto Yoshiyuki, Kim Kwang Hyun, Sumita Kazasa, Tsuda Mikiyo, Kondou Kazuma, Ayakawa Riku, Satou Shouji, Komi Shinya, LINDA, Jun, Shirabi, Mizuryu Kei, Z-ton, Bibi, Kawamori Shouji, Kusunoki Rin, Yoshioka Sakaki, Mashima Azusa, ShindoL, Asanagi, Kuro, Kagami, Uo Denim, Meru, Machiking, Aaron Schmit, Moistchi, Fueta Kishi, Hiroyuki Tamakoshi, Houtengeki, Kwang-Hyun Kim, Mizuryu Kei, Sasamori Tomoe, Shouji Sato, Shun “Tosh” Saeki, Tomohiro Kai), pinup \(style\), NSFW, hentai, DeviantArt, trending on pixiv, boudoir, [[[colorful]]], streetlevel view, fine art, [[Vivid colors]]", "negative_prompts": "(((((out of frame))))), (((deformed))), (((grayscale))), ((((((loli)))))), (((child))), manga, ((text)), ((kanji)), (((blurry))), ((((watermark)))), ((((ugly)))), (((duplicate))), ((morbid)), ((mutilated)), out of frame, extra fingers, mutated hands, ((poorly drawn hands)), ((poorly drawn face)), (((mutation))), (((deformed))), ((ugly)), blurry, ((bad anatomy)), (((bad proportions))), ((extra limbs)), cloned face, (((disfigured))), ugly, extra limbs, (bad anatomy), gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), ((censored)), ((fused_crotch)), ((2girls))", "animation_mode": "2D", "max_frames": 24, "border": "replicate", "angle": "0:(0)", "zoom": "0:(1.0025+0.002sin(1.253.14t/30))", "translation_x": "0:(0)", "translation_y": "0:(0)", "translation_z": "0:(1.75)", "transform_center_x": "0:(0.5)", "transform_center_y": "0:(0.5)", "rotation_3d_x": "0:(0)", "rotation_3d_y": "0:(0)", "rotation_3d_z": "0:(0)", "enable_perspective_flip": false, "perspective_flip_theta": "0:(0)", "perspective_flip_phi": "0:(0)", "perspective_flip_gamma": "0:(0)", "perspective_flip_fv": "0:(53)", "noise_schedule": "0: (0.065)", "strength_schedule": "0: (0.65)", "contrast_schedule": "0: (1.0)", "cfg_scale_schedule": "0: (7)", "pix2pix_img_cfg_scale_schedule": "0:(1.5)", "enable_subseed_scheduling": false, "subseed_schedule": "0:(1)", "subseed_strength_schedule": "0:(0)", "enable_steps_scheduling": false, "steps_schedule": "0: (25)", "fov_schedule": "0: (70)", "aspect_ratio_schedule": "0: (1)", "near_schedule": "0: (200)", "far_schedule": "0: (10000)", "seed_schedule": "0:(s), 1:(-1), \"max_f-2\":(-1), \"max_f-1\":(s)", "enable_sampler_scheduling": false, "sampler_schedule": "0: (\"Euler a\")", "mask_schedule": "0: (\"{video_mask}\")", "use_noise_mask": false, "noise_mask_schedule": "0: (\"{video_mask}\")", "enable_checkpoint_scheduling": false, "checkpoint_schedule": "0: (\"model1.ckpt\"), 100: (\"model2.ckpt\")", "enable_clipskip_scheduling": false, "clipskip_schedule": "0: (2)", "enable_noise_multiplier_scheduling": true, "noise_multiplier_schedule": "0: (1.05)", "kernel_schedule": "0: (5)", "sigma_schedule": "0: (1.0)", "amount_schedule": "0: (0.1)", "threshold_schedule": "0: (0.0)", "color_coherence": "LAB", "color_coherence_image_path": "", "color_coherence_video_every_N_frames": 1.0, "color_force_grayscale": false, "diffusion_cadence": 1, "optical_flow_cadence": false, "noise_type": "perlin", "perlin_octaves": 4, "perlin_persistence": 0.5, "use_depth_warping": true, "midas_weight": 0.2, "padding_mode": "border", "sampling_mode": "bicubic", "save_depth_maps": false, "video_init_path": "C:\Users\Josh\Downloads\U4CS.webm", "extract_nth_frame": 1, "extract_from_frame": 0, "extract_to_frame": -1, "overwrite_extracted_frames": true, "use_mask_video": false, "video_mask_path": "https://deforum.github.io/a1/VM1.mp4", "resume_from_timestring": false, "resume_timestring": "20230129210106", "hybrid_generate_inputframes": false, "hybrid_generate_human_masks": "None", "hybrid_use_first_frame_as_init_image": true, "hybrid_motion": "None", "hybrid_motion_use_prev_img": false, "hybrid_flow_method": "Farneback", "hybrid_composite": false, "hybrid_comp_mask_type": "None", "hybrid_comp_mask_inverse": false, "hybrid_comp_mask_equalize": "None", "hybrid_comp_mask_auto_contrast": false, "hybrid_comp_save_extra_frames": false, "hybrid_comp_alpha_schedule": "0:(1)", "hybrid_comp_mask_blend_alpha_schedule": "0:(0.5)", "hybrid_comp_mask_contrast_schedule": "0:(1)", "hybrid_comp_mask_auto_contrast_cutoff_high_schedule": "0:(100)", "hybrid_comp_mask_auto_contrast_cutoff_low_schedule": "0:(0)", "parseq_manifest": "", "parseq_use_deltas": true, "use_looper": false, "init_images": "{\n \"0\": \"https://deforum.github.io/a1/Gi1.png\",\n \"max_f/4-5\": \"https://deforum.github.io/a1/Gi2.png\",\n \"max_f/2-10\": \"https://deforum.github.io/a1/Gi3.png\",\n \"3max_f/4-15\": \"https://deforum.github.io/a1/Gi4.jpg\",\n \"max_f-20\": \"https://deforum.github.io/a1/Gi1.png\"\n}", "image_strength_schedule": "0:(0.75)", "blendFactorMax": "0:(0.35)", "blendFactorSlope": "0:(0.25)", "tweening_frames_schedule": "0:(20)", "color_correction_factor": "0:(0.075)", "controlnet_overwrite_frames": false, "controlnet_vid_path": "C:\Users\Josh\Downloads\U4CS.webm", "controlnet_mask_vid_path": "", "controlnet_enabled": true, "controlnet_guess_mode": true, "controlnet_invert_image": false, "controlnet_rgbbgr_mode": false, "controlnet_lowvram": true, "controlnet_module": "depth", "controlnet_model": "control_sd15_depth [fef5e48e]", "controlnet_weight": 1, "controlnet_guidance_start": 0, "controlnet_guidance_end": 1, "controlnet_processor_res": 384, "controlnet_threshold_a": 64, "controlnet_threshold_b": 64, "controlnet_resize_mode": "Just Resize", "skip_video_creation": false, "fps": 24, "make_gif": true, "delete_imgs": false, "ffmpeg_location": "C:\ai\stable-diffusion-webui\venv\lib\site-packages\imageio_ffmpeg\binaries\ffmpeg-win64-v4.2.2.exe", "ffmpeg_crf": "17", "ffmpeg_preset": "slow", "add_soundtrack": "None", "soundtrack_path": "https://deforum.github.io/a1/A1.mp3", "r_upscale_video": false, "r_upscale_model": "realesrgan-x4plus-anime", "r_upscale_factor": "x4", "r_upscale_keep_imgs": true, "store_frames_in_ram": false, "frame_interpolation_engine": "None", "frame_interpolation_x_amount": 2, "frame_interpolation_slow_mo_enabled": false, "frame_interpolation_slow_mo_amount": 2, "frame_interpolation_keep_imgs": false, "deforum_git_commit_id": "d5b833f1 (Thu Mar 16 12:08:23 2023)" }

Webui core settings

{ "samples_save": true, "samples_format": "png", "samples_filename_pattern": "", "save_images_add_number": true, "grid_save": true, "grid_format": "png", "grid_extended_filename": false, "grid_only_if_multiple": true, "grid_prevent_empty_spots": true, "n_rows": -1, "enable_pnginfo": false, "save_txt": true, "save_images_before_face_restoration": true, "save_images_before_highres_fix": true, "save_images_before_color_correction": true, "jpeg_quality": 80, "export_for_4chan": true, "img_downscale_threshold": 4.0, "target_side_length": 4000, "use_original_name_batch": true, "use_upscaler_name_as_suffix": true, "save_selected_only": true, "do_not_add_watermark": true, "temp_dir": "", "clean_temp_dir_at_start": false, "outdir_samples": "", "outdir_txt2img_samples": "outputs/txt2img-images", "outdir_img2img_samples": "outputs/img2img-images", "outdir_extras_samples": "outputs/extras-images", "outdir_grids": "", "outdir_txt2img_grids": "outputs/txt2img-grids", "outdir_img2img_grids": "outputs/img2img-grids", "outdir_save": "log/images", "save_to_dirs": true, "grid_save_to_dirs": true, "use_save_to_dirs_for_ui": false, "directories_filename_pattern": "[date]", "directories_max_prompt_words": 8, "ESRGAN_tile": 512, "ESRGAN_tile_overlap": 32, "realesrgan_enabled_models": [ "R-ESRGAN 4x+", "R-ESRGAN 4x+ Anime6B", "R-ESRGAN General 4xV3", "R-ESRGAN General WDN 4xV3", "R-ESRGAN AnimeVideo" ], "upscaler_for_img2img": null, "face_restoration_model": "GFPGAN", "code_former_weight": 0.3, "face_restoration_unload": true, "show_warnings": true, "memmon_poll_rate": 8, "samples_log_stdout": false, "multiple_tqdm": true, "print_hypernet_extra": false, "unload_models_when_training": false, "pin_memory": false, "save_optimizer_state": false, "save_training_settings_to_txt": true, "dataset_filename_word_regex": "", "dataset_filename_join_string": " ", "training_image_repeats_per_epoch": 1, "training_write_csv_every": 500, "training_xattention_optimizations": true, "training_enable_tensorboard": false, "training_tensorboard_save_images": false, "training_tensorboard_flush_every": 120, "sd_model_checkpoint": "HD-19.Any-V4.ckpt [e27b4e4e48]", "sd_checkpoint_cache": 0, "sd_vae_checkpoint_cache": 0, "sd_vae": "Automatic", "sd_vae_as_default": true, "inpainting_mask_weight": 1.0, "initial_noise_multiplier": 1.0, "img2img_color_correction": false, "img2img_fix_steps": false, "img2img_background_color": "#ffffff", "enable_quantization": false, "enable_emphasis": true, "enable_batch_seeds": true, "comma_padding_backtrack": 20, "CLIP_stop_at_last_layers": 1, "upcast_attn": true, "use_old_emphasis_implementation": false, "use_old_karras_scheduler_sigmas": false, "no_dpmpp_sde_batch_determinism": true, "use_old_hires_fix_width_height": false, "interrogate_keep_models_in_memory": false, "interrogate_return_ranks": false, "interrogate_clip_num_beams": 1, "interrogate_clip_min_length": 24, "interrogate_clip_max_length": 48, "interrogate_clip_dict_limit": 1500, "interrogate_clip_skip_categories": [], "interrogate_deepbooru_score_threshold": 0.5, "deepbooru_sort_alpha": true, "deepbooru_use_spaces": true, "deepbooru_escape": true, "deepbooru_filter_tags": "", "extra_networks_default_view": "cards", "extra_networks_default_multiplier": 1.0, "sd_hypernetwork": "None", "return_grid": true, "do_not_show_images": false, "add_model_hash_to_info": true, "add_model_name_to_info": true, "disable_weights_auto_swap": true, "send_seed": true, "send_size": true, "font": "", "js_modal_lightbox": true, "js_modal_lightbox_initially_zoomed": true, "show_progress_in_title": true, "samplers_in_dropdown": true, "dimensions_and_batch_together": true, "keyedit_precision_attention": 0.1, "keyedit_precision_extra": 0.05, "quicksettings": "sd_model_checkpoint", "ui_reorder": "inpaint, sampler, checkboxes, hires_fix, dimensions, cfg, seed, batch, override_settings, scripts", "ui_extra_networks_tab_reorder": "", "localization": "None", "show_progressbar": true, "live_previews_enable": true, "show_progress_grid": true, "show_progress_every_n_steps": -1, "show_progress_type": "Full", "live_preview_content": "Combined", "live_preview_refresh_period": 1000, "hide_samplers": [ "Euler a", "Euler" ], "eta_ddim": 0.0, "eta_ancestral": 1.0, "ddim_discretize": "uniform", "s_churn": 0.0, "s_tmin": 0.0, "s_noise": 1.0, "eta_noise_seed_delta": 0, "always_discard_next_to_last_sigma": false, "postprocessing_enable_in_main_ui": [ "GFPGAN", "Upscale", "CodeFormer" ], "postprocessing_operation_order": [ "Upscale", "CodeFormer", "GFPGAN" ], "upscaling_max_images_in_cache": 2, "disabled_extensions": [], "sd_checkpoint_hash": "e27b4e4e4896bcf69e86907758fd0e0e9f3eae34afd9e273f5666641e633e862", "ldsr_steps": 100, "ldsr_cached": false, "SWIN_tile": 192, "SWIN_tile_overlap": 8, "sd_lora": "None", "lora_apply_to_outputs": false, "tac_tagFile": "danbooru.csv", "tac_active": true, "tac_activeIn.txt2img": true, "tac_activeIn.img2img": true, "tac_activeIn.negativePrompts": true, "tac_activeIn.thirdParty": true, "tac_activeIn.modelList": "", "tac_activeIn.modelListMode": "Blacklist", "tac_slidingPopup": true, "tac_maxResults": 5.0, "tac_showAllResults": false, "tac_resultStepLength": 100.0, "tac_delayTime": 100.0, "tac_useWildcards": true, "tac_useEmbeddings": true, "tac_useHypernetworks": true, "tac_useLoras": true, "tac_showWikiLinks": true, "tac_replaceUnderscores": true, "tac_escapeParentheses": true, "tac_appendComma": true, "tac_alias.searchByAlias": true, "tac_alias.onlyShowAlias": false, "tac_translation.translationFile": "None", "tac_translation.oldFormat": false, "tac_translation.searchByTranslation": true, "tac_extra.extraFile": "extra-quality-tags.csv", "tac_extra.addMode": "Insert before", "animatoranon_film_folder": "C:/AI/frame_interpolation/film.bat", "animatoranon_prop_folder": "c:/ai/props", "animatoranon_output_folder": "C:\ai\stable-diffusion-webui\outputs\animation", "control_net_model_config": "models\cldm_v15.yaml", "control_net_model_adapter_config": "models\sketch_adapter_v14.yaml", "control_net_detectedmap_dir": "detected_maps", "control_net_models_path": "", "control_net_max_models_num": 4, "control_net_model_cache_size": 1, "control_net_control_transfer": false, "control_net_no_detectmap": false, "control_net_detectmap_autosaving": false, "control_net_only_midctrl_hires": true, "control_net_allow_script_control": true, "control_net_skip_img2img_processing": false, "control_net_monocular_depth_optim": true, "control_net_only_mid_control": false, "control_net_cfg_based_guidance": false, "ctp_flavor": "mocha", "accent_color": "lavender", "webp_lossless": false, "extra_networks_add_text_separator": " ", "uni_pc_variant": "bh1", "uni_pc_skip_type": "time_uniform", "uni_pc_order": 3, "uni_pc_lower_order_final": true, "image_browser_active_tabs": "txt2img, img2img, txt2img-grids, img2img-grids, Extras, Favorites, Others, Maintenance", "image_browser_hidden_components": [], "image_browser_with_subdirs": true, "image_browser_preload": false, "image_browser_copy_image": false, "image_browser_delete_message": true, "image_browser_txt_files": true, "image_browser_logger_warning": false, "image_browser_logger_debug": false, "image_browser_delete_recycle": false, "image_browser_scan_exif": true, "image_browser_mod_shift": false, "image_browser_mod_ctrl_shift": false, "image_browser_enable_maint": true, "image_browser_ranking_pnginfo": false, "image_browser_page_columns": 6.0, "image_browser_page_rows": 6.0, "image_browser_pages_perload": 20.0, "training_picker_fixed_size": 512.0, "training_picker_videos_path": "C:\ai\stable-diffusion-webui\training-picker\videos", "training_picker_framesets_path": "C:\ai\stable-diffusion-webui\training-picker\extracted-frames", "training_picker_default_output_path": "C:\ai\stable-diffusion-webui\training-picker\cropped-frames", "dp_ignore_whitespace": false, "dp_write_raw_template": false, "dp_write_prompts_to_file": false, "dp_parser_variant_start": "{", "dp_parser_variant_end": "}", "dp_parser_wildcard_wrap": "__", "dp_limit_jinja_prompts": false, "img_max_size_mp": 200.0, "hidden_tabs": [] }

Console logs

Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Startup time: 43.6s (import gradio: 1.8s, import ldm: 1.3s, other imports: 2.2s, list extensions: 2.5s, setup codeformer: 0.2s, load scripts: 1.8s, load SD checkpoint: 14.9s, create ui: 18.4s, gradio launch: 0.3s).
reading custom settings from deforum_settings1.txt
Deforum extension for auto1111 webui, v2.3b
Git commit: d5b833f1 (Thu Mar 16 12:08:23 2023)
Unpacking ControlNet base video
Exporting Video Frames (1 every 1) frames to C:\ai\stable-diffusion-webui\outputs/img2img-images\DeforumAnimeTest\controlnet_inputframes...
Trying to extract frames from video with input FPS of 12.5. Please wait patiently.
Successfully extracted 9 frames from video.
Loading 24 input frames from C:\ai\stable-diffusion-webui\outputs/img2img-images\DeforumAnimeTest\controlnet_inputframes and saving video frames to C:\ai\stable-diffusion-webui\outputs/img2img-images\DeforumAnimeTest
ControlNet base video unpacked!
Saving animation frames to:
C:\ai\stable-diffusion-webui\outputs/img2img-images\DeforumAnimeTest
Animation frame: 0/24
Seed: 314366174
Prompt: (Masterpiece), ((Digital art)), (Illustration), ((cel-shaded)), (((anime art))), 90's anime style, final fantasy vii, Genshin Impact, ((vibrant coloring)), of an adult anime fox girl as a cyberpunk, (((solo))), ((1girl)), (((single subject))), she is heavily tattoed, wearing a ((torn latex bodysuit)), ((torn bikesuit)), with a ((boob window)), (lowered_zipper), (center opening, cleavage cutout, plunging neckline). She is (((riding a motorcycle))), ((sitting on motorcycle)), (((wide shot))) of the city passing behind her, She is posed in the glowing cityscape of Neo-Seattle, (((outdoor urban environment))), outdoors at ((night)), with ((rain)) in the background. 8k UHD, (high contrast), studio quality, (ray-traced lighting), highres. Drawn in the style of ((((anime \(style\)))), full color, final fantasy vii remake, anime coloring, Nanten Yutaka, park sung woo, Hirano Kouta, Tsunako, Sarachi Yomi, Nightow Yasuhiro, Hihei Tsutomu, Okamoto Lynn, Shirow Masamune, Yabuki Kentarou, Shono Kotaro, Tatsu Yukinobu, Sadamoto Yoshiyuki, Kim Kwang Hyun, Sumita Kazasa, Tsuda Mikiyo, Kondou Kazuma, Ayakawa Riku, Satou Shouji, Komi Shinya, LINDA, Jun, Shirabi, Mizuryu Kei, Z-ton, Bibi, Kawamori Shouji, Kusunoki Rin, Yoshioka Sakaki, Mashima Azusa, ShindoL, Asanagi, Kuro, Kagami, Uo Denim, Meru, Machiking, Aaron Schmit, Moistchi, Fueta Kishi, Hiroyuki Tamakoshi, Houtengeki, Kwang-Hyun Kim, Mizuryu Kei, Sasamori Tomoe, Shouji Sato, Shun “Tosh” Saeki, Tomohiro Kai), pinup \(style\),  NSFW, hentai, DeviantArt, trending on pixiv, boudoir, [[[colorful]]], streetlevel view, fine art, [[Vivid colors]] tiny cute swamp bunny, highly detailed, intricate, ultra hd, sharp photo, crepuscular rays, in focus, by tomasz alen kopera
Neg Prompt: (((((out of frame))))), (((deformed))), (((grayscale))), ((((((loli)))))), (((child))), manga, ((text)), ((kanji)), (((blurry))), ((((watermark)))),  ((((ugly)))), (((duplicate))), ((morbid)), ((mutilated)), out of frame, extra fingers, mutated hands, ((poorly drawn hands)), ((poorly drawn face)), (((mutation))), (((deformed))), ((ugly)), blurry, ((bad anatomy)), (((bad proportions))), ((extra limbs)), cloned face, (((disfigured))), ugly, extra limbs, (bad anatomy), gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), ((censored)), ((fused_crotch)), ((2girls))
Not using an init image (doing pure txt2img)
╭─────┬───┬───────┬─────┬──────┬────┬────╮
│Steps│CFG│Denoise│Angle│ Zoom │Tr X│Tr Y│
├─────┼───┼───────┼─────┼──────┼────┼────┤
│ 25  │7.0│ None  │  0  │1.0025│ 0  │ 0  │
╰─────┴───┴───────┴─────┴──────┴────┴────╯
Reading ControlNet base frame 1 at C:\ai\stable-diffusion-webui\outputs/img2img-images\DeforumAnimeTest\controlnet_inputframes\000000001.jpg
Reading ControlNet mask frame 1 at C:\ai\stable-diffusion-webui\outputs/img2img-images\DeforumAnimeTest\controlnet_maskframes\000000001.jpg
                                          ControlNet params
╭──────┬───────────┬──────┬─────┬───────────┬─────────┬─────┬───────────┬───────┬────────┬─────┬─────╮
│module│   model   │weight│ inv │guide_start│guide_end│guess│  resize   │rgb_bgr│proc res│thr a│thr b│
├──────┼───────────┼──────┼─────┼───────────┼─────────┼─────┼───────────┼───────┼────────┼─────┼─────┤
│depth │sd15_depth │  1   │False│     0     │    1    │True │Just Resize│ False │  384   │ 64  │ 64  │
╰──────┴───────────┴──────┴─────┴───────────┴─────────┴─────┴───────────┴───────┴────────┴─────┴─────╯
Error completing request
Arguments: ('task(w8kqdrpsjlftefz)', None, False, '', '2D', 24, 'replicate', '0:(0)', '0:(1.0025+0.002*sin(1.25*3.14*t/30))', '0:(0)', '0:(0)', '0:(1.75)', '0:(0.5)', '0:(0.5)', '0:(0)', '0:(0)', '0:(0)', False, '0:(0)', '0:(0)', '0:(0)', '0:(53)', '0: (0.065)', '0: (0.65)', '0: (1.0)', '0: (7)', '0:(1.5)', False, '0:(1)', '0:(0)', False, '0: (25)', '0: (70)', '0: (1)', '0: (200)', '0: (10000)', '0:(s), 1:(-1), "max_f-2":(-1), "max_f-1":(s)', False, '0: ("Euler a")', '0: ("{video_mask}")', False, '0: ("{video_mask}")', False, '0: ("model1.ckpt"), 100: ("model2.ckpt")', False, '0: (2)', True, '0: (1.05)', '0: (5)', '0: (1.0)', '0: (0.1)', '0: (0.0)', 'LAB', '', 1.0, False, '2', False, 'perlin', 8, 8, 4, 0.5, True, 0.2, 'border', 'bicubic', False, 'C:\\Users\\Josh\\Downloads\\U4CS.webm', 1, 0, -1, True, False, 'https://deforum.github.io/a1/VM1.mp4', False, '20230129210106', '{\n    "0": "tiny cute swamp bunny, highly detailed, intricate, ultra hd, sharp photo, crepuscular rays, in focus, by tomasz alen kopera",\n    "30": "anthropomorphic clean cat, surrounded by fractals, epic angle and pose, symmetrical, 3d, depth of field, ruan jia and fenghua zhong",\n    "60": "a beautiful coconut --neg photo, realistic",\n    "90": "a beautiful durian, trending on Artstation"\n}', "(Masterpiece), ((Digital art)), (Illustration), ((cel-shaded)), (((anime art))), 90's anime style, final fantasy vii, Genshin Impact, ((vibrant coloring)), of an adult anime fox girl as a cyberpunk, (((solo))), ((1girl)), (((single subject))), she is heavily tattoed, wearing a ((torn latex bodysuit)), ((torn bikesuit)), with a ((boob window)), (lowered_zipper), (center opening, cleavage cutout, plunging neckline). She is (((riding a motorcycle))), ((sitting on motorcycle)), (((wide shot))) of the city passing behind her, She is posed in the glowing cityscape of Neo-Seattle, (((outdoor urban environment))), outdoors at ((night)), with ((rain)) in the background. 8k UHD, (high contrast), studio quality, (ray-traced lighting), highres. Drawn in the style of ((((anime \\(style\\)))), full color, final fantasy vii remake, anime coloring, Nanten Yutaka, park sung woo, Hirano Kouta, Tsunako, Sarachi Yomi, Nightow Yasuhiro, Hihei Tsutomu, Okamoto Lynn, Shirow Masamune, Yabuki Kentarou, Shono Kotaro, Tatsu Yukinobu, Sadamoto Yoshiyuki, Kim Kwang Hyun, Sumita Kazasa, Tsuda Mikiyo, Kondou Kazuma, Ayakawa Riku, Satou Shouji, Komi Shinya, LINDA, Jun, Shirabi, Mizuryu Kei, Z-ton, Bibi, Kawamori Shouji, Kusunoki Rin, Yoshioka Sakaki, Mashima Azusa, ShindoL, Asanagi, Kuro, Kagami, Uo Denim, Meru, Machiking, Aaron Schmit, Moistchi, Fueta Kishi, Hiroyuki Tamakoshi, Houtengeki, Kwang-Hyun Kim, Mizuryu Kei, Sasamori Tomoe, Shouji Sato, Shun “Tosh” Saeki, Tomohiro Kai), pinup \\(style\\),  NSFW, hentai, DeviantArt, trending on pixiv, boudoir, [[[colorful]]], streetlevel view, fine art, [[Vivid colors]]", '(((((out of frame))))), (((deformed))), (((grayscale))), ((((((loli)))))), (((child))), manga, ((text)), ((kanji)), (((blurry))), ((((watermark)))),  ((((ugly)))), (((duplicate))), ((morbid)), ((mutilated)), out of frame, extra fingers, mutated hands, ((poorly drawn hands)), ((poorly drawn face)), (((mutation))), (((deformed))), ((ugly)), blurry, ((bad anatomy)), (((bad proportions))), ((extra limbs)), cloned face, (((disfigured))), ugly, extra limbs, (bad anatomy), gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), ((censored)), ((fused_crotch)), ((2girls))', 910, 512, False, True, 314366174, 'DPM++ 2M Karras', False, 0, 0, 25, 0.0, 1, True, True, False, False, False, 'DeforumAnimeTest', '{timestring}_{index}_{prompt}.png', 'fixed', 1, False, False, True, 0, '', False, False, False, False, 'https://deforum.github.io/a1/M1.jpg', 1.0, 1.0, 4, 1, True, 4, 'reroll', False, 24, True, False, 'FFMPEG mp4', 'C:\\ai\\stable-diffusion-webui\\venv\\lib\\site-packages\\imageio_ffmpeg\\binaries\\ffmpeg-win64-v4.2.2.exe', '17', 'slow', 'None', 'https://deforum.github.io/a1/A1.mp3', False, 'realesrgan-x4plus-anime', 'x4', True, False, 'x0_pred', 'C:/SD/20230124234916_%09d.png', 'testvidmanualsettings.mp4', False, 'None', 2, False, 2, False, '', True, False, 'None', True, 'None', False, 'Farneback', False, 'None', False, 'None', False, False, '0:(1)', '0:(0.5)', '0:(1)', '0:(100)', '0:(0)', False, '{\n    "0": "https://deforum.github.io/a1/Gi1.png",\n    "max_f/4-5": "https://deforum.github.io/a1/Gi2.png",\n    "max_f/2-10": "https://deforum.github.io/a1/Gi3.png",\n    "3*max_f/4-15": "https://deforum.github.io/a1/Gi4.jpg",\n    "max_f-20": "https://deforum.github.io/a1/Gi1.png"\n}', '0:(0.75)', '0:(0.35)', '0:(0.25)', '0:(20)', '0:(0.075)', <tempfile._TemporaryFileWrapper object at 0x0000020B90AC6140>, None, False, '', '', True, True, False, False, True, 'depth', 'control_sd15_depth [fef5e48e]', 1, 0, 1, 384, 64, 64, 'Just Resize') {}
Traceback (most recent call last):
  File "C:\ai\stable-diffusion-webui\modules\call_queue.py", line 56, in f
    res = list(func(*args, **kwargs))
  File "C:\ai\stable-diffusion-webui\modules\call_queue.py", line 37, in f
    res = func(*args, **kwargs)
  File "C:\ai\stable-diffusion-webui\extensions\deforum-for-automatic1111-webui\scripts\deforum.py", line 85, in run_deforum
    render_animation(args, anim_args, video_args, parseq_args, loop_args, controlnet_args, root.animation_prompts, root)
  File "C:\ai\stable-diffusion-webui/extensions/deforum-for-automatic1111-webui/scripts\deforum_helpers\render.py", line 475, in render_animation
    image = generate(args, keys, anim_args, loop_args, controlnet_args, root, frame_idx, sampler_name=scheduled_sampler_name)
  File "C:\ai\stable-diffusion-webui/extensions/deforum-for-automatic1111-webui/scripts\deforum_helpers\generate.py", line 188, in generate
    process_with_controlnet(p_txt, args, anim_args, loop_args, controlnet_args, root, is_img2img=False, frame_idx=frame+1)
  File "C:\ai\stable-diffusion-webui/extensions/deforum-for-automatic1111-webui/scripts\deforum_helpers\deforum_controlnet.py", line 295, in process_with_controlnet
    cnet.update_cn_script_in_processing(p, cn_units, is_img2img=is_img2img, is_ui=False)
TypeError: update_cn_script_in_processing() got an unexpected keyword argument 'is_img2img'

got a request to *vid2depth* an existing video.
Trying to extract frames from video with input FPS of 12.5. Please wait patiently.
Successfully extracted 9 frames from video.
Vid2depth progress (it's OK if it finishes before 100%):
Loading Depth Model
Loading base model ()...Done.
Removing last two layers (global_pool & classifier).
Building Encoder-Decoder model..Done.
Vid2depth:   0%|                                                                                 | 0/9 [00:00<?, ?it/s]  resized to 517x387
  depth min:0.8584490418434143 max:2.207519292831421
Vid2depth:  11%|████████                                                                 | 1/9 [00:05<00:41,  5.23s/it]  resized to 517x387
  depth min:0.8642578125 max:2.115683078765869
Vid2depth:  22%|████████████████▏                                                        | 2/9 [00:05<00:16,  2.31s/it]  resized to 517x387
  depth min:0.895587682723999 max:2.2521748542785645
Vid2depth:  33%|████████████████████████▎                                                | 3/9 [00:05<00:08,  1.37s/it]  resized to 517x387
  depth min:0.8948915600776672 max:2.2301344871520996
Vid2depth:  44%|████████████████████████████████▍                                        | 4/9 [00:06<00:04,  1.07it/s]  resized to 517x387
  depth min:0.8886394500732422 max:2.2872533798217773
Vid2depth:  56%|████████████████████████████████████████▌                                | 5/9 [00:06<00:02,  1.45it/s]  resized to 517x387
  depth min:0.8761951923370361 max:1.9087852239608765
Vid2depth:  67%|████████████████████████████████████████████████▋                        | 6/9 [00:06<00:01,  1.84it/s]  resized to 517x387
  depth min:0.8724881410598755 max:2.1867547035217285
Vid2depth:  78%|████████████████████████████████████████████████████████▊                | 7/9 [00:06<00:00,  2.23it/s]  resized to 517x387
  depth min:0.8656319379806519 max:2.100947141647339
Vid2depth:  89%|████████████████████████████████████████████████████████████████▉        | 8/9 [00:07<00:00,  2.58it/s]  resized to 517x387
  depth min:0.8553339838981628 max:2.1206796169281006
Vid2depth: 100%|█████████████████████████████████████████████████████████████████████████| 9/9 [00:07<00:00,  1.23it/s]
*Passing depth frames to ffmpeg...*
Got a request to stitch frames to video using FFmpeg.
Frames:
C:\ai\stable-diffusion-webui\outputs\frame-depth\U4CS_2\tmp_input_frames\depth_frames_U4CS\%09d.png
To Video:
C:\ai\stable-diffusion-webui\outputs\frame-depth\U4CS_2\U4CS_depth_None.mp4
Stitching *video*...
Stitching *video*...
Error adding audio to video. Actual error: b'ffmpeg version 4.2.2 Copyright (c) 2000-2019 the FFmpeg developers\r\n  built with gcc 9.2.1 (GCC) 20200122\r\n  configuration: --enable-gpl --enable-version3 --enable-sdl2 --enable-fontconfig --enable-gnutls --enable-iconv --enable-libass --enable-libdav1d --enable-libbluray --enable-libfreetype --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libtheora --enable-libtwolame --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libzimg --enable-lzma --enable-zlib --enable-gmp --enable-libvidstab --enable-libvorbis --enable-libvo-amrwbenc --enable-libmysofa --enable-libspeex --enable-libxvid --enable-libaom --enable-libmfx --enable-amf --enable-ffnvcodec --enable-cuvid --enable-d3d11va --enable-nvenc --enable-nvdec --enable-dxva2 --enable-avisynth --enable-libopenmpt\r\n  libavutil      56. 31.100 / 56. 31.100\r\n  libavcodec     58. 54.100 / 58. 54.100\r\n  libavformat    58. 29.100 / 58. 29.100\r\n  libavdevice    58.  8.100 / 58.  8.100\r\n  libavfilter     7. 57.100 /  7. 57.100\r\n  libswscale      5.  5.100 /  5.  5.100\r\n  libswresample   3.  5.100 /  3.  5.100\r\n  libpostproc    55.  5.100 / 55.  5.100\r\nC:\\ai\\stable-diffusion-webui\\outputs\\frame-depth\\U4CS_2\\U4CS_depth_None.mp4: No such file or directory\r\n'
FFMPEG Video (sorry, no audio) stitching done in 0.12 seconds!
Deforum extension for auto1111 webui, v2.3b
Git commit: d5b833f1 (Thu Mar 16 12:08:23 2023)
Unpacking ControlNet base video
Exporting Video Frames (1 every 1) frames to C:\ai\stable-diffusion-webui\outputs/img2img-images\DeforumAnimeTest\controlnet_inputframes...
Trying to extract frames from video with input FPS of 12.5. Please wait patiently.
Successfully extracted 9 frames from video.
Loading 24 input frames from C:\ai\stable-diffusion-webui\outputs/img2img-images\DeforumAnimeTest\controlnet_inputframes and saving video frames to C:\ai\stable-diffusion-webui\outputs/img2img-images\DeforumAnimeTest
ControlNet base video unpacked!
Saving animation frames to:
C:\ai\stable-diffusion-webui\outputs/img2img-images\DeforumAnimeTest
Animation frame: 0/24
Seed: 314366174
Prompt: (Masterpiece), ((Digital art)), (Illustration), ((cel-shaded)), (((anime art))), 90's anime style, final fantasy vii, Genshin Impact, ((vibrant coloring)), of an adult anime fox girl as a cyberpunk, (((solo))), ((1girl)), (((single subject))), she is heavily tattoed, wearing a ((torn latex bodysuit)), ((torn bikesuit)), with a ((boob window)), (lowered_zipper), (center opening, cleavage cutout, plunging neckline). She is (((riding a motorcycle))), ((sitting on motorcycle)), (((wide shot))) of the city passing behind her, She is posed in the glowing cityscape of Neo-Seattle, (((outdoor urban environment))), outdoors at ((night)), with ((rain)) in the background. 8k UHD, (high contrast), studio quality, (ray-traced lighting), highres. Drawn in the style of ((((anime \(style\)))), full color, final fantasy vii remake, anime coloring, Nanten Yutaka, park sung woo, Hirano Kouta, Tsunako, Sarachi Yomi, Nightow Yasuhiro, Hihei Tsutomu, Okamoto Lynn, Shirow Masamune, Yabuki Kentarou, Shono Kotaro, Tatsu Yukinobu, Sadamoto Yoshiyuki, Kim Kwang Hyun, Sumita Kazasa, Tsuda Mikiyo, Kondou Kazuma, Ayakawa Riku, Satou Shouji, Komi Shinya, LINDA, Jun, Shirabi, Mizuryu Kei, Z-ton, Bibi, Kawamori Shouji, Kusunoki Rin, Yoshioka Sakaki, Mashima Azusa, ShindoL, Asanagi, Kuro, Kagami, Uo Denim, Meru, Machiking, Aaron Schmit, Moistchi, Fueta Kishi, Hiroyuki Tamakoshi, Houtengeki, Kwang-Hyun Kim, Mizuryu Kei, Sasamori Tomoe, Shouji Sato, Shun “Tosh” Saeki, Tomohiro Kai), pinup \(style\),  NSFW, hentai, DeviantArt, trending on pixiv, boudoir, [[[colorful]]], streetlevel view, fine art, [[Vivid colors]] tiny cute swamp bunny, highly detailed, intricate, ultra hd, sharp photo, crepuscular rays, in focus, by tomasz alen kopera
Neg Prompt: (((((out of frame))))), (((deformed))), (((grayscale))), ((((((loli)))))), (((child))), manga, ((text)), ((kanji)), (((blurry))), ((((watermark)))),  ((((ugly)))), (((duplicate))), ((morbid)), ((mutilated)), out of frame, extra fingers, mutated hands, ((poorly drawn hands)), ((poorly drawn face)), (((mutation))), (((deformed))), ((ugly)), blurry, ((bad anatomy)), (((bad proportions))), ((extra limbs)), cloned face, (((disfigured))), ugly, extra limbs, (bad anatomy), gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), ((censored)), ((fused_crotch)), ((2girls))
Not using an init image (doing pure txt2img)
╭─────┬───┬───────┬─────┬──────┬────┬────╮
│Steps│CFG│Denoise│Angle│ Zoom │Tr X│Tr Y│
├─────┼───┼───────┼─────┼──────┼────┼────┤
│ 39  │7.0│ None  │  0  │1.0025│ 0  │ 0  │
╰─────┴───┴───────┴─────┴──────┴────┴────╯
Reading ControlNet base frame 1 at C:\ai\stable-diffusion-webui\outputs/img2img-images\DeforumAnimeTest\controlnet_inputframes\000000001.jpg
Reading ControlNet mask frame 1 at C:\ai\stable-diffusion-webui\outputs/img2img-images\DeforumAnimeTest\controlnet_maskframes\000000001.jpg
                                          ControlNet params
╭──────┬───────────┬──────┬─────┬───────────┬─────────┬─────┬───────────┬───────┬────────┬─────┬─────╮
│module│   model   │weight│ inv │guide_start│guide_end│guess│  resize   │rgb_bgr│proc res│thr a│thr b│
├──────┼───────────┼──────┼─────┼───────────┼─────────┼─────┼───────────┼───────┼────────┼─────┼─────┤
│depth │sd15_depth │  1   │False│     0     │    1    │True │Just Resize│ False │  384   │ 64  │ 64  │
╰──────┴───────────┴──────┴─────┴───────────┴─────────┴─────┴───────────┴───────┴────────┴─────┴─────╯
Error completing request
Arguments: ('task(2ws0h89jplstnu5)', None, False, '', '2D', 24, 'replicate', '0:(0)', '0:(1.0025+0.002*sin(1.25*3.14*t/30))', '0:(0)', '0:(0)', '0:(1.75)', '0:(0.5)', '0:(0.5)', '0:(0)', '0:(0)', '0:(0)', False, '0:(0)', '0:(0)', '0:(0)', '0:(53)', '0: (0.065)', '0: (0.65)', '0: (1.0)', '0: (7)', '0:(1.5)', False, '0:(1)', '0:(0)', False, '0: (25)', '0: (70)', '0: (1)', '0: (200)', '0: (10000)', '0:(s), 1:(-1), "max_f-2":(-1), "max_f-1":(s)', False, '0: ("Euler a")', '0: ("{video_mask}")', False, '0: ("{video_mask}")', False, '0: ("model1.ckpt"), 100: ("model2.ckpt")', False, '0: (2)', True, '0: (1.05)', '0: (5)', '0: (1.0)', '0: (0.1)', '0: (0.0)', 'LAB', '', 1.0, False, 1, False, 'perlin', 8, 8, 4, 0.5, True, 0.2, 'border', 'bicubic', False, 'C:\\Users\\Josh\\Downloads\\U4CS.webm', 1, 0, -1, True, False, 'https://deforum.github.io/a1/VM1.mp4', False, '20230129210106', '{\n    "0": "tiny cute swamp bunny, highly detailed, intricate, ultra hd, sharp photo, crepuscular rays, in focus, by tomasz alen kopera",\n    "30": "anthropomorphic clean cat, surrounded by fractals, epic angle and pose, symmetrical, 3d, depth of field, ruan jia and fenghua zhong",\n    "60": "a beautiful coconut --neg photo, realistic",\n    "90": "a beautiful durian, trending on Artstation"\n}', "(Masterpiece), ((Digital art)), (Illustration), ((cel-shaded)), (((anime art))), 90's anime style, final fantasy vii, Genshin Impact, ((vibrant coloring)), of an adult anime fox girl as a cyberpunk, (((solo))), ((1girl)), (((single subject))), she is heavily tattoed, wearing a ((torn latex bodysuit)), ((torn bikesuit)), with a ((boob window)), (lowered_zipper), (center opening, cleavage cutout, plunging neckline). She is (((riding a motorcycle))), ((sitting on motorcycle)), (((wide shot))) of the city passing behind her, She is posed in the glowing cityscape of Neo-Seattle, (((outdoor urban environment))), outdoors at ((night)), with ((rain)) in the background. 8k UHD, (high contrast), studio quality, (ray-traced lighting), highres. Drawn in the style of ((((anime \\(style\\)))), full color, final fantasy vii remake, anime coloring, Nanten Yutaka, park sung woo, Hirano Kouta, Tsunako, Sarachi Yomi, Nightow Yasuhiro, Hihei Tsutomu, Okamoto Lynn, Shirow Masamune, Yabuki Kentarou, Shono Kotaro, Tatsu Yukinobu, Sadamoto Yoshiyuki, Kim Kwang Hyun, Sumita Kazasa, Tsuda Mikiyo, Kondou Kazuma, Ayakawa Riku, Satou Shouji, Komi Shinya, LINDA, Jun, Shirabi, Mizuryu Kei, Z-ton, Bibi, Kawamori Shouji, Kusunoki Rin, Yoshioka Sakaki, Mashima Azusa, ShindoL, Asanagi, Kuro, Kagami, Uo Denim, Meru, Machiking, Aaron Schmit, Moistchi, Fueta Kishi, Hiroyuki Tamakoshi, Houtengeki, Kwang-Hyun Kim, Mizuryu Kei, Sasamori Tomoe, Shouji Sato, Shun “Tosh” Saeki, Tomohiro Kai), pinup \\(style\\),  NSFW, hentai, DeviantArt, trending on pixiv, boudoir, [[[colorful]]], streetlevel view, fine art, [[Vivid colors]]", '(((((out of frame))))), (((deformed))), (((grayscale))), ((((((loli)))))), (((child))), manga, ((text)), ((kanji)), (((blurry))), ((((watermark)))),  ((((ugly)))), (((duplicate))), ((morbid)), ((mutilated)), out of frame, extra fingers, mutated hands, ((poorly drawn hands)), ((poorly drawn face)), (((mutation))), (((deformed))), ((ugly)), blurry, ((bad anatomy)), (((bad proportions))), ((extra limbs)), cloned face, (((disfigured))), ugly, extra limbs, (bad anatomy), gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), ((censored)), ((fused_crotch)), ((2girls))', 910, 512, False, True, 314366174, 'DPM++ 2M Karras', False, 0, 0, 39, 0.0, 1, True, True, False, False, False, 'DeforumAnimeTest', '{timestring}_{index}_{prompt}.png', 'fixed', 1, False, False, True, 0, '', False, False, False, False, 'https://deforum.github.io/a1/M1.jpg', 1.0, 1.0, 4, 1, False, 4, 'reroll', False, 24, True, False, 'FFMPEG mp4', 'C:\\ai\\stable-diffusion-webui\\venv\\lib\\site-packages\\imageio_ffmpeg\\binaries\\ffmpeg-win64-v4.2.2.exe', '17', 'slow', 'None', 'https://deforum.github.io/a1/A1.mp3', False, 'realesrgan-x4plus-anime', 'x4', True, False, 'x0_pred', 'C:/SD/20230124234916_%09d.png', 'testvidmanualsettings.mp4', False, 'None', 2, False, 2, False, '', True, False, 'None', True, 'None', False, 'Farneback', False, 'None', False, 'None', False, False, '0:(1)', '0:(0.5)', '0:(1)', '0:(100)', '0:(0)', False, '{\n    "0": "https://deforum.github.io/a1/Gi1.png",\n    "max_f/4-5": "https://deforum.github.io/a1/Gi2.png",\n    "max_f/2-10": "https://deforum.github.io/a1/Gi3.png",\n    "3*max_f/4-15": "https://deforum.github.io/a1/Gi4.jpg",\n    "max_f-20": "https://deforum.github.io/a1/Gi1.png"\n}', '0:(0.75)', '0:(0.35)', '0:(0.25)', '0:(20)', '0:(0.075)', <tempfile._TemporaryFileWrapper object at 0x0000020C22EF5780>, None, False, '', '', True, True, False, False, True, 'depth', 'control_sd15_depth [fef5e48e]', 1, 0, 1, 384, 64, 64, 'Just Resize') {}
Traceback (most recent call last):
  File "C:\ai\stable-diffusion-webui\modules\call_queue.py", line 56, in f
    res = list(func(*args, **kwargs))
  File "C:\ai\stable-diffusion-webui\modules\call_queue.py", line 37, in f
    res = func(*args, **kwargs)
  File "C:\ai\stable-diffusion-webui\extensions\deforum-for-automatic1111-webui\scripts\deforum.py", line 85, in run_deforum
    render_animation(args, anim_args, video_args, parseq_args, loop_args, controlnet_args, root.animation_prompts, root)
  File "C:\ai\stable-diffusion-webui/extensions/deforum-for-automatic1111-webui/scripts\deforum_helpers\render.py", line 475, in render_animation
    image = generate(args, keys, anim_args, loop_args, controlnet_args, root, frame_idx, sampler_name=scheduled_sampler_name)
  File "C:\ai\stable-diffusion-webui/extensions/deforum-for-automatic1111-webui/scripts\deforum_helpers\generate.py", line 188, in generate
    process_with_controlnet(p_txt, args, anim_args, loop_args, controlnet_args, root, is_img2img=False, frame_idx=frame+1)
  File "C:\ai\stable-diffusion-webui/extensions/deforum-for-automatic1111-webui/scripts\deforum_helpers\deforum_controlnet.py", line 295, in process_with_controlnet
    cnet.update_cn_script_in_processing(p, cn_units, is_img2img=is_img2img, is_ui=False)
TypeError: update_cn_script_in_processing() got an unexpected keyword argument 'is_img2img'

Additional information

No response

hithereai commented 1 year ago

Seems like a breaking change in the CN external API... again. You'll have to revert to a previous version of CN for it to work again I'm afraid. Try a version from 2 days ago.

ljleb commented 1 year ago

Added a passthrough for kwargs in https://github.com/Mikubill/sd-webui-controlnet/commit/2aa9c048cf59c0e4bacbc58c88b2c62d8a2319f3. Let us know if anything else broke.

kabachuha commented 1 year ago

@ljleb huge thank you!