deforum-art / sd-webui-deforum

Deforum extension for AUTOMATIC1111's Stable Diffusion webui
https://deforum.github.io
Other
2.69k stars 389 forks source link

[Bug]: Path error, new to this update (CN or Hybrid) #618

Closed revolvedai closed 1 year ago

revolvedai commented 1 year ago

Have you read the latest version of the FAQ?

Is there an existing issue for this?

Are you using the latest version of the Deforum extension?

What happened?

Using controlnet or hybrid on latest update is broken for me.

Error: None. Check your schedules/ init values please. Also make sure you don't have a forward slash in any of your PATHs - use / instead of .

This error exists no matter which was path is formatted with slashes. Note Win11 copy as path uses forward slash and worked before latest update.

Steps to reproduce the problem

  1. Install Automatic1111 fresh.
  2. Install Torch 2 using https://medium.com/@inzaniak/updating-automatic1111-stable-diffusion-webui-to-torch-2-for-amazing-performance-50366dcc9bc1
  3. Install Controlnet 1.1 using install instructions on their github for Auto1111 CN. Full restart of Auto. Move over CN models.
  4. Install Deforum.
  5. Boot up and attempt to make video using controlnet or hybrid.

What should have happened?

Controlnet + Hybrid video starts.

WebUI and Deforum extension Commit IDs

python: 3.10.9  •  torch: 2.0.0+cu118  •  xformers: N/A  •  gradio: 3.23.0  •  commit: [22bcc7be]  •  checkpoint: [6ce0161689] deforum-for-automatic1111-webui | https://github.com/deforum-art/deforum-for-automatic1111-webui.git | b55b9500 (Wed sd-webui-controlnet | https://github.com/Mikubill/sd-webui-controlnet.git | 93b0f9e1 (Wed Apr 26 03:16:41 2023)

On which platform are you launching the webui with the extension?

No response

Deforum settings

{ "W": 768, "H": 512, "tiling": false, "restore_faces": false, "seed": 4132021, "sampler": "Euler a", "seed_resize_from_w": 0, "seed_resize_from_h": 0, "steps": 25, "ddim_eta": 0.0, "save_settings": true, "save_sample_per_step": false, "batch_name": "Deforum_20230426123834", "seed_behavior": "iter", "seed_iter_N": 1, "use_init": false, "strength_0_no_init": true, "strength": 0.8, "init_image": null, "use_mask": false, "use_alpha_as_mask": false, "invert_mask": false, "overlay_mask": true, "mask_file": "https://deforum.github.io/a1/M1.jpg", "mask_contrast_adjust": 1.0, "mask_brightness_adjust": 1.0, "mask_overlay_blur": 4, "fill": 1, "full_res_mask": true, "full_res_mask_padding": 4, "reroll_blank_frames": "reroll", "reroll_patience": 10.0, "precision": "autocast", "timestring": "20230426123834", "prompts": { "0": " androgyne being, glowing skin, videosynthesis, portrait of a woman, digital painting, marbling-arts, sharp focus, highly detailed, retro airbrush style, 4k, --neg easynegative, bad-artist, blurry, deformed, cartoon, amateur drawing, ugly, pixelated, obscured, plastic " }, "positive_prompts": "", "negative_prompts": "", "outdir": "C:\Users\edken\stable-diffusion-webui\outputs/img2img-images\Deforum_20230426123834", "animation_mode": "3D", "max_frames": 120, "border": "replicate", "angle": "0:(0)", "zoom": "0:(1.0025+0.002sin(1.253.14t/30))", "translation_x": "0:(0)", "translation_y": "0:(0)", "translation_z": "0:(0)", "transform_center_x": "0:(0.5)", "transform_center_y": "0:(0.5)", "rotation_3d_x": "0:(0)", "rotation_3d_y": "0:(0)", "rotation_3d_z": "0:(0)", "enable_perspective_flip": false, "perspective_flip_theta": "0:(0)", "perspective_flip_phi": "0:(0)", "perspective_flip_gamma": "0:(0)", "perspective_flip_fv": "0:(53)", "noise_schedule": "0: (0.065)", "strength_schedule": "0: (0.65)", "contrast_schedule": "0: (1.0)", "cfg_scale_schedule": "0: (7)", "pix2pix_img_cfg_scale_schedule": "0:(1.5)", "enable_subseed_scheduling": false, "subseed_schedule": "0:(1)", "subseed_strength_schedule": "0:(0)", "enable_steps_scheduling": false, "steps_schedule": "0: (25)", "fov_schedule": "0: (70)", "aspect_ratio_schedule": "0: (1)", "aspect_ratio_use_old_formula": false, "near_schedule": "0: (200)", "far_schedule": "0: (10000)", "seed_schedule": "0:(s), 1:(-1), \"max_f-2\":(-1), \"max_f-1\":(s)", "enable_sampler_scheduling": false, "sampler_schedule": "0: (\"Euler a\")", "mask_schedule": "0: (\"{video_mask}\")", "use_noise_mask": false, "noise_mask_schedule": "0: (\"{video_mask}\")", "enable_checkpoint_scheduling": false, "checkpoint_schedule": "0: (\"model1.ckpt\"), 100: (\"model2.safetensors\")", "enable_clipskip_scheduling": false, "clipskip_schedule": "0: (2)", "enable_noise_multiplier_scheduling": true, "noise_multiplier_schedule": "0: (1.05)", "kernel_schedule": "0: (5)", "sigma_schedule": "0: (1.0)", "amount_schedule": "0: (0.1)", "threshold_schedule": "0: (0.0)", "color_coherence": "Video Input", "color_coherence_image_path": "", "color_coherence_video_every_N_frames": 1.0, "color_force_grayscale": false, "diffusion_cadence": "2", "optical_flow_cadence": "None", "cadence_flow_factor_schedule": "0: (1)", "optical_flow_redo_generation": "None", "redo_flow_factor_schedule": "0: (1)", "diffusion_redo": "0", "noise_type": "perlin", "perlin_octaves": 4, "perlin_persistence": 0.5, "use_depth_warping": true, "use_zoe_depth": false, "midas_weight": 0.2, "padding_mode": "border", "sampling_mode": "bicubic", "save_depth_maps": false, "video_init_path": "", "extract_nth_frame": 1, "extract_from_frame": 0, "extract_to_frame": -1, "overwrite_extracted_frames": false, "use_mask_video": false, "video_mask_path": "https://deforum.github.io/a1/VM1.mp4", "resume_from_timestring": false, "resume_timestring": null, "hybrid_generate_inputframes": false, "hybrid_generate_human_masks": "None", "hybrid_use_first_frame_as_init_image": true, "hybrid_motion": "None", "hybrid_motion_use_prev_img": false, "hybrid_flow_method": "RAFT", "hybrid_composite": "None", "hybrid_use_init_image": false, "hybrid_comp_mask_type": "None", "hybrid_comp_mask_inverse": false, "hybrid_comp_mask_equalize": "None", "hybrid_comp_mask_auto_contrast": false, "hybrid_comp_save_extra_frames": false, "hybrid_comp_alpha_schedule": "0:(0.5)", "hybrid_flow_factor_schedule": "0:(1)", "hybrid_comp_mask_blend_alpha_schedule": "0:(0.5)", "hybrid_comp_mask_contrast_schedule": "0:(1)", "hybrid_comp_mask_auto_contrast_cutoff_high_schedule": "0:(100)", "hybrid_comp_mask_auto_contrast_cutoff_low_schedule": "0:(0)", "parseq_manifest": null, "parseq_use_deltas": true, "use_looper": false, "init_images": "{\n \"0\": \"https://deforum.github.io/a1/Gi1.png\",\n \"max_f/4-5\": \"https://deforum.github.io/a1/Gi2.png\",\n \"max_f/2-10\": \"https://deforum.github.io/a1/Gi3.png\",\n \"3max_f/4-15\": \"https://deforum.github.io/a1/Gi4.jpg\",\n \"max_f-20\": \"https://deforum.github.io/a1/Gi1.png\"\n}", "image_strength_schedule": "0:(0.75)", "blendFactorMax": "0:(0.35)", "blendFactorSlope": "0:(0.25)", "tweening_frames_schedule": "0:(20)", "color_correction_factor": "0:(0.075)", "cn_1_overwrite_frames": true, "cn_1_vid_path": "C:/Users/edken/Videos/pexels-yaroslav-shuraev-4154533-3840x2160-24fps.mp4", "cn_1_mask_vid_path": "", "cn_1_enabled": false, "cn_1_low_vram": false, "cn_1_pixel_perfect": false, "cn_1_module": "normal_map", "cn_1_model": "control_v11p_sd15_normalbae [316696f1]", "cn_1_weight": 1, "cn_1_guidance_start": 0, "cn_1_guidance_end": 1, "cn_1_processor_res": 512, "cn_1_threshold_a": 0.4, "cn_1_threshold_b": 64, "cn_1_resize_mode": "Inner Fit (Scale to Fit)", "cn_1_control_mode": "Balanced", "cn_2_overwrite_frames": true, "cn_2_vid_path": "C:/Users/edken/Videos/pexels-yaroslav-shuraev-4154533-3840x2160-24fps.mp4", "cn_2_mask_vid_path": "", "cn_2_enabled": false, "cn_2_low_vram": false, "cn_2_pixel_perfect": false, "cn_2_module": "mediapipe_face", "cn_2_model": "control_v2p_sd15_mediapipe_face [0653d983]", "cn_2_weight": 1, "cn_2_guidance_start": 0, "cn_2_guidance_end": 1, "cn_2_processor_res": 512, "cn_2_threshold_a": 1, "cn_2_threshold_b": 0.5, "cn_2_resize_mode": "Inner Fit (Scale to Fit)", "cn_2_control_mode": "Balanced", "cn_3_overwrite_frames": true, "cn_3_vid_path": "", "cn_3_mask_vid_path": "", "cn_3_enabled": false, "cn_3_low_vram": false, "cn_3_pixel_perfect": false, "cn_3_module": "none", "cn_3_model": "None", "cn_3_weight": 1, "cn_3_guidance_start": 0, "cn_3_guidance_end": 1, "cn_3_processor_res": 64, "cn_3_threshold_a": 64, "cn_3_threshold_b": 64, "cn_3_resize_mode": "Inner Fit (Scale to Fit)", "cn_3_control_mode": "Balanced", "cn_4_overwrite_frames": true, "cn_4_vid_path": "", "cn_4_mask_vid_path": "", "cn_4_enabled": false, "cn_4_low_vram": false, "cn_4_pixel_perfect": false, "cn_4_module": "none", "cn_4_model": "None", "cn_4_weight": 1, "cn_4_guidance_start": 0, "cn_4_guidance_end": 1, "cn_4_processor_res": 64, "cn_4_threshold_a": 64, "cn_4_threshold_b": 64, "cn_4_resize_mode": "Inner Fit (Scale to Fit)", "cn_4_control_mode": "Balanced", "cn_5_overwrite_frames": true, "cn_5_vid_path": "", "cn_5_mask_vid_path": "", "cn_5_enabled": false, "cn_5_low_vram": false, "cn_5_pixel_perfect": false, "cn_5_module": "none", "cn_5_model": "None", "cn_5_weight": 1, "cn_5_guidance_start": 0, "cn_5_guidance_end": 1, "cn_5_processor_res": 64, "cn_5_threshold_a": 64, "cn_5_threshold_b": 64, "cn_5_resize_mode": "Inner Fit (Scale to Fit)", "cn_5_control_mode": "Balanced", "skip_video_creation": false, "fps": 24, "make_gif": false, "delete_imgs": true, "add_soundtrack": "None", "soundtrack_path": "https://deforum.github.io/a1/A1.mp3", "r_upscale_video": false, "r_upscale_model": "realesrgan-x4plus", "r_upscale_factor": "x4", "r_upscale_keep_imgs": true, "store_frames_in_ram": false, "frame_interpolation_engine": "None", "frame_interpolation_x_amount": 2, "frame_interpolation_slow_mo_enabled": false, "frame_interpolation_slow_mo_amount": 2, "frame_interpolation_keep_imgs": false, "sd_model_name": "v1-5-pruned-emaonly.safetensors", "sd_model_hash": "d7049739", "deforum_git_commit_id": "b55b9500 (Wed Apr 26 12:28:38 2023)" }

Webui core settings

https://pastebin.com/UdMMVAZ3

Console logs

https://pastebin.com/uqhf8QUy

Additional information

3090 running locally on fresh install

github-actions[bot] commented 1 year ago

This issue has been closed due to incorrect formatting. Please address the following mistakes and reopen the issue:

revolvedai commented 1 year ago

I could not submit this message with a full paste of settings and a full paste of the console logs because it was too many characters. Not sure how I can get this all in one issue without going over char limit. Bot is automodding. I assume it will automod if I pastebin the settings as well.

kabachuha commented 1 year ago

Oh, thanks for noting this inconvenience about the pastebin files! ♥

I'll need to correct the autocheck to account for it