s9roll7 / animatediff-cli-prompt-travel

animatediff prompt travel
Apache License 2.0
1.19k stars 104 forks source link

Question: Changing in the behavior of animatediff tile-upscale | SOLVED #77

Closed ShmuelRonen closed 1 year ago

ShmuelRonen commented 1 year ago

Hi... Thank you very much for the work you do! I upscaled some videos without any problem. And suddenly it starts making an error without any changes I made that I can figure out.

Here is the error code:

(venv) W:\animatediff-cli-prompt-travel> animatediff tile-upscale "W:\animatediff-cli-prompt-travel\output\R1\R22" -W 768 -H 1152 04:09:48 INFO Using generation config: output\R1\prompt.json cli.py:572 04:09:52 INFO is_v2=True util.py:323 INFO Will save outputs to ./upscaled\2023-10-02T04-09-52-haruhidance-meinamix_meinav11 cli.py:587 INFO Using scheduler "ddim" (DDIMScheduler) generate.py:479 INFO Loading weights from generate.py:499 W:\animatediff-cli-prompt-travel\data\models\sd\meinamix_meinaV11.safetensors text_config_dict is provided which will be used to initialize CLIPTextConfig. The value text_config["id2label"] will be overriden. text_config_dict is provided which will be used to initialize CLIPTextConfig. The value text_config["bos_token_id"] will be overriden. text_config_dict is provided which will be used to initialize CLIPTextConfig. The value text_config["eos_token_id"] will be overriden. W:\animatediff-cli-prompt-travel\venv\lib\site-packages\transformers\models\clip\feature_extraction_clip.py:28: FutureWarning: The class CLIPFeatureExtractor is deprecated and will be removed in version 5 of Transformers. Please use CLIPImageProcessor instead. warnings.warn( 04:10:13 INFO No TI embeddings found ti.py:102 INFO Sending pipeline to device "cuda" pipeline.py:22 INFO Selected data types: unet_dtype=torch.float16, tenc_dtype=torch.float16, device.py:90 vae_dtype=torch.bfloat16 INFO Using channels_last memory format for UNet and VAE device.py:111 INFO -> Selected data types: pipeline.py:44 unet_dtype=torch.bfloat16,tenc_dtype=torch.bfloat16,vae_dtype=torch.bfloat16 04:10:19 INFO Saving prompt config to output directory cli.py:639 INFO Initialization complete! cli.py:647 INFO Running generation 1 of 1 (prompt 1) cli.py:657 INFO Generation seed: 8378067828662132702 cli.py:665 04:10:26 INFO use_controlnet_tile=False generate.py:1028 INFO use_controlnet_line_anime=False generate.py:1029 INFO use_controlnet_ip2p=False generate.py:1030 INFO controlnet_conditioning_scale=[] generate.py:1032 INFO guess_mode=[] generate.py:1033 INFO control_guidance_start=[] generate.py:1034 INFO control_guidance_end=[] generate.py:1035 Upscaling... 0% ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0/128 [ 0:00:00 < -:--:-- , ? it/s ] ╭─────────────────────────────── Traceback (most recent call last) ────────────────────────────────╮ │ W:\animatediff-cli-prompt-travel\src\animatediff\cli.py:680 in tile_upscale │ │ │ │ 677 │ │ │ │ 678 │ │ if model_config.upscale_config: │ │ 679 │ │ │ │ │ ❱ 680 │ │ │ upscaled_output = run_upscale( │ │ 681 │ │ │ │ org_imgs=org_images, │ │ 682 │ │ │ │ pipeline=us_pipeline, │ │ 683 │ │ │ │ prompt_map=prompt_map, │ │ │ │ W:\animatediff-cli-prompt-travel\src\animatediff\generate.py:1066 in run_upscale │ │ │ │ 1063 │ │ │ │ guidance_scale=guidance_scale, │ │ 1064 │ │ │ │ generator=generator, │ │ 1065 │ │ │ │ │ │ ❱ 1066 │ │ │ │ controlnet_conditioning_scale= controlnet_conditioning_scale if len(cont │ │ 1067 │ │ │ │ guess_mode= guess_mode[0], │ │ 1068 │ │ │ │ control_guidance_start= control_guidance_start if len(control_guidance_s │ │ 1069 │ │ │ │ control_guidance_end= control_guidance_end if len(control_guidance_end) │ ╰──────────────────────────────────────────────────────────────────────────────────────────────────╯ IndexError: list index out of range

(venv) W:\animatediff-cli-prompt-travel>

ShmuelRonen commented 1 year ago

Solved...

}, "upscale_config": { "scheduler": "k_dpmpp_sde", "steps": 20, "strength": 0.5, "guidance_scale": 10, "controlnet_tile": { "enable": true, "controlnet_conditioning_scale": 1.0, "guess_mode": false, "control_guidance_start": 0.0, "control_guidance_end": 1.0 },