search

deforum-art / sd-webui-deforum

Deforum extension for AUTOMATIC1111's Stable Diffusion webui
https://deforum.github.io
Other
2.69k stars 389 forks source link

Error when I change the keyframes from 2D to 3D[Bug]: #837

Open cyberbadger6969 opened 1 year ago

cyberbadger6969 commented 1 year ago

Have you read the latest version of the FAQ?

Is there an existing issue for this?

Are you using the latest version of the Deforum extension?

What happened?

when I go to the deforum and change the keyframes to 3D it shows mee this error: Error: 'Input type (float) and bias type (struct c10::Half) should be the same'. Check your schedules/ init values please. Also make sure you don't have a backwards slash in any of your PATHs - use / instead of . Full error message is in your terminal/ cli.

Win11 GTX 1660Ti Python3.10.6

Steps to reproduce the problem

Go to Deforum Change keyframes to 3D Click generate ERROR

What should have happened/how would you fix it?

No response

Torch version

[webui [5ab7f213] deforum exten](torch: 2.0.0+cpu)

On which platform are you launching the webui with the extension?

Local PC setup (Windows)

Deforum settings

https://drive.google.com/file/d/1bnOKfQIgegX4wdNfWEvhKUIiHyeR_y8A/view?usp=sharing

Webui core settings

https://drive.google.com/file/d/1j5OvKc4Y6fyGnvjZfT4UspVGQSGzQuqc/view?usp=drive_link

Console logs

Already up to date.
venv "E:\DEFORUM\stable-diffusion-webui-directml\venv\Scripts\Python.exe"
fatal: No names found, cannot describe anything.
Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug  1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Version: 1.5.1
Commit hash: b180d1df30125ed606f94a779536f2dfb8aca74a

Launching Web UI with arguments:
no module 'xformers'. Processing without...
no module 'xformers'. Processing without...
No module 'xformers'. Proceeding without it.
2023-08-10 02:22:14,497 - ControlNet - INFO - ControlNet v1.1.237
ControlNet preprocessor location: E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-controlnet\annotator\downloads
2023-08-10 02:22:14,579 - ControlNet - INFO - ControlNet v1.1.237
Loading weights [879db523c3] from E:\DEFORUM\stable-diffusion-webui-directml\models\Stable-diffusion\dreamshaper_8.safetensors
*Deforum ControlNet support: enabled*
Creating model from config: E:\DEFORUM\stable-diffusion-webui-directml\configs\v1-inference.yaml
LatentDiffusion: Running in eps-prediction mode
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Startup time: 12.1s (launcher: 1.3s, import torch: 4.5s, import gradio: 1.2s, setup paths: 1.6s, other imports: 1.8s, list SD models: 0.2s, load scripts: 0.8s, create ui: 0.4s, gradio launch: 0.3s).
DiffusionWrapper has 859.52 M params.
Applying attention optimization: InvokeAI... done.
Model loaded in 4.2s (load weights from disk: 0.6s, create model: 0.3s, apply weights to model: 0.5s, apply half(): 0.5s, move model to device: 2.1s, calculate empty prompt: 0.1s).
started run_deforum
times_to_run: 1
Deforum extension for auto1111 webui
Git commit: ff0680bb
Starting job task(vvbsc33qytsrqt0)-0...
Saving animation frames to:
E:\DEFORUM\stable-diffusion-webui-directml\outputs/img2img-images\Deforum_20230810022355
Loading MiDaS model from dpt_large-midas-2f21e586.pt...
Animation frame: 0/120
Seed: 3690456440
Prompt: tiny cute bunny, vibrant diffraction, highly detailed, intricate, ultra hd, sharp photo, crepuscular rays, in focus, by tomasz alen kopera
Neg Prompt: nsfw, nude
Not using an init image (doing pure txt2img)
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│   0   │ 0  │ 0  │1.75│ 0  │ 0  │ 0  │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|██████████████████████████████████████████████████████████████████████████████████| 25/25 [00:40<00:00,  1.60s/it]
Animation frame: 2/120  █▊                                                            | 25/556 [00:37<13:06,  1.48s/it]
Creating in-between cadence frame: 0; tween:0.50;

*START OF TRACEBACK*
Traceback (most recent call last):
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\run_deforum.py", line 94, in run_deforum
    render_animation(args, anim_args, video_args, parseq_args, loop_args, controlnet_args, root)
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\render.py", line 305, in render_animation
    depth = depth_model.predict(turbo_next_image, anim_args.midas_weight, root.half_precision)
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\depth.py", line 88, in predict
    depth_tensor = self.midas_depth.predict(prev_img_cv2, half_precision)
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\depth_midas.py", line 60, in predict
    midas_depth = self.midas_model.forward(sample)
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\src\midas\dpt_depth.py", line 166, in forward
    return super().forward(x).squeeze(dim=1)
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\src\midas\dpt_depth.py", line 114, in forward
    layers = self.forward_transformer(self.pretrained, x)
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\src\midas\backbones\vit.py", line 13, in forward_vit
    return forward_adapted_unflatten(pretrained, x, "forward_flex")
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\src\midas\backbones\utils.py", line 86, in forward_adapted_unflatten
    exec(f"glob = pretrained.model.{function_name}(x)")
  File "<string>", line 1, in <module>
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\src\midas\backbones\vit.py", line 47, in forward_flex
    x = self.patch_embed.proj(x).flatten(2).transpose(1, 2)
  File "E:\DEFORUM\stable-diffusion-webui-directml\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions-builtin\Lora\networks.py", line 376, in network_Conv2d_forward
    return torch.nn.Conv2d_forward_before_network(self, input)
  File "E:\DEFORUM\stable-diffusion-webui-directml\venv\lib\site-packages\torch\nn\modules\conv.py", line 463, in forward
    return self._conv_forward(input, self.weight, self.bias)
  File "E:\DEFORUM\stable-diffusion-webui-directml\venv\lib\site-packages\torch\nn\modules\conv.py", line 459, in _conv_forward
    return F.conv2d(input, weight, bias, self.stride,
  File "E:\DEFORUM\stable-diffusion-webui-directml\modules\dml\amp\autocast_mode.py", line 39, in <lambda>
    setattr(resolved_obj, func_path[-1], lambda *args, **kwargs: forward(op, args, kwargs))
  File "E:\DEFORUM\stable-diffusion-webui-directml\modules\dml\amp\autocast_mode.py", line 13, in forward
    return op(*args, **kwargs)
RuntimeError: Input type (float) and bias type (struct c10::Half) should be the same
*END OF TRACEBACK*

User friendly error message:
Error: Input type (float) and bias type (struct c10::Half) should be the same. Check your schedules/ init values please. Also make sure you don't have a backwards slash in any of your PATHs - use / instead of \.
Deforum progress:   4%|██▊                                                            | 25/556 [00:39<13:53,  1.57s/it]

Additional information

No response

IsmaelBMAT commented 1 year ago

did you fix it?

cyberbadger6969 commented 1 year ago

no

cyberbadger6969 commented 1 year ago

Win11 RADEON 6800 XT Python3.10.6

Inflamery commented 12 months ago

Screenshot_20231025_220256_Chrome How to fix this? SD using CPU instead of GPU?