kabachuha / sd-webui-text2video

Auto1111 extension implementing text2video diffusion models (like ModelScope or VideoCrafter) using only Auto1111 webui dependencies
Other
1.28k stars 106 forks source link

[Bug]: New SD3 model not load #246

Open colotoon opened 3 months ago

colotoon commented 3 months ago

Is there an existing issue for this?

Are you using the latest version of the extension?

What happened?

Hello.

I downloaded new stable diffusion model (SD3), and then i try to change it to SD3 - its fails

i try use 4gb and 5gb files from HF: https://huggingface.co/stabilityai/stable-diffusion-3-medium

And i ask u, if u can start this model weights - plz told me how run.

TNX

Steps to reproduce the problem

  1. load any model u have.
  2. change to SD3 model

What should have happened?

No response

WebUI and Deforum extension Commit IDs

sysinfo-2024-06-13-05-45.json

Torch version

sysinfo-2024-06-13-05-45.json

What GPU were you using for launching?

RTX 3060 (12gb)

On which platform are you launching the webui backend with the extension?

Local PC setup (Windows)

Settings

what page of settings u need? i dont understand, sry

Console logs

changing setting sd_model_checkpoint to sd3_medium.safetensors [cc236278d2]: RuntimeError
Traceback (most recent call last):
  File "F:\AI\Soft\sd.webui\webui\modules\options.py", line 165, in set
    option.onchange()
  File "F:\AI\Soft\sd.webui\webui\modules\call_queue.py", line 13, in f
    res = func(*args, **kwargs)
  File "F:\AI\Soft\sd.webui\webui\modules\initialize_util.py", line 181, in <lambda>
    shared.opts.onchange("sd_model_checkpoint", wrap_queued_call(lambda: sd_models.reload_model_weights()), call=False)
  File "F:\AI\Soft\sd.webui\webui\modules\sd_models.py", line 883, in reload_model_weights
    load_model_weights(sd_model, checkpoint_info, state_dict, timer)
  File "F:\AI\Soft\sd.webui\webui\modules\sd_models.py", line 393, in load_model_weights
    model.load_state_dict(state_dict, strict=False)
  File "F:\AI\Soft\sd.webui\system\python\lib\site-packages\torch\nn\modules\module.py", line 2152, in load_state_dict
    raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format(
RuntimeError: Error(s) in loading state_dict for LatentDiffusion:
        size mismatch for first_stage_model.encoder.conv_out.weight: copying a param with shape torch.Size([32, 512, 3, 3]) from checkpoint, the shape in current model is torch.Size([8, 512, 3, 3]).
        size mismatch for first_stage_model.encoder.conv_out.bias: copying a param with shape torch.Size([32]) from checkpoint, the shape in current model is torch.Size([8]).
        size mismatch for first_stage_model.decoder.conv_in.weight: copying a param with shape torch.Size([512, 16, 3, 3]) from checkpoint, the shape in current model is torch.Size([512, 4, 3, 3]).

Additional information

No response