search

light-and-ray / sd-webui-old-sd-firstpasser

Firstpass generation with old SD model, Loras, embedding, etc
30 stars 3 forks source link

Issue with SD3 #5

Closed cryptoquick closed 4 months ago

cryptoquick commented 4 months ago

The Auto setting didn't work (Exception: Can't guess 'Firstpass network type', please set it up manually), so I tried SDXL, and I get this error:

Error in UI:

RuntimeError: Error(s) in loading state_dict for LatentDiffusion: size mismatch for first_stage_model.encoder.conv_out.weight: copying a param with shape torch.Size([32, 512, 3, 3]) from checkpoint, the shape in current model is torch.Size([8, 512, 3, 3]). size mismatch for first_stage_model.encoder.conv_out.bias: copying a param with shape torch.Size([32]) from checkpoint, the shape in current model is torch.Size([8]). size mismatch for first_stage_model.decoder.conv_in.weight: copying a param with shape torch.Size([512, 16, 3, 3]) from checkpoint, the shape in current model is torch.Size([512, 4, 3, 3]).

Error in CLI:

File "/home/hunter/Projects/ai/stable-diffusion-webui-debug/modules/sd_disable_initialization.py", line 223, in <lambda>
        module_load_state_dict = self.replace(torch.nn.Module, 'load_state_dict', lambda *args, **kwargs: load_state_dict(module_load_state_dict, *args, **kwargs))
                                                                                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
      File "/home/hunter/Projects/ai/stable-diffusion-webui-debug/modules/sd_disable_initialization.py", line 221, in load_state_dict
        original(module, state_dict, strict=strict)
      File "/home/hunter/Projects/ai/stable-diffusion-webui-debug/venv/lib/python3.12/site-packages/torch/nn/modules/module.py", line 2191, in load_state_dict
        raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format(
    RuntimeError: Error(s) in loading state_dict for LatentDiffusion:
        size mismatch for first_stage_model.encoder.conv_out.weight: copying a param with shape torch.Size([32, 512, 3, 3]) from checkpoint, the shape in current model is torch.Size([8, 512, 3, 3]).
        size mismatch for first_stage_model.encoder.conv_out.bias: copying a param with shape torch.Size([32]) from checkpoint, the shape in current model is torch.Size([8]).
        size mismatch for first_stage_model.decoder.conv_in.weight: copying a param with shape torch.Size([512, 16, 3, 3]) from checkpoint, the shape in current model is torch.Size([512, 4, 3, 3]).

Firstpass model is stableDiffusion3SD3_sd3Medium.safetensors

light-and-ray commented 4 months ago

SD3 is not supported in webui right now. We need to wait a few days and it will be in dev branch of webui

cryptoquick commented 4 months ago

Good to know, thank you.