AUTOMATIC1111 / stable-diffusion-webui

Stable Diffusion web UI
GNU Affero General Public License v3.0
140.63k stars 26.61k forks source link

[Bug]: lora LoCon Failed to match keys when loading Lora #8360

Closed YinnVI closed 1 year ago

YinnVI commented 1 year ago

Is there an existing issue for this?

What happened?

Always get this error Failed to match keys when loading Lora, works fine when generating but LoCon gives no effect.

ERROR `Failed to match keys when loading Lora C:\Stable Diffusion WebUI\models\Lora\Choco-000001.safetensors: ['lora_unet_down_blocks_0_downsamplers_0_conv.alpha', 'lora_unet_down_blocks_0_downsamplers_0_conv.lora_down.weight', 'lora_unet_down_blocks_0_downsamplers_0_conv.lora_up.weight', 'lora_unet_down_blocks_0_resnets_0_conv1.alpha', 'lora_unet_down_blocks_0_resnets_0_conv1.lora_down.weight', 'lora_unet_down_blocks_0_resnets_0_conv1.lora_up.weight', 'lora_unet_down_blocks_0_resnets_0_conv2.alpha', 'lora_unet_down_blocks_0_resnets_0_conv2.lora_down.weight', 'lora_unet_down_blocks_0_resnets_0_conv2.lora_up.weight', 'lora_unet_down_blocks_0_resnets_0_time_emb_proj.alpha', 'lora_unet_down_blocks_0_resnets_0_time_emb_proj.lora_down.weight', 'lora_unet_down_blocks_0_resnets_0_time_emb_proj.lora_up.weight', 'lora_unet_down_blocks_0_resnets_1_conv1.alpha', 'lora_unet_down_blocks_0_resnets_1_conv1.lora_down.weight', 'lora_unet_down_blocks_0_resnets_1_conv1.lora_up.weight', 'lora_unet_down_blocks_0_resnets_1_conv2.alpha', 'lora_unet_down_blocks_0_resnets_1_conv2.lora_down.weight', 'lora_unet_down_blocks_0_resnets_1_conv2.lora_up.weight', 'lora_unet_down_blocks_0_resnets_1_time_emb_proj.alpha', 'lora_unet_down_blocks_0_resnets_1_time_emb_proj.lora_down.weight', 'lora_unet_down_blocks_0_resnets_1_time_emb_proj.lora_up.weight', 'lora_unet_down_blocks_1_downsamplers_0_conv.alpha', 'lora_unet_down_blocks_1_downsamplers_0_conv.lora_down.weight', 'lora_unet_down_blocks_1_downsamplers_0_conv.lora_up.weight', 'lora_unet_down_blocks_1_resnets_0_conv1.alpha', 'lora_unet_down_blocks_1_resnets_0_conv1.lora_down.weight', 'lora_unet_down_blocks_1_resnets_0_conv1.lora_up.weight', 'lora_unet_down_blocks_1_resnets_0_conv2.alpha', 'lora_unet_down_blocks_1_resnets_0_conv2.lora_down.weight', 'lora_unet_down_blocks_1_resnets_0_conv2.lora_up.weight', 'lora_unet_down_blocks_1_resnets_0_conv_shortcut.alpha', 'lora_unet_down_blocks_1_resnets_0_conv_shortcut.lora_down.weight', 'lora_unet_down_blocks_1_resnets_0_conv_shortcut.lora_up.weight', 'lora_unet_down_blocks_1_resnets_0_time_emb_proj.alpha', 'lora_unet_down_blocks_1_resnets_0_time_emb_proj.lora_down.weight', 'lora_unet_down_blocks_1_resnets_0_time_emb_proj.lora_up.weight', 'lora_unet_down_blocks_1_resnets_1_conv1.alpha', 'lora_unet_down_blocks_1_resnets_1_conv1.lora_down.weight', 'lora_unet_down_blocks_1_resnets_1_conv1.lora_up.weight', 'lora_unet_down_blocks_1_resnets_1_conv2.alpha', 'lora_unet_down_blocks_1_resnets_1_conv2.lora_down.weight', 'lora_unet_down_blocks_1_resnets_1_conv2.lora_up.weight', 'lora_unet_down_blocks_1_resnets_1_time_emb_proj.alpha', 'lora_unet_down_blocks_1_resnets_1_time_emb_proj.lora_down.weight', 'lora_unet_down_blocks_1_resnets_1_time_emb_proj.lora_up.weight', 'lora_unet_down_blocks_2_downsamplers_0_conv.alpha', 'lora_unet_down_blocks_2_downsamplers_0_conv.lora_down.weight', 'lora_unet_down_blocks_2_downsamplers_0_conv.lora_up.weight', 'lora_unet_down_blocks_2_resnets_0_conv1.alpha', 'lora_unet_down_blocks_2_resnets_0_conv1.lora_down.weight', 'lora_unet_down_blocks_2_resnets_0_conv1.lora_up.weight', 'lora_unet_down_blocks_2_resnets_0_conv2.alpha', 'lora_unet_down_blocks_2_resnets_0_conv2.lora_down.weight', 'lora_unet_down_blocks_2_resnets_0_conv2.lora_up.weight', 'lora_unet_down_blocks_2_resnets_0_conv_shortcut.alpha', 'lora_unet_down_blocks_2_resnets_0_conv_shortcut.lora_down.weight', 'lora_unet_down_blocks_2_resnets_0_conv_shortcut.lora_up.weight', 'lora_unet_down_blocks_2_resnets_0_time_emb_proj.alpha', 'lora_unet_down_blocks_2_resnets_0_time_emb_proj.lora_down.weight', 'lora_unet_down_blocks_2_resnets_0_time_emb_proj.lora_up.weight', 'lora_unet_down_blocks_2_resnets_1_conv1.alpha', 'lora_unet_down_blocks_2_resnets_1_conv1.lora_down.weight', 'lora_unet_down_blocks_2_resnets_1_conv1.lora_up.weight', 'lora_unet_down_blocks_2_resnets_1_conv2.alpha', 'lora_unet_down_blocks_2_resnets_1_conv2.lora_down.weight', 'lora_unet_down_blocks_2_resnets_1_conv2.lora_up.weight', 'lora_unet_down_blocks_2_resnets_1_time_emb_proj.alpha', 'lora_unet_down_blocks_2_resnets_1_time_emb_proj.lora_down.weight', 'lora_unet_down_blocks_2_resnets_1_time_emb_proj.lora_up.weight', 'lora_unet_down_blocks_3_resnets_0_conv1.alpha', 'lora_unet_down_blocks_3_resnets_0_conv1.lora_down.weight', 'lora_unet_down_blocks_3_resnets_0_conv1.lora_up.weight', 'lora_unet_down_blocks_3_resnets_0_conv2.alpha', 'lora_unet_down_blocks_3_resnets_0_conv2.lora_down.weight', 'lora_unet_down_blocks_3_resnets_0_conv2.lora_up.weight', 'lora_unet_down_blocks_3_resnets_0_time_emb_proj.alpha', 'lora_unet_down_blocks_3_resnets_0_time_emb_proj.lora_down.weight', 'lora_unet_down_blocks_3_resnets_0_time_emb_proj.lora_up.weight', 'lora_unet_down_blocks_3_resnets_1_conv1.alpha', 'lora_unet_down_blocks_3_resnets_1_conv1.lora_down.weight', 'lora_unet_down_blocks_3_resnets_1_conv1.lora_up.weight', 'lora_unet_down_blocks_3_resnets_1_conv2.alpha', 'lora_unet_down_blocks_3_resnets_1_conv2.lora_down.weight', 'lora_unet_down_blocks_3_resnets_1_conv2.lora_up.weight', 'lora_unet_down_blocks_3_resnets_1_time_emb_proj.alpha', 'lora_unet_down_blocks_3_resnets_1_time_emb_proj.lora_down.weight', 'lora_unet_down_blocks_3_resnets_1_time_emb_proj.lora_up.weight', 'lora_unet_mid_block_resnets_0_conv1.alpha', 'lora_unet_mid_block_resnets_0_conv1.lora_down.weight', 'lora_unet_mid_block_resnets_0_conv1.lora_up.weight', 'lora_unet_mid_block_resnets_0_conv2.alpha', 'lora_unet_mid_block_resnets_0_conv2.lora_down.weight', 'lora_unet_mid_block_resnets_0_conv2.lora_up.weight', 'lora_unet_mid_block_resnets_0_time_emb_proj.alpha', 'lora_unet_mid_block_resnets_0_time_emb_proj.lora_down.weight', 'lora_unet_mid_block_resnets_0_time_emb_proj.lora_up.weight', 'lora_unet_mid_block_resnets_1_conv1.alpha', 'lora_unet_mid_block_resnets_1_conv1.lora_down.weight', 'lora_unet_mid_block_resnets_1_conv1.lora_up.weight', 'lora_unet_mid_block_resnets_1_conv2.alpha', 'lora_unet_mid_block_resnets_1_conv2.lora_down.weight', 'lora_unet_mid_block_resnets_1_conv2.lora_up.weight', 'lora_unet_mid_block_resnets_1_time_emb_proj.alpha', 'lora_unet_mid_block_resnets_1_time_emb_proj.lora_down.weight', 'lora_unet_mid_block_resnets_1_time_emb_proj.lora_up.weight', 'lora_unet_up_blocks_0_resnets_0_conv1.alpha', 'lora_unet_up_blocks_0_resnets_0_conv1.lora_down.weight', 'lora_unet_up_blocks_0_resnets_0_conv1.lora_up.weight', 'lora_unet_up_blocks_0_resnets_0_conv2.alpha', 'lora_unet_up_blocks_0_resnets_0_conv2.lora_down.weight', 'lora_unet_up_blocks_0_resnets_0_conv2.lora_up.weight', 'lora_unet_up_blocks_0_resnets_0_conv_shortcut.alpha', 'lora_unet_up_blocks_0_resnets_0_conv_shortcut.lora_down.weight', 'lora_unet_up_blocks_0_resnets_0_conv_shortcut.lora_up.weight', 'lora_unet_up_blocks_0_resnets_0_time_emb_proj.alpha', 'lora_unet_up_blocks_0_resnets_0_time_emb_proj.lora_down.weight', 'lora_unet_up_blocks_0_resnets_0_time_emb_proj.lora_up.weight', 'lora_unet_up_blocks_0_resnets_1_conv1.alpha', 'lora_unet_up_blocks_0_resnets_1_conv1.lora_down.weight', 'lora_unet_up_blocks_0_resnets_1_conv1.lora_up.weight', 'lora_unet_up_blocks_0_resnets_1_conv2.alpha', 'lora_unet_up_blocks_0_resnets_1_conv2.lora_down.weight', 'lora_unet_up_blocks_0_resnets_1_conv2.lora_up.weight', 'lora_unet_up_blocks_0_resnets_1_conv_shortcut.alpha', 'lora_unet_up_blocks_0_resnets_1_conv_shortcut.lora_down.weight', 'lora_unet_up_blocks_0_resnets_1_conv_shortcut.lora_up.weight', 'lora_unet_up_blocks_0_resnets_1_time_emb_proj.alpha', 'lora_unet_up_blocks_0_resnets_1_time_emb_proj.lora_down.weight', 'lora_unet_up_blocks_0_resnets_1_time_emb_proj.lora_up.weight', 'lora_unet_up_blocks_0_resnets_2_conv1.alpha', 'lora_unet_up_blocks_0_resnets_2_conv1.lora_down.weight', 'lora_unet_up_blocks_0_resnets_2_conv1.lora_up.weight', 'lora_unet_up_blocks_0_resnets_2_conv2.alpha', 'lora_unet_up_blocks_0_resnets_2_conv2.lora_down.weight', 'lora_unet_up_blocks_0_resnets_2_conv2.lora_up.weight', 'lora_unet_up_blocks_0_resnets_2_conv_shortcut.alpha', 'lora_unet_up_blocks_0_resnets_2_conv_shortcut.lora_down.weight', 'lora_unet_up_blocks_0_resnets_2_conv_shortcut.lora_up.weight', 'lora_unet_up_blocks_0_resnets_2_time_emb_proj.alpha', 'lora_unet_up_blocks_0_resnets_2_time_emb_proj.lora_down.weight', 'lora_unet_up_blocks_0_resnets_2_time_emb_proj.lora_up.weight', 'lora_unet_up_blocks_0_upsamplers_0_conv.alpha', 'lora_unet_up_blocks_0_upsamplers_0_conv.lora_down.weight', 'lora_unet_up_blocks_0_upsamplers_0_conv.lora_up.weight', 'lora_unet_up_blocks_1_resnets_0_conv1.alpha', 'lora_unet_up_blocks_1_resnets_0_conv1.lora_down.weight', 'lora_unet_up_blocks_1_resnets_0_conv1.lora_up.weight', 'lora_unet_up_blocks_1_resnets_0_conv2.alpha', 'lora_unet_up_blocks_1_resnets_0_conv2.lora_down.weight', 'lora_unet_up_blocks_1_resnets_0_conv2.lora_up.weight', 'lora_unet_up_blocks_1_resnets_0_conv_shortcut.alpha', 'lora_unet_up_blocks_1_resnets_0_conv_shortcut.lora_down.weight', 'lora_unet_up_blocks_1_resnets_0_conv_shortcut.lora_up.weight', 'lora_unet_up_blocks_1_resnets_0_time_emb_proj.alpha', 'lora_unet_up_blocks_1_resnets_0_time_emb_proj.lora_down.weight', 'lora_unet_up_blocks_1_resnets_0_time_emb_proj.lora_up.weight', 'lora_unet_up_blocks_1_resnets_1_conv1.alpha', 'lora_unet_up_blocks_1_resnets_1_conv1.lora_down.weight', 'lora_unet_up_blocks_1_resnets_1_conv1.lora_up.weight', 'lora_unet_up_blocks_1_resnets_1_conv2.alpha', 'lora_unet_up_blocks_1_resnets_1_conv2.lora_down.weight', 'lora_unet_up_blocks_1_resnets_1_conv2.lora_up.weight', 'lora_unet_up_blocks_1_resnets_1_conv_shortcut.alpha', 'lora_unet_up_blocks_1_resnets_1_conv_shortcut.lora_down.weight', 'lora_unet_up_blocks_1_resnets_1_conv_shortcut.lora_up.weight', 'lora_unet_up_blocks_1_resnets_1_time_emb_proj.alpha', 'lora_unet_up_blocks_1_resnets_1_time_emb_proj.lora_down.weight', 'lora_unet_up_blocks_1_resnets_1_time_emb_proj.lora_up.weight', 'lora_unet_up_blocks_1_resnets_2_conv1.alpha', 'lora_unet_up_blocks_1_resnets_2_conv1.lora_down.weight', 'lora_unet_up_blocks_1_resnets_2_conv1.lora_up.weight', 'lora_unet_up_blocks_1_resnets_2_conv2.alpha', 'lora_unet_up_blocks_1_resnets_2_conv2.lora_down.weight', 'lora_unet_up_blocks_1_resnets_2_conv2.lora_up.weight', 'lora_unet_up_blocks_1_resnets_2_conv_shortcut.alpha', 'lora_unet_up_blocks_1_resnets_2_conv_shortcut.lora_down.weight', 'lora_unet_up_blocks_1_resnets_2_conv_shortcut.lora_up.weight', 'lora_unet_up_blocks_1_resnets_2_time_emb_proj.alpha', 'lora_unet_up_blocks_1_resnets_2_time_emb_proj.lora_down.weight', 'lora_unet_up_blocks_1_resnets_2_time_emb_proj.lora_up.weight', 'lora_unet_up_blocks_1_upsamplers_0_conv.alpha', 'lora_unet_up_blocks_1_upsamplers_0_conv.lora_down.weight', 'lora_unet_up_blocks_1_upsamplers_0_conv.lora_up.weight', 'lora_unet_up_blocks_2_resnets_0_conv1.alpha', 'lora_unet_up_blocks_2_resnets_0_conv1.lora_down.weight', 'lora_unet_up_blocks_2_resnets_0_conv1.lora_up.weight', 'lora_unet_up_blocks_2_resnets_0_conv2.alpha', 'lora_unet_up_blocks_2_resnets_0_conv2.lora_down.weight', 'lora_unet_up_blocks_2_resnets_0_conv2.lora_up.weight', 'lora_unet_up_blocks_2_resnets_0_conv_shortcut.alpha', 'lora_unet_up_blocks_2_resnets_0_conv_shortcut.lora_down.weight', 'lora_unet_up_blocks_2_resnets_0_conv_shortcut.lora_up.weight', 'lora_unet_up_blocks_2_resnets_0_time_emb_proj.alpha', 'lora_unet_up_blocks_2_resnets_0_time_emb_proj.lora_down.weight', 'lora_unet_up_blocks_2_resnets_0_time_emb_proj.lora_up.weight', 'lora_unet_up_blocks_2_resnets_1_conv1.alpha', 'lora_unet_up_blocks_2_resnets_1_conv1.lora_down.weight', 'lora_unet_up_blocks_2_resnets_1_conv1.lora_up.weight', 'lora_unet_up_blocks_2_resnets_1_conv2.alpha', 'lora_unet_up_blocks_2_resnets_1_conv2.lora_down.weight', 'lora_unet_up_blocks_2_resnets_1_conv2.lora_up.weight', 'lora_unet_up_blocks_2_resnets_1_conv_shortcut.alpha', 'lora_unet_up_blocks_2_resnets_1_conv_shortcut.lora_down.weight', 'lora_unet_up_blocks_2_resnets_1_conv_shortcut.lora_up.weight', 'lora_unet_up_blocks_2_resnets_1_time_emb_proj.alpha', 'lora_unet_up_blocks_2_resnets_1_time_emb_proj.lora_down.weight', 'lora_unet_up_blocks_2_resnets_1_time_emb_proj.lora_up.weight', 'lora_unet_up_blocks_2_resnets_2_conv1.alpha', 'lora_unet_up_blocks_2_resnets_2_conv1.lora_down.weight', 'lora_unet_up_blocks_2_resnets_2_conv1.lora_up.weight', 'lora_unet_up_blocks_2_resnets_2_conv2.alpha', 'lora_unet_up_blocks_2_resnets_2_conv2.lora_down.weight', 'lora_unet_up_blocks_2_resnets_2_conv2.lora_up.weight', 'lora_unet_up_blocks_2_resnets_2_conv_shortcut.alpha', 'lora_unet_up_blocks_2_resnets_2_conv_shortcut.lora_down.weight', 'lora_unet_up_blocks_2_resnets_2_conv_shortcut.lora_up.weight', 'lora_unet_up_blocks_2_resnets_2_time_emb_proj.alpha', 'lora_unet_up_blocks_2_resnets_2_time_emb_proj.lora_down.weight', 'lora_unet_up_blocks_2_resnets_2_time_emb_proj.lora_up.weight', 'lora_unet_up_blocks_2_upsamplers_0_conv.alpha', 'lora_unet_up_blocks_2_upsamplers_0_conv.lora_down.weight', 'lora_unet_up_blocks_2_upsamplers_0_conv.lora_up.weight', 'lora_unet_up_blocks_3_resnets_0_conv1.alpha', 'lora_unet_up_blocks_3_resnets_0_conv1.lora_down.weight', 'lora_unet_up_blocks_3_resnets_0_conv1.lora_up.weight', 'lora_unet_up_blocks_3_resnets_0_conv2.alpha', 'lora_unet_up_blocks_3_resnets_0_conv2.lora_down.weight', 'lora_unet_up_blocks_3_resnets_0_conv2.lora_up.weight', 'lora_unet_up_blocks_3_resnets_0_conv_shortcut.alpha', 'lora_unet_up_blocks_3_resnets_0_conv_shortcut.lora_down.weight', 'lora_unet_up_blocks_3_resnets_0_conv_shortcut.lora_up.weight', 'lora_unet_up_blocks_3_resnets_0_time_emb_proj.alpha', 'lora_unet_up_blocks_3_resnets_0_time_emb_proj.lora_down.weight', 'lora_unet_up_blocks_3_resnets_0_time_emb_proj.lora_up.weight', 'lora_unet_up_blocks_3_resnets_1_conv1.alpha', 'lora_unet_up_blocks_3_resnets_1_conv1.lora_down.weight', 'lora_unet_up_blocks_3_resnets_1_conv1.lora_up.weight', 'lora_unet_up_blocks_3_resnets_1_conv2.alpha', 'lora_unet_up_blocks_3_resnets_1_conv2.lora_down.weight', 'lora_unet_up_blocks_3_resnets_1_conv2.lora_up.weight', 'lora_unet_up_blocks_3_resnets_1_conv_shortcut.alpha', 'lora_unet_up_blocks_3_resnets_1_conv_shortcut.lora_down.weight', 'lora_unet_up_blocks_3_resnets_1_conv_shortcut.lora_up.weight', 'lora_unet_up_blocks_3_resnets_1_time_emb_proj.alpha', 'lora_unet_up_blocks_3_resnets_1_time_emb_proj.lora_down.weight', 'lora_unet_up_blocks_3_resnets_1_time_emb_proj.lora_up.weight', 'lora_unet_up_blocks_3_resnets_2_conv1.alpha', 'lora_unet_up_blocks_3_resnets_2_conv1.lora_down.weight', 'lora_unet_up_blocks_3_resnets_2_conv1.lora_up.weight', 'lora_unet_up_blocks_3_resnets_2_conv2.alpha', 'lora_unet_up_blocks_3_resnets_2_conv2.lora_down.weight', 'lora_unet_up_blocks_3_resnets_2_conv2.lora_up.weight', 'lora_unet_up_blocks_3_resnets_2_conv_shortcut.alpha', 'lora_unet_up_blocks_3_resnets_2_conv_shortcut.lora_down.weight', 'lora_unet_up_blocks_3_resnets_2_conv_shortcut.lora_up.weight', 'lora_unet_up_blocks_3_resnets_2_time_emb_proj.alpha', 'lora_unet_up_blocks_3_resnets_2_time_emb_proj.lora_down.weight', 'lora_unet_up_blocks_3_resnets_2_time_emb_proj.lora_up.weight']`

Steps to reproduce the problem

Using any lora that has been trained with locon

What should have happened?

No Error

Commit where the problem happens

Kohya's GUI Add LoCon support

What platforms do you use to access the UI ?

No response

What browsers do you use to access the UI ?

No response

Command Line Arguments

--xformers --no-half-vae --disable-nan-check --api --autolaunch --upcast-sampling --no-hashing --opt-channelslast --opt-split-attention

List of extensions

a1111-sd-webui-tagcomplete | https://github.com/DominikDoom/a1111-sd-webui-tagcomplete.git novelai-2-local-prompt | https://github.com/animerl/novelai-2-local-prompt.git sd-extension-steps-animation | https://github.com/vladmandic/sd-extension-steps-animation.git sd-webui-additional-networks | https://github.com/kohya-ss/sd-webui-additional-networks.git sd-webui-bilingual-localization | https://github.com/journey-ad/sd-webui-bilingual-localization sd-webui-controlnet | https://github.com/Mikubill/sd-webui-controlnet sd-webui-gelbooru-prompt | https://github.com/antis0007/sd-webui-gelbooru-prompt.git sd-webui-supermerger | https://github.com/hako-mikan/sd-webui-supermerger.git sdweb-auto-MBW | https://github.com/Xerxemi/sdweb-auto-MBW | unknown sdweb-merge-block-weighted-gui | https://github.com/bbc-mc/sdweb-merge-block-weighted-gui.git | unknown stable-diffusion-webui | https://github.com/catppuccin/stable-diffusion-webui.git | unknown stable-diffusion-webui-anti-burn | https://github.com/klimaleksus/stable-diffusion-webui-anti-burn.git stable-diffusion-webui-model-toolkit | https://github.com/arenatemp/stable-diffusion-webui-model-toolkit | unknown stable-diffusion-webui-sonar | https://github.com/Kahsolt/stable-diffusion-webui-sonar.git stable-diffusion-webui-wd14-tagger | https://github.com/toriato/stable-diffusion-webui-wd14-tagger.git | unknown LDSR | built-in |   Lora | built-in |   ScuNET | built-in |   SwinIR | built-in |   prompt-bracket-checker | built-in

Console logs

https://pastebin.com/PXLEzF2j

Additional information

No response

YinnVI commented 1 year ago

Fixed :

  1. installing https://github.com/KohakuBlueleaf/a1111-sd-webui-locon
  2. git pull on automatic1111 folder
  3. check Extensions Update