lucidrains / unet-stylegan2

A Pytorch implementation of Stylegan2 with UNet Discriminator
MIT License
199 stars 24 forks source link

Error while resume training #12

Open israrbacha opened 2 years ago

israrbacha commented 2 years ago

Hi, I am not able to resume traning from checkpoints, i have noticed that some people have this issue on your stylegan2-pytorch repo. The error is a key mismatch in discriminator module, i haven't change anything. The checkpoints size is 286MB for celeba dataset with image size of 256 maybe the ckpts are not saved properly if you confirm it? A portion of error msg is: RuntimeError: Error(s) in loading state_dict for StyleGAN2: size mismatch for D.down_blocks.0.conv_res.weight: copying a param with shape torch.Size([32, 3, 1, 1]) from checkpoint, the shape in current model is torch.Size([16, 3, 1, 1]). size mismatch for D.down_blocks.0.conv_res.bias: copying a param with shape torch.Size([32]) from checkpoint, the shape in current model is torch.Size([16]). size mismatch for D.down_blocks.0.net.0.weight: copying a param with shape torch.Size([32, 3, 3, 3]) from checkpoint, the shape in current model is torch.Size([16, 3, 3, 3]). size mismatch for D.down_blocks.0.net.0.bias: copying a param with shape torch.Size([32]) from checkpoint, the shape in current model is torch.Size([16]).

The error msg is pretty self-explainatory but the problem is i didn't change anything.

The other problem is the model didn't save '.config.json' file

wr0124 commented 12 months ago

the same problem here

Missing key(s) in state_dict: "G.attns.0.0.fn.g", "G.attns.0.0.fn.fn.to_q.weight", "G.attns.0.0.fn.fn.to_q.bias", "G.attns.0.0.fn.fn.to_k.weight", "G.attns.0.0.fn.fn.to_k.bias", "G.attns.0.0.fn.fn.to_v.weight", "G.attns.0.0.fn.fn.to_v.bias", "G.attns.0.0.fn.fn.to_out.weight", "G.attns.0.0.fn.fn.to_out.bias", "G.attns.0.1.fn.g", "G.attns.0.1.fn.fn.0.weight", "G.attns.0.1.fn.fn.0.bias", "G.attns.0.1.fn.fn.2.weight", "G.attns.0.1.fn.fn.2.bias", "G.attns.1.0.fn.g", "G.attns.1.0.fn.fn.to_q.weight", "G.attns.1.0.fn.fn.to_q.bias", "G.attns.1.0.fn.fn.to_k.weight", "G.attns.1.0.fn.fn.to_k.bias", "G.attns.1.0.fn.fn.to_v.weight", "G.attns.1.0.fn.fn.to_v.bias", "G.attns.1.0.fn.fn.to_out.weight", "G.attns.1.0.fn.fn.to_out.bias", "G.attns.1.1.fn.g", "G.attns.1.1.fn.fn.0.weight", "G.attns.1.1.fn.fn.0.bias", "G.attns.1.1.fn.fn.2.weight", "G.attns.1.1.fn.fn.2.bias", "G.attns.2.0.fn.g", "G.attns.2.0.fn.fn.to_q.weight", "G.attns.2.0.fn.fn.to_q.bias", "G.attns.2.0.fn.fn.to_k.weight", "G.attns.2.0.fn.fn.to_k.bias", "G.attns.2.0.fn.fn.to_v.weight", "G.attns.2.0.fn.fn.to_v.bias", "G.attns.2.0.fn.fn.to_out.weight", "G.attns.2.0.fn.fn.to_out.bias", "G.attns.2.1.fn.g", "G.attns.2.1.fn.fn.0.weight", "G.attns.2.1.fn.fn.0.bias", "G.attns.2.1.fn.fn.2.weight", "G.attns.2.1.fn.fn.2.bias", "G.attns.3.0.fn.g", "G.attns.3.0.fn.fn.to_q.weight", "G.attns.3.0.fn.fn.to_q.bias", "G.attns.3.0.fn.fn.to_k.weight", "G.attns.3.0.fn.fn.to_k.bias", "G.attns.3.0.fn.fn.to_v.weight", "G.attns.3.0.fn.fn.to_v.bias", "G.attns.3.0.fn.fn.to_out.weight", "G.attns.3.0.fn.fn.to_out.bias", "G.attns.3.1.fn.g", "G.attns.3.1.fn.fn.0.weight", "G.attns.3.1.fn.fn.0.bias", "G.attns.3.1.fn.fn.2.weight", "G.attns.3.1.fn.fn.2.bias", "G.attns.4.0.fn.g", "G.attns.4.0.fn.fn.to_q.weight", "G.attns.4.0.fn.fn.to_q.bias", "G.attns.4.0.fn.fn.to_k.weight", "G.attns.4.0.fn.fn.to_k.bias", "G.attns.4.0.fn.fn.to_v.weight", "G.attns.4.0.fn.fn.to_v.bias", "G.attns.4.0.fn.fn.to_out.weight", "G.attns.4.0.fn.fn.to_out.bias", "G.attns.4.1.fn.g", "G.attns.4.1.fn.fn.0.weight", "G.attns.4.1.fn.fn.0.bias", "G.attns.4.1.fn.fn.2.weight", "G.attns.4.1.fn.fn.2.bias", "G.attns.5.0.fn.g", "G.attns.5.0.fn.fn.to_q.weight", "G.attns.5.0.fn.fn.to_q.bias", "G.attns.5.0.fn.fn.to_k.weight", "G.attns.5.0.fn.fn.to_k.bias", "G.attns.5.0.fn.fn.to_v.weight", "G.attns.5.0.fn.fn.to_v.bias", "G.attns.5.0.fn.fn.to_out.weight", "G.attns.5.0.fn.fn.to_out.bias", "G.attns.5.1.fn.g", "G.attns.5.1.fn.fn.0.weight", "G.attns.5.1.fn.fn.0.bias", "G.attns.5.1.fn.fn.2.weight", "G.attns.5.1.fn.fn.2.bias", "D.down_blocks.0.conv_res.weight", "D.down_blocks.0.conv_res.bias", "D.down_blocks.0.net.0.weight", "D.down_blocks.0.net.0.bias", "D.down_blocks.0.net.2.weight", "D.down_blocks.0.net.2.bias", "D.down_blocks.0.down.weight", "D.down_blocks.0.down.bias", "D.down_blocks.1.conv_res.weight", "D.down_blocks.1.conv_res.bias", "D.down_blocks.1.net.0.weight", "D.down_blocks.1.net.0.bias", "D.down_blocks.1.net.2.weight", "D.down_blocks.1.net.2.bias", "D.down_blocks.1.down.weight", "D.down_blocks.1.down.bias", "D.down_blocks.2.conv_res.weight", "D.down_blocks.2.conv_res.bias", "D.down_blocks.2.net.0.weight", "D.down_blocks.2.net.0.bias", "D.down_blocks.2.net.2.weight", "D.down_blocks.2.net.2.bias", "D.down_blocks.2.down.weight", "D.down_blocks.2.down.bias", "D.down_blocks.3.conv_res.weight", "D.down_blocks.3.conv_res.bias", "D.down_blocks.3.net.0.weight", "D.down_blocks.3.net.0.bias", "D.down_blocks.3.net.2.weight", "D.down_blocks.3.net.2.bias", "D.down_blocks.3.down.weight", "D.down_blocks.3.down.bias", "D.down_blocks.4.conv_res.weight", "D.down_blocks.4.conv_res.bias", "D.down_blocks.4.net.0.weight", "D.down_blocks.4.net.0.bias", "D.down_blocks.4.net.2.weight", "D.down_blocks.4.net.2.bias", "D.attn_blocks.0.0.fn.g", "D.attn_blocks.0.0.fn.fn.to_q.weight", "D.attn_blocks.0.0.fn.fn.to_q.bias", "D.attn_blocks.0.0.fn.fn.to_k.weight", "D.attn_blocks.0.0.fn.fn.to_k.bias", "D.attn_blocks.0.0.fn.fn.to_v.weight", "D.attn_blocks.0.0.fn.fn.to_v.bias", "D.attn_blocks.0.0.fn.fn.to_out.weight", "D.attn_blocks.0.0.fn.fn.to_out.bias", "D.attn_blocks.0.1.fn.g", "D.attn_blocks.0.1.fn.fn.0.weight", "D.attn_blocks.0.1.fn.fn.0.bias", "D.attn_blocks.0.1.fn.fn.2.weight", "D.attn_blocks.0.1.fn.fn.2.bias", "D.attn_blocks.1.0.fn.g", "D.attn_blocks.1.0.fn.fn.to_q.weight", "D.attn_blocks.1.0.fn.fn.to_q.bias", "D.attn_blocks.1.0.fn.fn.to_k.weight", "D.attn_blocks.1.0.fn.fn.to_k.bias", "D.attn_blocks.1.0.fn.fn.to_v.weight", "D.attn_blocks.1.0.fn.fn.to_v.bias", "D.attn_blocks.1.0.fn.fn.to_out.weight", "D.attn_blocks.1.0.fn.fn.to_out.bias", "D.attn_blocks.1.1.fn.g", "D.attn_blocks.1.1.fn.fn.0.weight", "D.attn_blocks.1.1.fn.fn.0.bias", "D.attn_blocks.1.1.fn.fn.2.weight", "D.attn_blocks.1.1.fn.fn.2.bias", "D.attn_blocks.2.0.fn.g", "D.attn_blocks.2.0.fn.fn.to_q.weight", "D.attn_blocks.2.0.fn.fn.to_q.bias", "D.attn_blocks.2.0.fn.fn.to_k.weight", "D.attn_blocks.2.0.fn.fn.to_k.bias", "D.attn_blocks.2.0.fn.fn.to_v.weight", "D.attn_blocks.2.0.fn.fn.to_v.bias", "D.attn_blocks.2.0.fn.fn.to_out.weight", "D.attn_blocks.2.0.fn.fn.to_out.bias", "D.attn_blocks.2.1.fn.g", "D.attn_blocks.2.1.fn.fn.0.weight", "D.attn_blocks.2.1.fn.fn.0.bias", "D.attn_blocks.2.1.fn.fn.2.weight", "D.attn_blocks.2.1.fn.fn.2.bias", "D.attn_blocks.3.0.fn.g", "D.attn_blocks.3.0.fn.fn.to_q.weight", "D.attn_blocks.3.0.fn.fn.to_q.bias", "D.attn_blocks.3.0.fn.fn.to_k.weight", "D.attn_blocks.3.0.fn.fn.to_k.bias", "D.attn_blocks.3.0.fn.fn.to_v.weight", "D.attn_blocks.3.0.fn.fn.to_v.bias", "D.attn_blocks.3.0.fn.fn.to_out.weight", "D.attn_blocks.3.0.fn.fn.to_out.bias", "D.attn_blocks.3.1.fn.g", "D.attn_blocks.3.1.fn.fn.0.weight", "D.attn_blocks.3.1.fn.fn.0.bias", "D.attn_blocks.3.1.fn.fn.2.weight", "D.attn_blocks.3.1.fn.fn.2.bias", "D.attn_blocks.4.0.fn.g", "D.attn_blocks.4.0.fn.fn.to_q.weight", "D.attn_blocks.4.0.fn.fn.to_q.bias", "D.attn_blocks.4.0.fn.fn.to_k.weight", "D.attn_blocks.4.0.fn.fn.to_k.bias", "D.attn_blocks.4.0.fn.fn.to_v.weight", "D.attn_blocks.4.0.fn.fn.to_v.bias", "D.attn_blocks.4.0.fn.fn.to_out.weight", "D.attn_blocks.4.0.fn.fn.to_out.bias", "D.attn_blocks.4.1.fn.g", "D.attn_blocks.4.1.fn.fn.0.weight", "D.attn_blocks.4.1.fn.fn.0.bias", "D.attn_blocks.4.1.fn.fn.2.weight", "D.attn_blocks.4.1.fn.fn.2.bias", "D.to_logit.3.weight", "D.to_logit.3.bias", "D.conv.0.weight", "D.conv.0.bias", "D.conv.2.weight", "D.conv.2.bias", "D.up_blocks.0.conv_res.weight", "D.up_blocks.0.conv_res.bias", "D.up_blocks.0.net.0.weight", "D.up_blocks.0.net.0.bias", "D.up_blocks.0.net.2.weight", "D.up_blocks.0.net.2.bias", "D.up_blocks.1.conv_res.weight", "D.up_blocks.1.conv_res.bias", "D.up_blocks.1.net.0.weight", "D.up_blocks.1.net.0.bias", "D.up_blocks.1.net.2.weight", "D.up_blocks.1.net.2.bias", "D.up_blocks.2.conv_res.weight", "D.up_blocks.2.conv_res.bias", "D.up_blocks.2.net.0.weight", "D.up_blocks.2.net.0.bias", "D.up_blocks.2.net.2.weight", "D.up_blocks.2.net.2.bias", "D.up_blocks.3.conv_res.weight", "D.up_blocks.3.conv_res.bias", "D.up_blocks.3.net.0.weight", "D.up_blocks.3.net.0.bias", "D.up_blocks.3.net.2.weight", "D.up_blocks.3.net.2.bias", "D.conv_out.weight", "D.conv_out.bias", "GE.attns.0.0.fn.g", "GE.attns.0.0.fn.fn.to_q.weight", "GE.attns.0.0.fn.fn.to_q.bias", "GE.attns.0.0.fn.fn.to_k.weight", "GE.attns.0.0.fn.fn.to_k.bias", "GE.attns.0.0.fn.fn.to_v.weight", "GE.attns.0.0.fn.fn.to_v.bias", "GE.attns.0.0.fn.fn.to_out.weight", "GE.attns.0.0.fn.fn.to_out.bias", "GE.attns.0.1.fn.g", "GE.attns.0.1.fn.fn.0.weight", "GE.attns.0.1.fn.fn.0.bias", "GE.attns.0.1.fn.fn.2.weight", "GE.attns.0.1.fn.fn.2.bias", "GE.attns.1.0.fn.g", "GE.attns.1.0.fn.fn.to_q.weight", "GE.attns.1.0.fn.fn.to_q.bias", "GE.attns.1.0.fn.fn.to_k.weight", "GE.attns.1.0.fn.fn.to_k.bias", "GE.attns.1.0.fn.fn.to_v.weight", "GE.attns.1.0.fn.fn.to_v.bias", "GE.attns.1.0.fn.fn.to_out.weight", "GE.attns.1.0.fn.fn.to_out.bias", "GE.attns.1.1.fn.g", "GE.attns.1.1.fn.fn.0.weight", "GE.attns.1.1.fn.fn.0.bias", "GE.attns.1.1.fn.fn.2.weight", "GE.attns.1.1.fn.fn.2.bias", "GE.attns.2.0.fn.g", "GE.attns.2.0.fn.fn.to_q.weight", "GE.attns.2.0.fn.fn.to_q.bias", "GE.attns.2.0.fn.fn.to_k.weight", "GE.attns.2.0.fn.fn.to_k.bias", "GE.attns.2.0.fn.fn.to_v.weight", "GE.attns.2.0.fn.fn.to_v.bias", "GE.attns.2.0.fn.fn.to_out.weight", "GE.attns.2.0.fn.fn.to_out.bias", "GE.attns.2.1.fn.g", "GE.attns.2.1.fn.fn.0.weight", "GE.attns.2.1.fn.fn.0.bias", "GE.attns.2.1.fn.fn.2.weight", "GE.attns.2.1.fn.fn.2.bias", "GE.attns.3.0.fn.g", "GE.attns.3.0.fn.fn.to_q.weight", "GE.attns.3.0.fn.fn.to_q.bias", "GE.attns.3.0.fn.fn.to_k.weight", "GE.attns.3.0.fn.fn.to_k.bias", "GE.attns.3.0.fn.fn.to_v.weight", "GE.attns.3.0.fn.fn.to_v.bias", "GE.attns.3.0.fn.fn.to_out.weight", "GE.attns.3.0.fn.fn.to_out.bias", "GE.attns.3.1.fn.g", "GE.attns.3.1.fn.fn.0.weight", "GE.attns.3.1.fn.fn.0.bias", "GE.attns.3.1.fn.fn.2.weight", "GE.attns.3.1.fn.fn.2.bias", "GE.attns.4.0.fn.g", "GE.attns.4.0.fn.fn.to_q.weight", "GE.attns.4.0.fn.fn.to_q.bias", "GE.attns.4.0.fn.fn.to_k.weight", "GE.attns.4.0.fn.fn.to_k.bias", "GE.attns.4.0.fn.fn.to_v.weight", "GE.attns.4.0.fn.fn.to_v.bias", "GE.attns.4.0.fn.fn.to_out.weight", "GE.attns.4.0.fn.fn.to_out.bias", "GE.attns.4.1.fn.g", "GE.attns.4.1.fn.fn.0.weight", "GE.attns.4.1.fn.fn.0.bias", "GE.attns.4.1.fn.fn.2.weight", "GE.attns.4.1.fn.fn.2.bias", "GE.attns.5.0.fn.g", "GE.attns.5.0.fn.fn.to_q.weight", "GE.attns.5.0.fn.fn.to_q.bias", "GE.attns.5.0.fn.fn.to_k.weight", "GE.attns.5.0.fn.fn.to_k.bias", "GE.attns.5.0.fn.fn.to_v.weight", "GE.attns.5.0.fn.fn.to_v.bias", "GE.attns.5.0.fn.fn.to_out.weight", "GE.attns.5.0.fn.fn.to_out.bias", "GE.attns.5.1.fn.g", "GE.attns.5.1.fn.fn.0.weight", "GE.attns.5.1.fn.fn.0.bias", "GE.attns.5.1.fn.fn.2.weight", "GE.attns.5.1.fn.fn.2.bias", "D_aug.D.down_blocks.0.conv_res.weight", "D_aug.D.down_blocks.0.conv_res.bias", "D_aug.D.down_blocks.0.net.0.weight", "D_aug.D.down_blocks.0.net.0.bias", "D_aug.D.down_blocks.0.net.2.weight", "D_aug.D.down_blocks.0.net.2.bias", "D_aug.D.down_blocks.0.down.weight", "D_aug.D.down_blocks.0.down.bias", "D_aug.D.down_blocks.1.conv_res.weight", "D_aug.D.down_blocks.1.conv_res.bias", "D_aug.D.down_blocks.1.net.0.weight", "D_aug.D.down_blocks.1.net.0.bias", "D_aug.D.down_blocks.1.net.2.weight", "D_aug.D.down_blocks.1.net.2.bias", "D_aug.D.down_blocks.1.down.weight", "D_aug.D.down_blocks.1.down.bias", "D_aug.D.down_blocks.2.conv_res.weight", "D_aug.D.down_blocks.2.conv_res.bias", "D_aug.D.down_blocks.2.net.0.weight", "D_aug.D.down_blocks.2.net.0.bias", "D_aug.D.down_blocks.2.net.2.weight", "D_aug.D.down_blocks.2.net.2.bias", "D_aug.D.down_blocks.2.down.weight", "D_aug.D.down_blocks.2.down.bias", "D_aug.D.down_blocks.3.conv_res.weight", "D_aug.D.down_blocks.3.conv_res.bias", "D_aug.D.down_blocks.3.net.0.weight", "D_aug.D.down_blocks.3.net.0.bias", "D_aug.D.down_blocks.3.net.2.weight", "D_aug.D.down_blocks.3.net.2.bias", "D_aug.D.down_blocks.3.down.weight", "D_aug.D.down_blocks.3.down.bias", "D_aug.D.down_blocks.4.conv_res.weight", "D_aug.D.down_blocks.4.conv_res.bias", "D_aug.D.down_blocks.4.net.0.weight", "D_aug.D.down_blocks.4.net.0.bias", "D_aug.D.down_blocks.4.net.2.weight", "D_aug.D.down_blocks.4.net.2.bias", "D_aug.D.attn_blocks.0.0.fn.g", "D_aug.D.attn_blocks.0.0.fn.fn.to_q.weight", "D_aug.D.attn_blocks.0.0.fn.fn.to_q.bias", "D_aug.D.attn_blocks.0.0.fn.fn.to_k.weight", "D_aug.D.attn_blocks.0.0.fn.fn.to_k.bias", "D_aug.D.attn_blocks.0.0.fn.fn.to_v.weight", "D_aug.D.attn_blocks.0.0.fn.fn.to_v.bias", "D_aug.D.attn_blocks.0.0.fn.fn.to_out.weight", "D_aug.D.attn_blocks.0.0.fn.fn.to_out.bias", "D_aug.D.attn_blocks.0.1.fn.g", "D_aug.D.attn_blocks.0.1.fn.fn.0.weight", "D_aug.D.attn_blocks.0.1.fn.fn.0.bias", "D_aug.D.attn_blocks.0.1.fn.fn.2.weight", "D_aug.D.attn_blocks.0.1.fn.fn.2.bias", "D_aug.D.attn_blocks.1.0.fn.g", "D_aug.D.attn_blocks.1.0.fn.fn.to_q.weight", "D_aug.D.attn_blocks.1.0.fn.fn.to_q.bias", "D_aug.D.attn_blocks.1.0.fn.fn.to_k.weight", "D_aug.D.attn_blocks.1.0.fn.fn.to_k.bias", "D_aug.D.attn_blocks.1.0.fn.fn.to_v.weight", "D_aug.D.attn_blocks.1.0.fn.fn.to_v.bias", "D_aug.D.attn_blocks.1.0.fn.fn.to_out.weight", "D_aug.D.attn_blocks.1.0.fn.fn.to_out.bias", "D_aug.D.attn_blocks.1.1.fn.g", "D_aug.D.attn_blocks.1.1.fn.fn.0.weight", "D_aug.D.attn_blocks.1.1.fn.fn.0.bias", "D_aug.D.attn_blocks.1.1.fn.fn.2.weight", "D_aug.D.attn_blocks.1.1.fn.fn.2.bias", "D_aug.D.attn_blocks.2.0.fn.g", "D_aug.D.attn_blocks.2.0.fn.fn.to_q.weight", "D_aug.D.attn_blocks.2.0.fn.fn.to_q.bias", "D_aug.D.attn_blocks.2.0.fn.fn.to_k.weight", "D_aug.D.attn_blocks.2.0.fn.fn.to_k.bias", "D_aug.D.attn_blocks.2.0.fn.fn.to_v.weight", "D_aug.D.attn_blocks.2.0.fn.fn.to_v.bias", "D_aug.D.attn_blocks.2.0.fn.fn.to_out.weight", "D_aug.D.attn_blocks.2.0.fn.fn.to_out.bias", "D_aug.D.attn_blocks.2.1.fn.g", "D_aug.D.attn_blocks.2.1.fn.fn.0.weight", "D_aug.D.attn_blocks.2.1.fn.fn.0.bias", "D_aug.D.attn_blocks.2.1.fn.fn.2.weight", "D_aug.D.attn_blocks.2.1.fn.fn.2.bias", "D_aug.D.attn_blocks.3.0.fn.g", "D_aug.D.attn_blocks.3.0.fn.fn.to_q.weight", "D_aug.D.attn_blocks.3.0.fn.fn.to_q.bias", "D_aug.D.attn_blocks.3.0.fn.fn.to_k.weight", "D_aug.D.attn_blocks.3.0.fn.fn.to_k.bias", "D_aug.D.attn_blocks.3.0.fn.fn.to_v.weight", "D_aug.D.attn_blocks.3.0.fn.fn.to_v.bias", "D_aug.D.attn_blocks.3.0.fn.fn.to_out.weight", "D_aug.D.attn_blocks.3.0.fn.fn.to_out.bias", "D_aug.D.attn_blocks.3.1.fn.g", "D_aug.D.attn_blocks.3.1.fn.fn.0.weight", "D_aug.D.attn_blocks.3.1.fn.fn.0.bias", "D_aug.D.attn_blocks.3.1.fn.fn.2.weight", "D_aug.D.attn_blocks.3.1.fn.fn.2.bias", "D_aug.D.attn_blocks.4.0.fn.g", "D_aug.D.attn_blocks.4.0.fn.fn.to_q.weight", "D_aug.D.attn_blocks.4.0.fn.fn.to_q.bias", "D_aug.D.attn_blocks.4.0.fn.fn.to_k.weight", "D_aug.D.attn_blocks.4.0.fn.fn.to_k.bias", "D_aug.D.attn_blocks.4.0.fn.fn.to_v.weight", "D_aug.D.attn_blocks.4.0.fn.fn.to_v.bias", "D_aug.D.attn_blocks.4.0.fn.fn.to_out.weight", "D_aug.D.attn_blocks.4.0.fn.fn.to_out.bias", "D_aug.D.attn_blocks.4.1.fn.g", "D_aug.D.attn_blocks.4.1.fn.fn.0.weight", "D_aug.D.attn_blocks.4.1.fn.fn.0.bias", "D_aug.D.attn_blocks.4.1.fn.fn.2.weight", "D_aug.D.attn_blocks.4.1.fn.fn.2.bias", "D_aug.D.to_logit.3.weight", "D_aug.D.to_logit.3.bias", "D_aug.D.conv.0.weight", "D_aug.D.conv.0.bias", "D_aug.D.conv.2.weight", "D_aug.D.conv.2.bias", "D_aug.D.up_blocks.0.conv_res.weight", "D_aug.D.up_blocks.0.conv_res.bias", "D_aug.D.up_blocks.0.net.0.weight", "D_aug.D.up_blocks.0.net.0.bias", "D_aug.D.up_blocks.0.net.2.weight", "D_aug.D.up_blocks.0.net.2.bias", "D_aug.D.up_blocks.1.conv_res.weight", "D_aug.D.up_blocks.1.conv_res.bias", "D_aug.D.up_blocks.1.net.0.weight", "D_aug.D.up_blocks.1.net.0.bias", "D_aug.D.up_blocks.1.net.2.weight", "D_aug.D.up_blocks.1.net.2.bias", "D_aug.D.up_blocks.2.conv_res.weight", "D_aug.D.up_blocks.2.conv_res.bias", "D_aug.D.up_blocks.2.net.0.weight", "D_aug.D.up_blocks.2.net.0.bias", "D_aug.D.up_blocks.2.net.2.weight", "D_aug.D.up_blocks.2.net.2.bias", "D_aug.D.up_blocks.3.conv_res.weight", "D_aug.D.up_blocks.3.conv_res.bias", "D_aug.D.up_blocks.3.net.0.weight", "D_aug.D.up_blocks.3.net.0.bias", "D_aug.D.up_blocks.3.net.2.weight", "D_aug.D.up_blocks.3.net.2.bias", "D_aug.D.conv_out.weight", "D_aug.D.conv_out.bias". Unexpected key(s) in state_dict: "G.blocks.0.to_rgb.upsample.1.f", "G.blocks.1.to_rgb.upsample.1.f", "G.blocks.2.to_rgb.upsample.1.f", "G.blocks.3.to_rgb.upsample.1.f", "G.blocks.4.to_rgb.upsample.1.f", "D.blocks.0.conv_res.weight", "D.blocks.0.conv_res.bias", "D.blocks.0.net.0.weight", "D.blocks.0.net.0.bias", "D.blocks.0.net.2.weight", "D.blocks.0.net.2.bias", "D.blocks.0.downsample.0.f", "D.blocks.0.downsample.1.weight", "D.blocks.0.downsample.1.bias", "D.blocks.1.conv_res.weight", "D.blocks.1.conv_res.bias", "D.blocks.1.net.0.weight", "D.blocks.1.net.0.bias", "D.blocks.1.net.2.weight", "D.blocks.1.net.2.bias", "D.blocks.1.downsample.0.f", "D.blocks.1.downsample.1.weight", "D.blocks.1.downsample.1.bias", "D.blocks.2.conv_res.weight", "D.blocks.2.conv_res.bias", "D.blocks.2.net.0.weight", "D.blocks.2.net.0.bias", "D.blocks.2.net.2.weight", "D.blocks.2.net.2.bias", "D.blocks.2.downsample.0.f", "D.blocks.2.downsample.1.weight", "D.blocks.2.downsample.1.bias", "D.blocks.3.conv_res.weight", "D.blocks.3.conv_res.bias", "D.blocks.3.net.0.weight", "D.blocks.3.net.0.bias", "D.blocks.3.net.2.weight", "D.blocks.3.net.2.bias", "D.blocks.3.downsample.0.f", "D.blocks.3.downsample.1.weight", "D.blocks.3.downsample.1.bias", "D.blocks.4.conv_res.weight", "D.blocks.4.conv_res.bias", "D.blocks.4.net.0.weight", "D.blocks.4.net.0.bias", "D.blocks.4.net.2.weight", "D.blocks.4.net.2.bias", "D.blocks.4.downsample.0.f", "D.blocks.4.downsample.1.weight", "D.blocks.4.downsample.1.bias", "D.blocks.5.conv_res.weight", "D.blocks.5.conv_res.bias", "D.blocks.5.net.0.weight", "D.blocks.5.net.0.bias", "D.blocks.5.net.2.weight", "D.blocks.5.net.2.bias", "D.blocks.5.downsample.0.f", "D.blocks.5.downsample.1.weight", "D.blocks.5.downsample.1.bias", "D.blocks.6.conv_res.weight", "D.blocks.6.conv_res.bias", "D.blocks.6.net.0.weight", "D.blocks.6.net.0.bias", "D.blocks.6.net.2.weight", "D.blocks.6.net.2.bias", "D.final_conv.weight", "D.final_conv.bias", "D.to_logit.weight", "D.to_logit.bias", "GE.blocks.0.to_rgb.upsample.1.f", "GE.blocks.1.to_rgb.upsample.1.f", "GE.blocks.2.to_rgb.upsample.1.f", "GE.blocks.3.to_rgb.upsample.1.f", "GE.blocks.4.to_rgb.upsample.1.f", "D_aug.D.blocks.0.conv_res.weight", "D_aug.D.blocks.0.conv_res.bias", "D_aug.D.blocks.0.net.0.weight", "D_aug.D.blocks.0.net.0.bias", "D_aug.D.blocks.0.net.2.weight", "D_aug.D.blocks.0.net.2.bias", "D_aug.D.blocks.0.downsample.0.f", "D_aug.D.blocks.0.downsample.1.weight", "D_aug.D.blocks.0.downsample.1.bias", "D_aug.D.blocks.1.conv_res.weight", "D_aug.D.blocks.1.conv_res.bias", "D_aug.D.blocks.1.net.0.weight", "D_aug.D.blocks.1.net.0.bias", "D_aug.D.blocks.1.net.2.weight", "D_aug.D.blocks.1.net.2.bias", "D_aug.D.blocks.1.downsample.0.f", "D_aug.D.blocks.1.downsample.1.weight", "D_aug.D.blocks.1.downsample.1.bias", "D_aug.D.blocks.2.conv_res.weight", "D_aug.D.blocks.2.conv_res.bias", "D_aug.D.blocks.2.net.0.weight", "D_aug.D.blocks.2.net.0.bias", "D_aug.D.blocks.2.net.2.weight", "D_aug.D.blocks.2.net.2.bias", "D_aug.D.blocks.2.downsample.0.f", "D_aug.D.blocks.2.downsample.1.weight", "D_aug.D.blocks.2.downsample.1.bias", "D_aug.D.blocks.3.conv_res.weight", "D_aug.D.blocks.3.conv_res.bias", "D_aug.D.blocks.3.net.0.weight", "D_aug.D.blocks.3.net.0.bias", "D_aug.D.blocks.3.net.2.weight", "D_aug.D.blocks.3.net.2.bias", "D_aug.D.blocks.3.downsample.0.f", "D_aug.D.blocks.3.downsample.1.weight", "D_aug.D.blocks.3.downsample.1.bias", "D_aug.D.blocks.4.conv_res.weight", "D_aug.D.blocks.4.conv_res.bias", "D_aug.D.blocks.4.net.0.weight", "D_aug.D.blocks.4.net.0.bias", "D_aug.D.blocks.4.net.2.weight", "D_aug.D.blocks.4.net.2.bias", "D_aug.D.blocks.4.downsample.0.f", "D_aug.D.blocks.4.downsample.1.weight", "D_aug.D.blocks.4.downsample.1.bias", "D_aug.D.blocks.5.conv_res.weight", "D_aug.D.blocks.5.conv_res.bias", "D_aug.D.blocks.5.net.0.weight", "D_aug.D.blocks.5.net.0.bias", "D_aug.D.blocks.5.net.2.weight", "D_aug.D.blocks.5.net.2.bias", "D_aug.D.blocks.5.downsample.0.f", "D_aug.D.blocks.5.downsample.1.weight", "D_aug.D.blocks.5.downsample.1.bias", "D_aug.D.blocks.6.conv_res.weight", "D_aug.D.blocks.6.conv_res.bias", "D_aug.D.blocks.6.net.0.weight", "D_aug.D.blocks.6.net.0.bias", "D_aug.D.blocks.6.net.2.weight", "D_aug.D.blocks.6.net.2.bias", "D_aug.D.final_conv.weight", "D_aug.D.final_conv.bias", "D_aug.D.to_logit.weight", "D_aug.D.to_logit.bias".