训练sd1.5正常，训练sdxl模型时报错RuntimeError: Error(s) in loading state_dict for CLIPTextModel

Loading weights [734d4dbe51] from /root/autodl-tmp/stable-diffusion-webui/models/Stable-diffusion/rSDXL_1.0_ArienMixXL_v2.0.safetensors 2024-01-17 13:00:06,734 - EasyPhoto - /root/autodl-tmp/stable-diffusion-webui/models/Stable-diffusion/Chilloutmix-Ni-pruned-fp16-fix.safetensors : Hash match 2024-01-17 13:00:07,204 - EasyPhoto - /root/autodl-tmp/stable-diffusion-webui/models/ControlNet/control_v11p_sd15_canny.pth : Hash match 2024-01-17 13:00:07,629 - EasyPhoto - /root/autodl-tmp/stable-diffusion-webui/models/ControlNet/control_sd15_random_color.pth : Hash match 2024-01-17 13:00:08,043 - EasyPhoto - /root/autodl-tmp/stable-diffusion-webui/models/VAE/vae-ft-mse-840000-ema-pruned.ckpt : Hash match 2024-01-17 13:00:08,461 - EasyPhoto - /root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-controlnet/models/control_v11p_sd15_openpose.pth : Hash match 2024-01-17 13:00:08,906 - EasyPhoto - /root/autodl-tmp/stable-diffusion-webui/models/ControlNet/control_v11f1e_sd15_tile.pth : Hash match 2024-01-17 13:00:09,308 - EasyPhoto - /root/autodl-tmp/stable-diffusion-webui/models/Lora/FilmVelvia3.safetensors : Hash match 2024-01-17 13:00:09,784 - EasyPhoto - /root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-controlnet/annotator/downloads/openpose/body_pose_model.pth : Hash match 2024-01-17 13:00:10,231 - EasyPhoto - /root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-controlnet/annotator/downloads/openpose/facenet.pth : Hash match 2024-01-17 13:00:10,706 - EasyPhoto - /root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-controlnet/annotator/downloads/openpose/hand_pose_model.pth : Hash match 2024-01-17 13:00:11,172 - EasyPhoto - /root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-EasyPhoto/models/face_skin.pth : Hash match 2024-01-17 13:00:11,578 - EasyPhoto - /root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-EasyPhoto/models/face_landmarks.pth : Hash match 2024-01-17 13:00:12,026 - EasyPhoto - /root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-EasyPhoto/models/makeup_transfer.pth : Hash match 2024-01-17 13:00:12,432 - EasyPhoto - /root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-EasyPhoto/models/training_templates/1.jpg : Hash match 2024-01-17 13:00:12,827 - EasyPhoto - /root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-EasyPhoto/models/training_templates/2.jpg : Hash match 2024-01-17 13:00:13,256 - EasyPhoto - /root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-EasyPhoto/models/training_templates/3.jpg : Hash match 2024-01-17 13:00:13,681 - EasyPhoto - /root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-EasyPhoto/models/training_templates/4.jpg : Hash match Loading weights [734d4dbe51] from /root/autodl-tmp/stable-diffusion-webui/models/Stable-diffusion/rSDXL_1.0_ArienMixXL_v2.0.safetensors 2024-01-17 13:00:16,715 - EasyPhoto - /root/autodl-tmp/stable-diffusion-webui/models/ControlNet/diffusers_xl_canny_mid.safetensors : Hash match 2024-01-17 13:00:17,191 - EasyPhoto - /root/autodl-tmp/stable-diffusion-webui/models/ControlNet/thibaud_xl_openpose_256lora.safetensors : Hash match 2024-01-17 13:00:17,620 - EasyPhoto - /root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-EasyPhoto/models/stable-diffusion-xl/madebyollin_sdxl_vae_fp16_fix/diffusion_pytorch_model.safetensors : Hash match 2024-01-17 13:00:18,078 - EasyPhoto - /root/autodl-tmp/stable-diffusion-webui/models/VAE/madebyollin-sdxl-vae-fp16-fix.safetensors : Hash match 2024-01-17 13:00:21,338 - modelscope - INFO - PyTorch version 2.0.1+cu118 Found. 2024-01-17 13:00:21,341 - modelscope - INFO - TensorFlow version 2.12.0 Found. 2024-01-17 13:00:21,341 - modelscope - INFO - Loading ast index from /root/.cache/modelscope/ast_indexer 2024-01-17 13:00:21,378 - modelscope - INFO - Loading done! Current index file version is 1.9.3, with md5 5b1883a5be1d6cc7c9b007bff2f2a4c7 and a total number of 943 components indexed 2024-01-17 13:00:22,542 - modelscope - INFO - Use user-specified model revision: v1.0.3 2024-01-17 13:00:22,779 - modelscope - WARNING - ('PIPELINES', 'face_recognition', 'face_recognition') not found in ast index file 2024-01-17 13:00:22,779 - modelscope - INFO - initiate model from /root/.cache/modelscope/hub/bubbliiiing/cv_retinafce_recognition 2024-01-17 13:00:22,780 - modelscope - INFO - initiate model from location /root/.cache/modelscope/hub/bubbliiiing/cv_retinafce_recognition. 2024-01-17 13:00:22,781 - modelscope - INFO - initialize model from /root/.cache/modelscope/hub/bubbliiiing/cv_retinafce_recognition 2024-01-17 13:00:22,783 - modelscope - WARNING - ('MODELS', 'face_recognition', 'face_recognition') not found in ast index file 2024-01-17 13:00:23,358 - modelscope - INFO - Model revision not specified, use revision: v2.0.2 2024-01-17 13:00:25,355 - modelscope - INFO - initiate model from /root/.cache/modelscope/hub/damo/cv_resnet50_face-detection_retinaface 2024-01-17 13:00:25,356 - modelscope - INFO - initiate model from location /root/.cache/modelscope/hub/damo/cv_resnet50_face-detection_retinaface. 2024-01-17 13:00:25,360 - modelscope - WARNING - No preprocessor field found in cfg. 2024-01-17 13:00:25,360 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file. 2024-01-17 13:00:25,360 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': '/root/.cache/modelscope/hub/damo/cv_resnet50_face-detection_retinaface'}. trying to build by task and model information. 2024-01-17 13:00:25,360 - modelscope - WARNING - Find task: face-detection, model type: None. Insufficient information to build preprocessor, skip building preprocessor 2024-01-17 13:00:25,361 - modelscope - INFO - loading model from /root/.cache/modelscope/hub/damo/cv_resnet50_face-detection_retinaface/pytorch_model.pt /root/miniconda3/envs/xl_env/lib/python3.10/site-packages/torchvision/models/_utils.py:208: UserWarning: The parameter 'pretrained' is deprecated since 0.13 and may be removed in the future, please use 'weights' instead. warnings.warn( /root/miniconda3/envs/xl_env/lib/python3.10/site-packages/torchvision/models/_utils.py:223: UserWarning: Arguments other than a weight enum or None for 'weights' are deprecated since 0.13 and may be removed in the future. The current behavior is equivalent to passing weights=None. warnings.warn(msg) 2024-01-17 13:00:26,162 - modelscope - INFO - load model done 2024-01-17 13:00:27,650 - modelscope - INFO - load facefusion models done 2024-01-17 13:00:27,650 - modelscope - INFO - init done 2024-01-17 13:00:27,651 - modelscope - WARNING - No preprocessor field found in cfg. 2024-01-17 13:00:27,651 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file. 2024-01-17 13:00:27,651 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': '/root/.cache/modelscope/hub/bubbliiiing/cv_retinafce_recognition'}. trying to build by task and model information. 2024-01-17 13:00:27,652 - modelscope - WARNING - No preprocessor key ('face_recognition', 'face_recognition') found in PREPROCESSOR_MAP, skip building preprocessor. 2024-01-17 13:00:27,652 - modelscope - INFO - image face recognition model init done 2024-01-17 13:00:28,254 - modelscope - INFO - Use user-specified model revision: v2.0.2 2024-01-17 13:00:30,045 - modelscope - INFO - initiate model from /root/.cache/modelscope/hub/damo/cv_resnet50_face-detection_retinaface 2024-01-17 13:00:30,045 - modelscope - INFO - initiate model from location /root/.cache/modelscope/hub/damo/cv_resnet50_face-detection_retinaface. 2024-01-17 13:00:30,049 - modelscope - WARNING - No preprocessor field found in cfg. 2024-01-17 13:00:30,049 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file. 2024-01-17 13:00:30,049 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': '/root/.cache/modelscope/hub/damo/cv_resnet50_face-detection_retinaface'}. trying to build by task and model information. 2024-01-17 13:00:30,049 - modelscope - WARNING - Find task: face-detection, model type: None. Insufficient information to build preprocessor, skip building preprocessor 2024-01-17 13:00:30,050 - modelscope - INFO - loading model from /root/.cache/modelscope/hub/damo/cv_resnet50_face-detection_retinaface/pytorch_model.pt 2024-01-17 13:00:30,645 - modelscope - INFO - load model done 2024-01-17 13:00:31,386 - modelscope - INFO - Use user-specified model revision: v1.0.0 2024-01-17 13:00:31,592 - modelscope - INFO - initiate model from /root/.cache/modelscope/hub/damo/cv_u2net_salient-detection 2024-01-17 13:00:31,593 - modelscope - INFO - initiate model from location /root/.cache/modelscope/hub/damo/cv_u2net_salient-detection. 2024-01-17 13:00:31,594 - modelscope - INFO - initialize model from /root/.cache/modelscope/hub/damo/cv_u2net_salient-detection 2024-01-17 13:00:32,270 - modelscope - WARNING - No preprocessor field found in cfg. 2024-01-17 13:00:32,270 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file. 2024-01-17 13:00:32,271 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': '/root/.cache/modelscope/hub/damo/cv_u2net_salient-detection'}. trying to build by task and model information. 2024-01-17 13:00:32,271 - modelscope - WARNING - No preprocessor key ('detection', 'semantic-segmentation') found in PREPROCESSOR_MAP, skip building preprocessor. 2024-01-17 13:00:32,958 - modelscope - INFO - Use user-specified model revision: v1.0.2 2024-01-17 13:00:33,210 - modelscope - WARNING - ('PIPELINES', 'skin-retouching-torch', 'skin-retouching-torch') not found in ast index file 2024-01-17 13:00:33,210 - modelscope - INFO - initiate model from /root/.cache/modelscope/hub/damo/cv_unet_skin_retouching_torch 2024-01-17 13:00:33,210 - modelscope - INFO - initiate model from location /root/.cache/modelscope/hub/damo/cv_unet_skin_retouching_torch. 2024-01-17 13:00:33,212 - modelscope - WARNING - No preprocessor field found in cfg. 2024-01-17 13:00:33,212 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file. 2024-01-17 13:00:33,212 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': '/root/.cache/modelscope/hub/damo/cv_unet_skin_retouching_torch'}. trying to build by task and model information. 2024-01-17 13:00:33,212 - modelscope - WARNING - Find task: skin-retouching-torch, model type: None. Insufficient information to build preprocessor, skip building preprocessor 2024-01-17 13:00:34,000 - modelscope - INFO - Model revision not specified, use revision: v2.0.2 2024-01-17 13:00:35,882 - modelscope - INFO - initiate model from /root/.cache/modelscope/hub/damo/cv_resnet50_face-detection_retinaface 2024-01-17 13:00:35,882 - modelscope - INFO - initiate model from location /root/.cache/modelscope/hub/damo/cv_resnet50_face-detection_retinaface. 2024-01-17 13:00:35,886 - modelscope - WARNING - No preprocessor field found in cfg. 2024-01-17 13:00:35,886 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file. 2024-01-17 13:00:35,887 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': '/root/.cache/modelscope/hub/damo/cv_resnet50_face-detection_retinaface'}. trying to build by task and model information. 2024-01-17 13:00:35,887 - modelscope - WARNING - Find task: face-detection, model type: None. Insufficient information to build preprocessor, skip building preprocessor 2024-01-17 13:00:35,888 - modelscope - INFO - loading model from /root/.cache/modelscope/hub/damo/cv_resnet50_face-detection_retinaface/pytorch_model.pt 2024-01-17 13:00:36,494 - modelscope - INFO - load model done 2024-01-17 13:00:38.329115306 [W:onnxruntime:, graph.cc:3543 CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt2649'. It is not used by any node and should be removed from the model. 2024-01-17 13:00:38.329146419 [W:onnxruntime:, graph.cc:3543 CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt2657'. It is not used by any node and should be removed from the model. 2024-01-17 13:00:38.329151532 [W:onnxruntime:, graph.cc:3543 CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt2644'. It is not used by any node and should be removed from the model. 2024-01-17 13:00:38.329156180 [W:onnxruntime:, graph.cc:3543 CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt2594'. It is not used by any node and should be removed from the model. 2024-01-17 13:00:38.329162336 [W:onnxruntime:, graph.cc:3543 CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt2596'. It is not used by any node and should be removed from the model. 2024-01-17 13:00:38.329168699 [W:onnxruntime:, graph.cc:3543 CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt2653'. It is not used by any node and should be removed from the model. 2024-01-17 13:00:38.329174711 [W:onnxruntime:, graph.cc:3543 CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt2624'. It is not used by any node and should be removed from the model. 2024-01-17 13:00:38.329179397 [W:onnxruntime:, graph.cc:3543 CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt2652'. It is not used by any node and should be removed from the model. 2024-01-17 13:00:38.329186926 [W:onnxruntime:, graph.cc:3543 CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt2645'. It is not used by any node and should be removed from the model. 2024-01-17 13:00:38.329191427 [W:onnxruntime:, graph.cc:3543 CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt2643'. It is not used by any node and should be removed from the model. 2024-01-17 13:00:38.329196609 [W:onnxruntime:, graph.cc:3543 CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt2648'. It is not used by any node and should be removed from the model. 2024-01-17 13:00:38.329200928 [W:onnxruntime:, graph.cc:3543 CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt2647'. It is not used by any node and should be removed from the model. 2024-01-17 13:00:38.329206381 [W:onnxruntime:, graph.cc:3543 CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt2641'. It is not used by any node and should be removed from the model. 2024-01-17 13:00:38.329211260 [W:onnxruntime:, graph.cc:3543 CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt2633'. It is not used by any node and should be removed from the model. 2024-01-17 13:00:38.329215584 [W:onnxruntime:, graph.cc:3543 CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt2632'. It is not used by any node and should be removed from the model. 2024-01-17 13:00:38.329221245 [W:onnxruntime:, graph.cc:3543 CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt2614'. It is not used by any node and should be removed from the model. 2024-01-17 13:00:38.329226986 [W:onnxruntime:, graph.cc:3543 CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt2613'. It is not used by any node and should be removed from the model. 2024-01-17 13:00:38.329231171 [W:onnxruntime:, graph.cc:3543 CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt2658'. It is not used by any node and should be removed from the model. 2024-01-17 13:00:38.329236522 [W:onnxruntime:, graph.cc:3543 CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt2606'. It is not used by any node and should be removed from the model. 2024-01-17 13:00:38.329240765 [W:onnxruntime:, graph.cc:3543 CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt2598'. It is not used by any node and should be removed from the model. 2024-01-17 13:00:39,224 - modelscope - INFO - Use user-specified model revision: v1.0.0 2024-01-17 13:00:39,474 - modelscope - INFO - initiate model from /root/.cache/modelscope/hub/damo/cv_gpen_image-portrait-enhancement 2024-01-17 13:00:39,474 - modelscope - INFO - initiate model from location /root/.cache/modelscope/hub/damo/cv_gpen_image-portrait-enhancement. 2024-01-17 13:00:39,475 - modelscope - INFO - initialize model from /root/.cache/modelscope/hub/damo/cv_gpen_image-portrait-enhancement Loading ResNet ArcFace 2024-01-17 13:00:42,032 - modelscope - INFO - load face enhancer model done 2024-01-17 13:00:42,546 - modelscope - INFO - load face detector model done 2024-01-17 13:00:42,875 - modelscope - INFO - load sr model done 2024-01-17 13:00:44,528 - modelscope - INFO - load fqa model done 0%| | 0/15 [00:00<?, ?it/s]2024-01-17 13:00:45,500 - modelscope - WARNING - task skin-retouching-torch input definition is missing 2024-01-17 13:00:48,283 - modelscope - WARNING - task skin-retouching-torch output keys are missing 2024-01-17 13:00:48,321 - modelscope - WARNING - task face_recognition input definition is missing 2024-01-17 13:00:48,681 - modelscope - INFO - model inference done 2024-01-17 13:00:48,682 - modelscope - WARNING - task face_recognition output keys are missing 7%|██████████▊ | 1/15 [00:04<00:57, 4.10s/it]2024-01-17 13:00:51,357 - modelscope - INFO - model inference done 13%|█████████████████████▋ | 2/15 [00:06<00:42, 3.26s/it]2024-01-17 13:00:54,342 - modelscope - INFO - model inference done 20%|████████████████████████████████▌ | 3/15 [00:09<00:37, 3.13s/it]2024-01-17 13:00:56,440 - modelscope - INFO - model inference done 27%|███████████████████████████████████████████▍ | 4/15 [00:11<00:29, 2.73s/it]2024-01-17 13:00:58,903 - modelscope - INFO - model inference done 33%|██████████████████████████████████████████████████████▎ | 5/15 [00:14<00:26, 2.63s/it]2024-01-17 13:01:01,305 - modelscope - INFO - model inference done 40%|█████████████████████████████████████████████████████████████████▏ | 6/15 [00:16<00:22, 2.55s/it]2024-01-17 13:01:03,868 - modelscope - INFO - model inference done 47%|████████████████████████████████████████████████████████████████████████████ | 7/15 [00:19<00:20, 2.56s/it]2024-01-17 13:01:06,005 - modelscope - INFO - model inference done 53%|██████████████████████████████████████████████████████████████████████████████████████▉ | 8/15 [00:21<00:16, 2.42s/it]2024-01-17 13:01:07,960 - modelscope - INFO - model inference done 60%|█████████████████████████████████████████████████████████████████████████████████████████████████▊ | 9/15 [00:23<00:13, 2.28s/it]2024-01-17 13:01:09,950 - modelscope - INFO - model inference done 67%|████████████████████████████████████████████████████████████████████████████████████████████████████████████ | 10/15 [00:25<00:10, 2.19s/it]2024-01-17 13:01:13,268 - modelscope - INFO - model inference done 73%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▊ | 11/15 [00:28<00:10, 2.53s/it]2024-01-17 13:01:15,220 - modelscope - INFO - model inference done 80%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▌ | 12/15 [00:30<00:07, 2.36s/it]2024-01-17 13:01:17,275 - modelscope - INFO - model inference done 87%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▍ | 13/15 [00:32<00:04, 2.27s/it]2024-01-17 13:01:19,235 - modelscope - INFO - model inference done 93%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▏ | 14/15 [00:34<00:02, 2.17s/it]2024-01-17 13:01:21,178 - modelscope - INFO - model inference done 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 15/15 [00:36<00:00, 2.44s/it] selected paths: /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/original_backup/2.jpg total scores: 0.6989840317757035 face angles 0.9874661735248256 selected paths: /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/original_backup/4.jpg total scores: 0.6787311882039542 face angles 0.9804245827601507 selected paths: /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/original_backup/13.jpg total scores: 0.6732655957618142 face angles 0.9189908446436776 selected paths: /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/original_backup/6.jpg total scores: 0.6677318819033589 face angles 0.9706401409845777 selected paths: /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/original_backup/5.jpg total scores: 0.6418859854018086 face angles 0.9124980976913215 selected paths: /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/original_backup/7.jpg total scores: 0.6305733812364852 face angles 0.9659900268628565 selected paths: /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/original_backup/1.jpg total scores: 0.6194173226164182 face angles 0.9625954982299167 selected paths: /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/original_backup/12.jpg total scores: 0.6158084800581795 face angles 0.8826194915105074 selected paths: /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/original_backup/8.jpg total scores: 0.6057876938659202 face angles 0.9864887914205243 selected paths: /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/original_backup/11.jpg total scores: 0.6038956491621849 face angles 0.9782490026954038 selected paths: /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/original_backup/9.jpg total scores: 0.5917115327165192 face angles 0.9195786037124233 selected paths: /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/original_backup/3.jpg total scores: 0.5886417454776025 face angles 0.950728264675863 selected paths: /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/original_backup/10.jpg total scores: 0.5839110632558091 face angles 0.9509421019842941 selected paths: /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/original_backup/14.jpg total scores: 0.5614075808315143 face angles 0.8965120729388546 selected paths: /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/original_backup/0.jpg total scores: 0.5018540023764362 face angles 0.7571816449256384 jpg: 13.jpg face_id_scores 0.6732655957618142 jpg: 2.jpg face_id_scores 0.6989840317757035 jpg: 5.jpg face_id_scores 0.6418859854018086 jpg: 12.jpg face_id_scores 0.6158084800581795 jpg: 4.jpg face_id_scores 0.6787311882039542 jpg: 6.jpg face_id_scores 0.6677318819033589 jpg: 0.jpg face_id_scores 0.5018540023764362 jpg: 7.jpg face_id_scores 0.6305733812364852 jpg: 1.jpg face_id_scores 0.6194173226164182 jpg: 9.jpg face_id_scores 0.5917115327165192 jpg: 14.jpg face_id_scores 0.5614075808315143 jpg: 3.jpg face_id_scores 0.5886417454776025 jpg: 11.jpg face_id_scores 0.6038956491621849 jpg: 8.jpg face_id_scores 0.6057876938659202 jpg: 10.jpg face_id_scores 0.5839110632558091 15it [00:05, 2.58it/s] save processed image to /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/processed_images/train/0.jpg save processed image to /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/processed_images/train/1.jpg save processed image to /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/processed_images/train/2.jpg save processed image to /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/processed_images/train/3.jpg save processed image to /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/processed_images/train/4.jpg save processed image to /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/processed_images/train/5.jpg save processed image to /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/processed_images/train/6.jpg save processed image to /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/processed_images/train/7.jpg save processed image to /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/processed_images/train/8.jpg save processed image to /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/processed_images/train/9.jpg save processed image to /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/processed_images/train/10.jpg save processed image to /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/processed_images/train/11.jpg save processed image to /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/processed_images/train/12.jpg save processed image to /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/processed_images/train/13.jpg save processed image to /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/processed_images/train/14.jpg 2024-01-17 13:01:28,185 - EasyPhoto - train_file_path : /root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-EasyPhoto/scripts/train_kohya/train_lora_sd_XL.py 2024-01-17 13:01:28,186 - EasyPhoto - cache_log_file_path: /root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-tmp/train_kohya_log.txt The following values were not passed to accelerate launch and had defaults used instead: --num_processes was set to a value of 1 --num_machines was set to a value of 1 --dynamo_backend was set to a value of 'no' To avoid this warning pass in values for each of the problematic parameters or run accelerate config. 01/17/2024 13:01:36 - INFO - main - Distributed environment: NO Num processes: 1 Process index: 0 Local process index: 0 Device: cuda

Mixed precision type: fp16

{'trained_betas', 'use_karras_sigmas'} was not found in config. Values will be initialized to default values. {'trained_betas', 'use_karras_sigmas'} was not found in config. Values will be initialized to default values. building U-Net loading U-Net from checkpoint U-Net: building text encoders loading text encoders from checkpoint Traceback (most recent call last): File "/root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-EasyPhoto/scripts/train_kohya/train_lora_sd_XL.py", line 1118, in main() File "/root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-EasyPhoto/scripts/train_kohya/train_lora_sd_XL.py", line 594, in main text_encoder, text_encoder_2, vae, unet, logit_scale, ckpt_info = load_models_from_sdxl_checkpoint( File "/root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-EasyPhoto/scripts/train_kohya/utils/model_utils.py", line 920, in load_models_from_sdxl_checkpoint info1 = _load_state_dict_on_device(text_model1, te1_sd, device=map_location) # remain fp32 File "/root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-EasyPhoto/scripts/train_kohya/utils/model_utils.py", line 811, in _load_state_dict_on_device raise RuntimeError("Error(s) in loading state_dict for {}:\n\t{}".format(model.class.name, "\n\t".join(error_msgs))) RuntimeError: Error(s) in loading state_dict for CLIPTextModel: Unexpected key(s) in state_dict: "text_model.embeddings.position_ids". Traceback (most recent call last): File "/root/miniconda3/envs/xl_env/lib/python3.10/runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "/root/miniconda3/envs/xl_env/lib/python3.10/runpy.py", line 86, in _run_code exec(code, run_globals) File "/root/miniconda3/envs/xl_env/lib/python3.10/site-packages/accelerate/commands/launch.py", line 996, in main() File "/root/miniconda3/envs/xl_env/lib/python3.10/site-packages/accelerate/commands/launch.py", line 992, in main launch_command(args) File "/root/miniconda3/envs/xl_env/lib/python3.10/site-packages/accelerate/commands/launch.py", line 986, in launch_command simple_launcher(args) File "/root/miniconda3/envs/xl_env/lib/python3.10/site-packages/accelerate/commands/launch.py", line 628, in simple_launcher raise subprocess.CalledProcessError(returncode=process.returncode, cmd=cmd) subprocess.CalledProcessError: Command '['/root/miniconda3/envs/xl_env/bin/python', '/root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-EasyPhoto/scripts/train_kohya/train_lora_sd_XL.py', '--pretrained_model_name_or_path=/root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-EasyPhoto/models/stable-diffusion-xl/stabilityai_stable_diffusion_xl_base_1.0', '--pretrained_model_ckpt=/root/autodl-tmp/stable-diffusion-webui/models/Stable-diffusion/rSDXL_1.0_ArienMixXL_v2.0.safetensors', '--train_data_dir=/root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/processed_images', '--caption_column=text', '--resolution=1024', '--random_flip', '--train_batch_size=1', '--gradient_accumulation_steps=4', '--dataloader_num_workers=16', '--max_train_steps=600', '--checkpointing_steps=100', '--learning_rate=0.0001', '--lr_scheduler=constant', '--lr_warmup_steps=0', '--train_text_encoder', '--seed=960236', '--rank=32', '--network_alpha=16', '--validation_prompt=easyphoto_face, easyphoto, 1person', '--validation_steps=100', '--output_dir=/root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/user_weights', '--logging_dir=/root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/user_weights', '--enable_xformers_memory_efficient_attention', '--mixed_precision=fp16', '--template_dir=/root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-EasyPhoto/models/training_templates', '--template_mask', '--merge_best_lora_based_face_id', '--merge_best_lora_name=xl', '--cache_log_file=/root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-tmp/train_kohya_log.txt', '--original_config=/root/autodl-tmp/stable-diffusion-webui/repositories/generative-models/configs/inference/sd_xl_base.yaml', '--pretrained_vae_model_name_or_path=/root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-EasyPhoto/models/stable-diffusion-xl/madebyollin_sdxl_vae_fp16_fix']' returned non-zero exit status 1. 2024-01-17 13:01:48,189 - EasyPhoto - Error executing the command: Command '['/root/miniconda3/envs/xl_env/bin/python', '-m', 'accelerate.commands.launch', '--mixed_precision=fp16', '--main_process_port=3456', '/root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-EasyPhoto/scripts/train_kohya/train_lora_sd_XL.py', '--pretrained_model_name_or_path=/root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-EasyPhoto/models/stable-diffusion-xl/stabilityai_stable_diffusion_xl_base_1.0', '--pretrained_model_ckpt=/root/autodl-tmp/stable-diffusion-webui/models/Stable-diffusion/rSDXL_1.0_ArienMixXL_v2.0.safetensors', '--train_data_dir=/root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/processed_images', '--caption_column=text', '--resolution=1024', '--random_flip', '--train_batch_size=1', '--gradient_accumulation_steps=4', '--dataloader_num_workers=16', '--max_train_steps=600', '--checkpointing_steps=100', '--learning_rate=0.0001', '--lr_scheduler=constant', '--lr_warmup_steps=0', '--train_text_encoder', '--seed=960236', '--rank=32', '--network_alpha=16', '--validation_prompt=easyphoto_face, easyphoto, 1person', '--validation_steps=100', '--output_dir=/root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/user_weights', '--logging_dir=/root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-user-id-infos/xl/user_weights', '--enable_xformers_memory_efficient_attention', '--mixed_precision=fp16', '--template_dir=/root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-EasyPhoto/models/training_templates', '--template_mask', '--merge_best_lora_based_face_id', '--merge_best_lora_name=xl', '--cache_log_file=/root/autodl-tmp/stable-diffusion-webui/outputs/easyphoto-tmp/train_kohya_log.txt', '--original_config=/root/autodl-tmp/stable-diffusion-webui/repositories/generative-models/configs/inference/sd_xl_base.yaml', '--pretrained_vae_model_name_or_path=/root/autodl-tmp/stable-diffusion-webui/extensions/sd-webui-EasyPhoto/models/stable-diffusion-xl/madebyollin_sdxl_vae_fp16_fix']' returned non-zero exit status 1. Applying attention optimization: xformers... done.

aigc-apps / sd-webui-EasyPhoto

训练sd1.5正常，训练sdxl模型时报错RuntimeError: Error(s) in loading state_dict for CLIPTextModel #376