[Bug]: Training not working

Is there an existing issue for this?

[X] I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

Is EasyPhoto the latest version?

[X] I have updated EasyPhoto to the latest version and the bug still exists.

What happened?

I installed easy photo via the extensions tab and tried training a person in sdxl

Steps to reproduce the problem

Go to .... Easy photo tab
Press .... upload images and press start training
... Get an error

What should have happened?

I should have trained the person

Commit where the problem happens

webui: EastPhoto:

What browsers do you use to access the UI ?

Microsoft Edge

Command Line Arguments

--xformers --theme dark --autolaunch --no-half --precision full

List of enabled extensions

Console logs

Loading weights [1601484d4b] from C:\StableDiffusion\stable-diffusion-webui\models\Stable-diffusion\newrealityxlAllInOne_21.safetensors
2024-02-09 21:49:22,678 - EasyPhoto - C:\StableDiffusion\stable-diffusion-webui\models\Stable-diffusion/Chilloutmix-Ni-pruned-fp16-fix.safetensors : Hash match
2024-02-09 21:49:26,086 - EasyPhoto - C:\StableDiffusion\stable-diffusion-webui\models\ControlNet/control_v11p_sd15_canny.pth : Hash match
2024-02-09 21:49:29,329 - EasyPhoto - C:\StableDiffusion\stable-diffusion-webui\models\ControlNet/control_sd15_random_color.pth : Hash match
2024-02-09 21:49:32,699 - EasyPhoto - C:\StableDiffusion\stable-diffusion-webui\models\VAE/vae-ft-mse-840000-ema-pruned.ckpt : Hash match
2024-02-09 21:49:35,964 - EasyPhoto - C:\StableDiffusion\stable-diffusion-webui\models\ControlNet/control_v11p_sd15_openpose.pth : Hash match
2024-02-09 21:49:39,275 - EasyPhoto - C:\StableDiffusion\stable-diffusion-webui\models\ControlNet/control_v11f1e_sd15_tile.pth : Hash match
2024-02-09 21:49:42,768 - EasyPhoto - C:\StableDiffusion\stable-diffusion-webui\models\Lora/FilmVelvia3.safetensors : Hash match
2024-02-09 21:49:46,211 - EasyPhoto - C:\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-controlnet\annotator/downloads/openpose\body_pose_model.pth : Hash match
2024-02-09 21:49:49,503 - EasyPhoto - C:\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-controlnet\annotator/downloads/openpose\facenet.pth : Hash match
2024-02-09 21:49:52,946 - EasyPhoto - C:\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-controlnet\annotator/downloads/openpose\hand_pose_model.pth : Hash match
2024-02-09 21:49:56,313 - EasyPhoto - C:\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-EasyPhoto\models\face_skin.pth : Hash match
2024-02-09 21:49:59,752 - EasyPhoto - C:\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-EasyPhoto\models\face_landmarks.pth : Hash match
2024-02-09 21:50:03,078 - EasyPhoto - C:\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-EasyPhoto\models\makeup_transfer.pth : Hash match
2024-02-09 21:50:06,384 - EasyPhoto - C:\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-EasyPhoto\models\training_templates\1.jpg : Hash match
2024-02-09 21:50:09,738 - EasyPhoto - C:\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-EasyPhoto\models\training_templates\2.jpg : Hash match
2024-02-09 21:50:13,022 - EasyPhoto - C:\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-EasyPhoto\models\training_templates\3.jpg : Hash match
2024-02-09 21:50:16,420 - EasyPhoto - C:\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-EasyPhoto\models\training_templates\4.jpg : Hash match
Loading weights [1601484d4b] from C:\StableDiffusion\stable-diffusion-webui\models\Stable-diffusion\newrealityxlAllInOne_21.safetensors
2024-02-09 21:50:20,320 - EasyPhoto - C:\StableDiffusion\stable-diffusion-webui\models\ControlNet/diffusers_xl_canny_mid.safetensors : Hash match
2024-02-09 21:50:23,749 - EasyPhoto - C:\StableDiffusion\stable-diffusion-webui\models\ControlNet/thibaud_xl_openpose_256lora.safetensors : Hash match
2024-02-09 21:50:27,255 - EasyPhoto - C:\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-EasyPhoto\models\stable-diffusion-xl/madebyollin_sdxl_vae_fp16_fix/diffusion_pytorch_model.safetensors : Hash match
2024-02-09 21:50:30,719 - EasyPhoto - C:\StableDiffusion\stable-diffusion-webui\models\VAE/madebyollin-sdxl-vae-fp16-fix.safetensors : Hash match
2024-02-09 21:50:32,721 - modelscope - INFO - PyTorch version 2.0.1+cu118 Found.
2024-02-09 21:50:32,724 - modelscope - INFO - TensorFlow version 2.15.0 Found.
2024-02-09 21:50:32,724 - modelscope - INFO - Loading ast index from C:\Users\rouve\.cache\modelscope\ast_indexer
2024-02-09 21:50:32,816 - modelscope - INFO - Loading done! Current index file version is 1.9.3, with md5 f316726eaf2b855a7de29cb0a1af1f44 and a total number of 943 components indexed
2024-02-09 21:50:36,094 - modelscope - INFO - Use user-specified model revision: v1.0.3
2024-02-09 21:50:36,534 - modelscope - WARNING - ('PIPELINES', 'face_recognition', 'face_recognition') not found in ast index file
2024-02-09 21:50:36,534 - modelscope - INFO - initiate model from C:\Users\rouve\.cache\modelscope\hub\bubbliiiing\cv_retinafce_recognition
2024-02-09 21:50:36,534 - modelscope - INFO - initiate model from location C:\Users\rouve\.cache\modelscope\hub\bubbliiiing\cv_retinafce_recognition.
2024-02-09 21:50:36,534 - modelscope - INFO - initialize model from C:\Users\rouve\.cache\modelscope\hub\bubbliiiing\cv_retinafce_recognition
2024-02-09 21:50:36,534 - modelscope - WARNING - ('MODELS', 'face_recognition', 'face_recognition') not found in ast index file
2024-02-09 21:50:38,698 - modelscope - INFO - Model revision not specified, use revision: v2.0.2
2024-02-09 21:50:40,770 - modelscope - INFO - initiate model from C:\Users\rouve\.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface
2024-02-09 21:50:40,770 - modelscope - INFO - initiate model from location C:\Users\rouve\.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface.
2024-02-09 21:50:40,777 - modelscope - WARNING - No preprocessor field found in cfg.
2024-02-09 21:50:40,777 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file.
2024-02-09 21:50:40,777 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': 'C:\\Users\\rouve\\.cache\\modelscope\\hub\\damo\\cv_resnet50_face-detection_retinaface'}. trying to build by task and model information.
2024-02-09 21:50:40,780 - modelscope - WARNING - Find task: face-detection, model type: None. Insufficient information to build preprocessor, skip building preprocessor
2024-02-09 21:50:40,780 - modelscope - INFO - loading model from C:\Users\rouve\.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface\pytorch_model.pt
C:\StableDiffusion\stable-diffusion-webui\venv\lib\site-packages\torchvision\models\_utils.py:208: UserWarning: The parameter 'pretrained' is deprecated since 0.13 and may be removed in the future, please use 'weights' instead.
  warnings.warn(
C:\StableDiffusion\stable-diffusion-webui\venv\lib\site-packages\torchvision\models\_utils.py:223: UserWarning: Arguments other than a weight enum or `None` for 'weights' are deprecated since 0.13 and may be removed in the future. The current behavior is equivalent to passing `weights=None`.
  warnings.warn(msg)
2024-02-09 21:50:41,117 - modelscope - INFO - load model done
2024-02-09 21:50:41,626 - modelscope - INFO - load facefusion models done
2024-02-09 21:50:41,626 - modelscope - INFO - init done
2024-02-09 21:50:41,633 - modelscope - WARNING - No preprocessor field found in cfg.
2024-02-09 21:50:41,633 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file.
2024-02-09 21:50:41,633 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': 'C:\\Users\\rouve\\.cache\\modelscope\\hub\\bubbliiiing\\cv_retinafce_recognition'}. trying to build by task and model information.
2024-02-09 21:50:41,633 - modelscope - WARNING - No preprocessor key ('face_recognition', 'face_recognition') found in PREPROCESSOR_MAP, skip building preprocessor.
2024-02-09 21:50:41,633 - modelscope - INFO - image face recognition model init done
2024-02-09 21:50:43,838 - modelscope - INFO - Use user-specified model revision: v2.0.2
2024-02-09 21:50:45,551 - modelscope - INFO - initiate model from C:\Users\rouve\.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface
2024-02-09 21:50:45,551 - modelscope - INFO - initiate model from location C:\Users\rouve\.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface.
2024-02-09 21:50:45,551 - modelscope - WARNING - No preprocessor field found in cfg.
2024-02-09 21:50:45,551 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file.
2024-02-09 21:50:45,551 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': 'C:\\Users\\rouve\\.cache\\modelscope\\hub\\damo\\cv_resnet50_face-detection_retinaface'}. trying to build by task and model information.
2024-02-09 21:50:45,551 - modelscope - WARNING - Find task: face-detection, model type: None. Insufficient information to build preprocessor, skip building preprocessor
2024-02-09 21:50:45,560 - modelscope - INFO - loading model from C:\Users\rouve\.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface\pytorch_model.pt
2024-02-09 21:50:45,789 - modelscope - INFO - load model done
2024-02-09 21:50:47,727 - modelscope - INFO - Use user-specified model revision: v1.0.0
2024-02-09 21:50:48,135 - modelscope - INFO - initiate model from C:\Users\rouve\.cache\modelscope\hub\damo\cv_u2net_salient-detection
2024-02-09 21:50:48,135 - modelscope - INFO - initiate model from location C:\Users\rouve\.cache\modelscope\hub\damo\cv_u2net_salient-detection.
2024-02-09 21:50:48,135 - modelscope - INFO - initialize model from C:\Users\rouve\.cache\modelscope\hub\damo\cv_u2net_salient-detection
2024-02-09 21:50:48,347 - modelscope - WARNING - No preprocessor field found in cfg.
2024-02-09 21:50:48,347 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file.
2024-02-09 21:50:48,347 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': 'C:\\Users\\rouve\\.cache\\modelscope\\hub\\damo\\cv_u2net_salient-detection'}. trying to build by task and model information.
2024-02-09 21:50:48,347 - modelscope - WARNING - No preprocessor key ('detection', 'semantic-segmentation') found in PREPROCESSOR_MAP, skip building preprocessor.
2024-02-09 21:50:50,840 - modelscope - INFO - Use user-specified model revision: v1.0.2
2024-02-09 21:50:51,390 - modelscope - WARNING - ('PIPELINES', 'skin-retouching-torch', 'skin-retouching-torch') not found in ast index file
2024-02-09 21:50:51,390 - modelscope - INFO - initiate model from C:\Users\rouve\.cache\modelscope\hub\damo\cv_unet_skin_retouching_torch
2024-02-09 21:50:51,390 - modelscope - INFO - initiate model from location C:\Users\rouve\.cache\modelscope\hub\damo\cv_unet_skin_retouching_torch.
2024-02-09 21:50:51,401 - modelscope - WARNING - No preprocessor field found in cfg.
2024-02-09 21:50:51,401 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file.
2024-02-09 21:50:51,401 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': 'C:\\Users\\rouve\\.cache\\modelscope\\hub\\damo\\cv_unet_skin_retouching_torch'}. trying to build by task and model information.
2024-02-09 21:50:51,401 - modelscope - WARNING - Find task: skin-retouching-torch, model type: None. Insufficient information to build preprocessor, skip building preprocessor
2024-02-09 21:50:53,970 - modelscope - INFO - Model revision not specified, use revision: v2.0.2
2024-02-09 21:50:55,781 - modelscope - INFO - initiate model from C:\Users\rouve\.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface
2024-02-09 21:50:55,784 - modelscope - INFO - initiate model from location C:\Users\rouve\.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface.
2024-02-09 21:50:55,784 - modelscope - WARNING - No preprocessor field found in cfg.
2024-02-09 21:50:55,784 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file.
2024-02-09 21:50:55,784 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': 'C:\\Users\\rouve\\.cache\\modelscope\\hub\\damo\\cv_resnet50_face-detection_retinaface'}. trying to build by task and model information.
2024-02-09 21:50:55,784 - modelscope - WARNING - Find task: face-detection, model type: None. Insufficient information to build preprocessor, skip building preprocessor
2024-02-09 21:50:55,784 - modelscope - INFO - loading model from C:\Users\rouve\.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface\pytorch_model.pt
2024-02-09 21:50:56,074 - modelscope - INFO - load model done
2024-02-09 21:50:56.6373780 [E:onnxruntime:Default, provider_bridge_ort.cc:1532 onnxruntime::TryGetProviderInfo_TensorRT] D:\a\_work\1\s\onnxruntime\core\session\provider_bridge_ort.cc:1209 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 126 "" when trying to load "C:\StableDiffusion\stable-diffusion-webui\venv\lib\site-packages\onnxruntime\capi\onnxruntime_providers_tensorrt.dll"

*************** EP Error ***************
EP Error D:\a\_work\1\s\onnxruntime\python\onnxruntime_pybind_state.cc:456 onnxruntime::python::RegisterTensorRTPluginsAsCustomOps Please install TensorRT libraries as mentioned in the GPU requirements page, make sure they're in the PATH or LD_LIBRARY_PATH, and that your GPU is supported.
 when using ['TensorrtExecutionProvider', 'CUDAExecutionProvider', 'CPUExecutionProvider']
Falling back to ['CUDAExecutionProvider', 'CPUExecutionProvider'] and retrying.
****************************************
2024-02-09 21:50:56.7598173 [W:onnxruntime:, graph.cc:3572 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_4__1660'. It is not used by any node and should be removed from the model.
2024-02-09 21:50:56.7626219 [W:onnxruntime:, graph.cc:3572 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'Shape__1662:0'. It is not used by any node and should be removed from the model.
2024-02-09 21:50:56.7664790 [W:onnxruntime:, graph.cc:3572 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'Sub__1664:0'. It is not used by any node and should be removed from the model.
2024-02-09 21:50:56.9620390 [W:onnxruntime:, cuda_execution_provider.cc:2319 onnxruntime::ConvTransposeNeedFallbackToCPU] Dropping the ConvTranspose node: cond_1/coarse/Conv2d_transpose/BiasAdd to CPU because it requires asymmetric padding which the CUDA EP currently does not support
2024-02-09 21:50:56.9664597 [W:onnxruntime:, cuda_execution_provider.cc:2426 onnxruntime::CUDAExecutionProvider::GetCapability] CUDA kernel not supported. Fallback to CPU execution provider for Op type: ConvTranspose node name: cond_1/coarse/Conv2d_transpose/BiasAdd
2024-02-09 21:50:56.9702515 [W:onnxruntime:, cuda_execution_provider.cc:2319 onnxruntime::ConvTransposeNeedFallbackToCPU] Dropping the ConvTranspose node: cond_1/coarse/Conv2d_transpose_1/BiasAdd to CPU because it requires asymmetric padding which the CUDA EP currently does not support
2024-02-09 21:50:56.9738058 [W:onnxruntime:, cuda_execution_provider.cc:2426 onnxruntime::CUDAExecutionProvider::GetCapability] CUDA kernel not supported. Fallback to CPU execution provider for Op type: ConvTranspose node name: cond_1/coarse/Conv2d_transpose_1/BiasAdd
2024-02-09 21:50:56.9782342 [W:onnxruntime:, cuda_execution_provider.cc:2319 onnxruntime::ConvTransposeNeedFallbackToCPU] Dropping the ConvTranspose node: cond_1/coarse/Conv2d_transpose_2/BiasAdd to CPU because it requires asymmetric padding which the CUDA EP currently does not support
2024-02-09 21:50:56.9821043 [W:onnxruntime:, cuda_execution_provider.cc:2426 onnxruntime::CUDAExecutionProvider::GetCapability] CUDA kernel not supported. Fallback to CPU execution provider for Op type: ConvTranspose node name: cond_1/coarse/Conv2d_transpose_2/BiasAdd
2024-02-09 21:50:56.9860065 [W:onnxruntime:, cuda_execution_provider.cc:2319 onnxruntime::ConvTransposeNeedFallbackToCPU] Dropping the ConvTranspose node: cond_1/coarse/Conv2d_transpose_3/BiasAdd to CPU because it requires asymmetric padding which the CUDA EP currently does not support
2024-02-09 21:50:56.9895475 [W:onnxruntime:, cuda_execution_provider.cc:2426 onnxruntime::CUDAExecutionProvider::GetCapability] CUDA kernel not supported. Fallback to CPU execution provider for Op type: ConvTranspose node name: cond_1/coarse/Conv2d_transpose_3/BiasAdd
2024-02-09 21:50:56.9940450 [W:onnxruntime:, cuda_execution_provider.cc:2319 onnxruntime::ConvTransposeNeedFallbackToCPU] Dropping the ConvTranspose node: cond_1/coarse/Conv2d_transpose_4/BiasAdd to CPU because it requires asymmetric padding which the CUDA EP currently does not support
2024-02-09 21:50:56.9975443 [W:onnxruntime:, cuda_execution_provider.cc:2426 onnxruntime::CUDAExecutionProvider::GetCapability] CUDA kernel not supported. Fallback to CPU execution provider for Op type: ConvTranspose node name: cond_1/coarse/Conv2d_transpose_4/BiasAdd
2024-02-09 21:50:57.0023801 [W:onnxruntime:, cuda_execution_provider.cc:2319 onnxruntime::ConvTransposeNeedFallbackToCPU] Dropping the ConvTranspose node: cond_1/refine/up_conv1/conv2d_transpose to CPU because it requires asymmetric padding which the CUDA EP currently does not support
2024-02-09 21:50:57.0060209 [W:onnxruntime:, cuda_execution_provider.cc:2426 onnxruntime::CUDAExecutionProvider::GetCapability] CUDA kernel not supported. Fallback to CPU execution provider for Op type: ConvTranspose node name: cond_1/refine/up_conv1/conv2d_transpose
2024-02-09 21:50:57.0094367 [W:onnxruntime:, cuda_execution_provider.cc:2319 onnxruntime::ConvTransposeNeedFallbackToCPU] Dropping the ConvTranspose node: cond_1/refine/up_conv2/conv2d_transpose to CPU because it requires asymmetric padding which the CUDA EP currently does not support
2024-02-09 21:50:57.0129304 [W:onnxruntime:, cuda_execution_provider.cc:2426 onnxruntime::CUDAExecutionProvider::GetCapability] CUDA kernel not supported. Fallback to CPU execution provider for Op type: ConvTranspose node name: cond_1/refine/up_conv2/conv2d_transpose
2024-02-09 21:50:57.0167536 [W:onnxruntime:, cuda_execution_provider.cc:2319 onnxruntime::ConvTransposeNeedFallbackToCPU] Dropping the ConvTranspose node: cond_1/refine/up_conv3/conv2d_transpose to CPU because it requires asymmetric padding which the CUDA EP currently does not support
2024-02-09 21:50:57.0203901 [W:onnxruntime:, cuda_execution_provider.cc:2426 onnxruntime::CUDAExecutionProvider::GetCapability] CUDA kernel not supported. Fallback to CPU execution provider for Op type: ConvTranspose node name: cond_1/refine/up_conv3/conv2d_transpose
2024-02-09 21:50:57.0247298 [W:onnxruntime:, cuda_execution_provider.cc:2319 onnxruntime::ConvTransposeNeedFallbackToCPU] Dropping the ConvTranspose node: cond_1/refine/up_conv4/conv2d_transpose to CPU because it requires asymmetric padding which the CUDA EP currently does not support
2024-02-09 21:50:57.0283651 [W:onnxruntime:, cuda_execution_provider.cc:2426 onnxruntime::CUDAExecutionProvider::GetCapability] CUDA kernel not supported. Fallback to CPU execution provider for Op type: ConvTranspose node name: cond_1/refine/up_conv4/conv2d_transpose
2024-02-09 21:50:57.0328473 [W:onnxruntime:, cuda_execution_provider.cc:2319 onnxruntime::ConvTransposeNeedFallbackToCPU] Dropping the ConvTranspose node: cond_1/refine/up_conv5/conv2d_transpose to CPU because it requires asymmetric padding which the CUDA EP currently does not support
2024-02-09 21:50:57.0348734 [W:onnxruntime:, cuda_execution_provider.cc:2426 onnxruntime::CUDAExecutionProvider::GetCapability] CUDA kernel not supported. Fallback to CPU execution provider for Op type: ConvTranspose node name: cond_1/refine/up_conv5/conv2d_transpose
2024-02-09 21:50:57.0439139 [W:onnxruntime:, cuda_execution_provider.cc:2319 onnxruntime::ConvTransposeNeedFallbackToCPU] Dropping the ConvTranspose node: detect/Conv2d_transpose/BiasAdd to CPU because it requires asymmetric padding which the CUDA EP currently does not support
2024-02-09 21:50:57.0474725 [W:onnxruntime:, cuda_execution_provider.cc:2426 onnxruntime::CUDAExecutionProvider::GetCapability] CUDA kernel not supported. Fallback to CPU execution provider for Op type: ConvTranspose node name: detect/Conv2d_transpose/BiasAdd
2024-02-09 21:50:57.0517569 [W:onnxruntime:, cuda_execution_provider.cc:2319 onnxruntime::ConvTransposeNeedFallbackToCPU] Dropping the ConvTranspose node: detect/Conv2d_transpose_1/BiasAdd to CPU because it requires asymmetric padding which the CUDA EP currently does not support
2024-02-09 21:50:57.0556907 [W:onnxruntime:, cuda_execution_provider.cc:2426 onnxruntime::CUDAExecutionProvider::GetCapability] CUDA kernel not supported. Fallback to CPU execution provider for Op type: ConvTranspose node name: detect/Conv2d_transpose_1/BiasAdd
2024-02-09 21:50:57.0592069 [W:onnxruntime:, cuda_execution_provider.cc:2319 onnxruntime::ConvTransposeNeedFallbackToCPU] Dropping the ConvTranspose node: detect/Conv2d_transpose_2/BiasAdd to CPU because it requires asymmetric padding which the CUDA EP currently does not support
2024-02-09 21:50:57.0626824 [W:onnxruntime:, cuda_execution_provider.cc:2426 onnxruntime::CUDAExecutionProvider::GetCapability] CUDA kernel not supported. Fallback to CPU execution provider for Op type: ConvTranspose node name: detect/Conv2d_transpose_2/BiasAdd
2024-02-09 21:50:57.0668965 [W:onnxruntime:, cuda_execution_provider.cc:2319 onnxruntime::ConvTransposeNeedFallbackToCPU] Dropping the ConvTranspose node: detect/Conv2d_transpose_3/BiasAdd to CPU because it requires asymmetric padding which the CUDA EP currently does not support
2024-02-09 21:50:57.0703296 [W:onnxruntime:, cuda_execution_provider.cc:2426 onnxruntime::CUDAExecutionProvider::GetCapability] CUDA kernel not supported. Fallback to CPU execution provider for Op type: ConvTranspose node name: detect/Conv2d_transpose_3/BiasAdd
2024-02-09 21:50:57.0734440 [W:onnxruntime:, cuda_execution_provider.cc:2319 onnxruntime::ConvTransposeNeedFallbackToCPU] Dropping the ConvTranspose node: detect/Conv2d_transpose_4/BiasAdd to CPU because it requires asymmetric padding which the CUDA EP currently does not support
2024-02-09 21:50:57.0768937 [W:onnxruntime:, cuda_execution_provider.cc:2426 onnxruntime::CUDAExecutionProvider::GetCapability] CUDA kernel not supported. Fallback to CPU execution provider for Op type: ConvTranspose node name: detect/Conv2d_transpose_4/BiasAdd
2024-02-09 21:50:57.3934791 [W:onnxruntime:, transformer_memcpy.cc:74 onnxruntime::MemcpyTransformer::ApplyImpl] 21 Memcpy nodes are added to the graph tf2onnx for CUDAExecutionProvider. It might have negative impact on performance (including unable to run CUDA graph). Set session_options.log_severity_level=1 to see the detail logs before this message.
2024-02-09 21:50:57.4087328 [W:onnxruntime:, transformer_memcpy.cc:74 onnxruntime::MemcpyTransformer::ApplyImpl] 29 Memcpy nodes are added to the graph tf2onnx__223 for CUDAExecutionProvider. It might have negative impact on performance (including unable to run CUDA graph). Set session_options.log_severity_level=1 to see the detail logs before this message.
2024-02-09 21:50:57.4136677 [W:onnxruntime:, transformer_memcpy.cc:74 onnxruntime::MemcpyTransformer::ApplyImpl] 5 Memcpy nodes are added to the graph tf2onnx__547 for CUDAExecutionProvider. It might have negative impact on performance (including unable to run CUDA graph). Set session_options.log_severity_level=1 to see the detail logs before this message.
2024-02-09 21:50:57.4187024 [W:onnxruntime:, transformer_memcpy.cc:74 onnxruntime::MemcpyTransformer::ApplyImpl] 5 Memcpy nodes are added to the graph tf2onnx__485 for CUDAExecutionProvider. It might have negative impact on performance (including unable to run CUDA graph). Set session_options.log_severity_level=1 to see the detail logs before this message.
2024-02-09 21:50:59,953 - modelscope - INFO - Use user-specified model revision: v1.0.0
2024-02-09 21:51:00,394 - modelscope - INFO - initiate model from C:\Users\rouve\.cache\modelscope\hub\damo\cv_gpen_image-portrait-enhancement
2024-02-09 21:51:00,394 - modelscope - INFO - initiate model from location C:\Users\rouve\.cache\modelscope\hub\damo\cv_gpen_image-portrait-enhancement.
2024-02-09 21:51:00,394 - modelscope - INFO - initialize model from C:\Users\rouve\.cache\modelscope\hub\damo\cv_gpen_image-portrait-enhancement
Loading ResNet ArcFace
2024-02-09 21:51:02,044 - modelscope - INFO - load face enhancer model done
2024-02-09 21:51:02,289 - modelscope - INFO - load face detector model done
2024-02-09 21:51:02,561 - modelscope - INFO - load sr model done
2024-02-09 21:51:03,269 - modelscope - INFO - load fqa model done
  0%|                                                                                           | 0/29 [00:00<?, ?it/s]2024-02-09 21:51:04,062 - modelscope - WARNING - task skin-retouching-torch input definition is missing
2024-02-09 21:51:07,394 - modelscope - WARNING - task skin-retouching-torch output keys are missing
2024-02-09 21:51:07,397 - modelscope - WARNING - task face_recognition input definition is missing
2024-02-09 21:51:07,573 - modelscope - INFO - model inference done
2024-02-09 21:51:07,573 - modelscope - WARNING - task face_recognition output keys are missing
  3%|██▊                                                                                | 1/29 [00:04<01:59,  4.28s/it]2024-02-09 21:51:08,302 - modelscope - INFO - model inference done
  7%|█████▋                                                                             | 2/29 [00:05<00:59,  2.19s/it]2024-02-09 21:51:08,893 - modelscope - INFO - model inference done
 10%|████████▌                                                                          | 3/29 [00:05<00:37,  1.46s/it]2024-02-09 21:51:09,253 - modelscope - INFO - model inference done
 14%|███████████▍                                                                       | 4/29 [00:05<00:25,  1.03s/it]2024-02-09 21:51:09,587 - modelscope - INFO - model inference done
 17%|██████████████▎                                                                    | 5/29 [00:06<00:18,  1.29it/s]2024-02-09 21:51:09,920 - modelscope - INFO - model inference done
 21%|█████████████████▏                                                                 | 6/29 [00:06<00:14,  1.60it/s]2024-02-09 21:51:10,247 - modelscope - INFO - model inference done
 24%|████████████████████                                                               | 7/29 [00:06<00:11,  1.89it/s]2024-02-09 21:51:10,564 - modelscope - INFO - model inference done
 28%|██████████████████████▉                                                            | 8/29 [00:07<00:09,  2.16it/s]2024-02-09 21:51:10,895 - modelscope - INFO - model inference done
 31%|█████████████████████████▊                                                         | 9/29 [00:07<00:08,  2.38it/s]2024-02-09 21:51:11,226 - modelscope - INFO - model inference done
 34%|████████████████████████████▎                                                     | 10/29 [00:07<00:07,  2.55it/s]2024-02-09 21:51:11,548 - modelscope - INFO - model inference done
 38%|███████████████████████████████                                                   | 11/29 [00:08<00:06,  2.70it/s]2024-02-09 21:51:12,250 - modelscope - INFO - model inference done
 41%|█████████████████████████████████▉                                                | 12/29 [00:08<00:08,  2.12it/s]2024-02-09 21:51:12,889 - modelscope - INFO - model inference done
 45%|████████████████████████████████████▊                                             | 13/29 [00:09<00:08,  1.91it/s]2024-02-09 21:51:13,539 - modelscope - INFO - model inference done
 48%|███████████████████████████████████████▌                                          | 14/29 [00:10<00:08,  1.78it/s]2024-02-09 21:51:14,079 - modelscope - INFO - model inference done
 52%|██████████████████████████████████████████▍                                       | 15/29 [00:10<00:07,  1.80it/s]2024-02-09 21:51:14,757 - modelscope - INFO - model inference done
 55%|█████████████████████████████████████████████▏                                    | 16/29 [00:11<00:07,  1.69it/s]2024-02-09 21:51:15,384 - modelscope - INFO - model inference done
 59%|████████████████████████████████████████████████                                  | 17/29 [00:12<00:07,  1.66it/s]2024-02-09 21:51:15,707 - modelscope - INFO - model inference done
 62%|██████████████████████████████████████████████████▉                               | 18/29 [00:12<00:05,  1.93it/s]2024-02-09 21:51:16,049 - modelscope - INFO - model inference done
 66%|█████████████████████████████████████████████████████▋                            | 19/29 [00:12<00:04,  2.15it/s]2024-02-09 21:51:16,382 - modelscope - INFO - model inference done
 69%|████████████████████████████████████████████████████████▌                         | 20/29 [00:13<00:03,  2.35it/s]2024-02-09 21:51:16,703 - modelscope - INFO - model inference done
 72%|███████████████████████████████████████████████████████████▍                      | 21/29 [00:13<00:03,  2.54it/s]2024-02-09 21:51:17,062 - modelscope - INFO - model inference done
 76%|██████████████████████████████████████████████████████████████▏                   | 22/29 [00:13<00:02,  2.61it/s]2024-02-09 21:51:17,708 - modelscope - INFO - model inference done
 79%|█████████████████████████████████████████████████████████████████                 | 23/29 [00:14<00:02,  2.16it/s]2024-02-09 21:51:18,387 - modelscope - INFO - model inference done
 83%|███████████████████████████████████████████████████████████████████▊              | 24/29 [00:15<00:02,  1.90it/s]2024-02-09 21:51:18,954 - modelscope - INFO - model inference done
 86%|██████████████████████████████████████████████████████████████████████▋           | 25/29 [00:15<00:02,  1.85it/s]2024-02-09 21:51:19,384 - modelscope - INFO - model inference done
 90%|█████████████████████████████████████████████████████████████████████████▌        | 26/29 [00:16<00:01,  1.97it/s]2024-02-09 21:51:19,783 - modelscope - INFO - model inference done
 93%|████████████████████████████████████████████████████████████████████████████▎     | 27/29 [00:16<00:00,  2.11it/s]2024-02-09 21:51:20,281 - modelscope - INFO - model inference done
 97%|███████████████████████████████████████████████████████████████████████████████▏  | 28/29 [00:16<00:00,  2.08it/s]2024-02-09 21:51:20,933 - modelscope - INFO - model inference done
100%|██████████████████████████████████████████████████████████████████████████████████| 29/29 [00:17<00:00,  1.64it/s]
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\26.jpg total scores:  0.8379745012450162 face angles 0.9992344663783325
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\28.jpg total scores:  0.8231718304400375 face angles 0.9965455335161503
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\27.jpg total scores:  0.8231718304400375 face angles 0.9965455335161503
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\24.jpg total scores:  0.8116116867317323 face angles 0.9889489249289991
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\3.jpg total scores:  0.8069717264615991 face angles 0.9905218539598603
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\4.jpg total scores:  0.8004007304618215 face angles 0.9803867786361956
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\2.jpg total scores:  0.7998649038136036 face angles 0.9825495317708355
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\8.jpg total scores:  0.7977301301648938 face angles 0.9843391076201213
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\25.jpg total scores:  0.7940179380343054 face angles 0.9750698729217478
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\7.jpg total scores:  0.7932173214076164 face angles 0.9856992154980644
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\18.jpg total scores:  0.78968567330434 face angles 0.9944685059570518
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\5.jpg total scores:  0.782194271509095 face angles 0.9645314949845136
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\6.jpg total scores:  0.7808738124354017 face angles 0.9556229064322057
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\17.jpg total scores:  0.7727809562485326 face angles 0.9677815545107208
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\0.jpg total scores:  0.7559819329994772 face angles 0.9718197612261629
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\12.jpg total scores:  0.7463847002569186 face angles 0.944408310811313
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\1.jpg total scores:  0.7365731146907267 face angles 0.9043248605976103
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\11.jpg total scores:  0.7334710662106577 face angles 0.9349080228173631
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\10.jpg total scores:  0.7234463846071374 face angles 0.96102820703347
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\20.jpg total scores:  0.7173664266752081 face angles 0.9032731135429992
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\19.jpg total scores:  0.7102728837478712 face angles 0.8925610650495941
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\21.jpg total scores:  0.7102359853488575 face angles 0.8976919521811817
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\14.jpg total scores:  0.7073620978061506 face angles 0.854013159616261
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\13.jpg total scores:  0.7061670213902868 face angles 0.8498066589415934
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\22.jpg total scores:  0.7049467099666177 face angles 0.8826350580139416
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\15.jpg total scores:  0.7022585153881901 face angles 0.8451887351409395
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\23.jpg total scores:  0.6737064745564814 face angles 0.857136349676567
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\16.jpg total scores:  0.6599276877546729 face angles 0.8147706846819572
selected paths: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\original_backup\9.jpg total scores:  0.592415333544167 face angles 0.8233117203044427
jpg: 26.jpg face_id_scores 0.8379745012450162
jpg: 13.jpg face_id_scores 0.7061670213902868
jpg: 15.jpg face_id_scores 0.7022585153881901
jpg: 14.jpg face_id_scores 0.7073620978061506
jpg: 28.jpg face_id_scores 0.8231718304400375
jpg: 27.jpg face_id_scores 0.8231718304400375
jpg: 24.jpg face_id_scores 0.8116116867317323
jpg: 6.jpg face_id_scores 0.7808738124354017
jpg: 4.jpg face_id_scores 0.8004007304618215
jpg: 3.jpg face_id_scores 0.8069717264615991
jpg: 1.jpg face_id_scores 0.7365731146907267
jpg: 25.jpg face_id_scores 0.7940179380343054
jpg: 2.jpg face_id_scores 0.7998649038136036
jpg: 5.jpg face_id_scores 0.782194271509095
jpg: 8.jpg face_id_scores 0.7977301301648938
15it [00:02,  7.03it/s]
save processed image to C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\processed_images\train\0.jpg
save processed image to C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\processed_images\train\1.jpg
save processed image to C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\processed_images\train\2.jpg
save processed image to C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\processed_images\train\3.jpg
save processed image to C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\processed_images\train\4.jpg
save processed image to C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\processed_images\train\5.jpg
save processed image to C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\processed_images\train\6.jpg
save processed image to C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\processed_images\train\7.jpg
save processed image to C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\processed_images\train\8.jpg
save processed image to C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\processed_images\train\9.jpg
save processed image to C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\processed_images\train\10.jpg
save processed image to C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\processed_images\train\11.jpg
save processed image to C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\processed_images\train\12.jpg
save processed image to C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\processed_images\train\13.jpg
save processed image to C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-user-id-infos\Jille\processed_images\train\14.jpg
2024-02-09 21:51:23,610 - EasyPhoto - train_file_path : C:\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-EasyPhoto\scripts\train_kohya/train_lora_sd_XL.py
2024-02-09 21:51:23,610 - EasyPhoto - cache_log_file_path: C:\StableDiffusion\stable-diffusion-webui\outputs/easyphoto-tmp/train_kohya_log.txt
2024-02-09 21:51:25.398967: I tensorflow/core/util/port.cc:113] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable `TF_ENABLE_ONEDNN_OPTS=0`.
WARNING:tensorflow:From C:\StableDiffusion\stable-diffusion-webui\venv\lib\site-packages\keras\src\losses.py:2976: The name tf.losses.sparse_softmax_cross_entropy is deprecated. Please use tf.compat.v1.losses.sparse_softmax_cross_entropy instead.

The following values were not passed to `accelerate launch` and had defaults used instead:
        `--num_processes` was set to a value of `1`
        `--num_machines` was set to a value of `1`
        `--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
2024-02-09 21:51:29.676583: I tensorflow/core/util/port.cc:113] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable `TF_ENABLE_ONEDNN_OPTS=0`.
WARNING:tensorflow:From C:\StableDiffusion\stable-diffusion-webui\venv\lib\site-packages\keras\src\losses.py:2976: The name tf.losses.sparse_softmax_cross_entropy is deprecated. Please use tf.compat.v1.losses.sparse_softmax_cross_entropy instead.

A matching Triton is not available, some optimizations will not be enabled.
Error caught was: No module named 'triton'
02/09/2024 21:51:32 - INFO - __main__ - Distributed environment: NO
Num processes: 1
Process index: 0
Local process index: 0
Device: cuda

Mixed precision type: fp16

Traceback (most recent call last):
  File "C:\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-EasyPhoto\scripts\train_kohya\train_lora_sd_XL.py", line 1156, in <module>
    main()
  File "C:\StableDiffusion\stable-diffusion-webui\extensions\sd-webui-EasyPhoto\scripts\train_kohya\train_lora_sd_XL.py", line 577, in main
    pipeline = download_from_original_stable_diffusion_ckpt(
  File "C:\StableDiffusion\stable-diffusion-webui\venv\lib\site-packages\diffusers\pipelines\stable_diffusion\convert_from_ckpt.py", line 1329, in download_from_original_stable_diffusion_ckpt
    and "cond_stage_config" in original_config["model"]["params"]
TypeError: string indices must be integers
Traceback (most recent call last):
  File "C:\Users\rouve\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "C:\Users\rouve\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "C:\StableDiffusion\stable-diffusion-webui\venv\lib\site-packages\accelerate\commands\launch.py", line 989, in <module>
    main()
  File "C:\StableDiffusion\stable-diffusion-webui\venv\lib\site-packages\accelerate\commands\launch.py", line 985, in main
    launch_command(args)
  File "C:\StableDiffusion\stable-diffusion-webui\venv\lib\site-packages\accelerate\commands\launch.py", line 979, in launch_command
    simple_launcher(args)
  File "C:\StableDiffusion\stable-diffusion-webui\venv\lib\site-packages\accelerate\commands\launch.py", line 628, in simple_launcher
    raise subprocess.CalledProcessError(returncode=process.returncode, cmd=cmd)
subprocess.CalledProcessError: Command '['C:\\StableDiffusion\\stable-diffusion-webui\\venv\\Scripts\\python.exe', 'C:\\StableDiffusion\\stable-diffusion-webui\\extensions\\sd-webui-EasyPhoto\\scripts\\train_kohya/train_lora_sd_XL.py', '--pretrained_model_name_or_path=extensions\\sd-webui-EasyPhoto\\models\\stable-diffusion-xl\\stabilityai_stable_diffusion_xl_base_1.0', '--pretrained_model_ckpt=models\\Stable-diffusion\\newrealityxlAllInOne_21.safetensors', '--train_data_dir=outputs\\easyphoto-user-id-infos\\Jille\\processed_images', '--caption_column=text', '--resolution=1024', '--random_flip', '--train_batch_size=1', '--gradient_accumulation_steps=4', '--dataloader_num_workers=0', '--max_train_steps=600', '--checkpointing_steps=100', '--learning_rate=0.0001', '--lr_scheduler=constant', '--lr_warmup_steps=0', '--train_text_encoder', '--seed=566250', '--rank=32', '--network_alpha=16', '--validation_prompt=easyphoto_face, easyphoto, 1person', '--validation_steps=100', '--output_dir=outputs\\easyphoto-user-id-infos\\Jille\\user_weights', '--logging_dir=outputs\\easyphoto-user-id-infos\\Jille\\user_weights', '--enable_xformers_memory_efficient_attention', '--mixed_precision=fp16', '--template_dir=extensions\\sd-webui-EasyPhoto\\models\\training_templates', '--template_mask', '--merge_best_lora_based_face_id', '--merge_best_lora_name=Jille', '--cache_log_file=C:\\StableDiffusion\\stable-diffusion-webui\\outputs/easyphoto-tmp/train_kohya_log.txt', '--original_config=C:\\StableDiffusion\\stable-diffusion-webui\\repositories\\generative-models\\configs\\inference\\sd_xl_base.yaml', '--pretrained_vae_model_name_or_path=C:\\StableDiffusion\\stable-diffusion-webui\\extensions\\sd-webui-EasyPhoto\\models/stable-diffusion-xl\\madebyollin_sdxl_vae_fp16_fix']' returned non-zero exit status 1.
2024-02-09 21:51:34,477 - EasyPhoto - Error executing the command: Command '['C:\\StableDiffusion\\stable-diffusion-webui\\venv\\Scripts\\python.exe', '-m', 'accelerate.commands.launch', '--mixed_precision=fp16', '--main_process_port=3456', 'C:\\StableDiffusion\\stable-diffusion-webui\\extensions\\sd-webui-EasyPhoto\\scripts\\train_kohya/train_lora_sd_XL.py', '--pretrained_model_name_or_path=extensions\\sd-webui-EasyPhoto\\models\\stable-diffusion-xl\\stabilityai_stable_diffusion_xl_base_1.0', '--pretrained_model_ckpt=models\\Stable-diffusion\\newrealityxlAllInOne_21.safetensors', '--train_data_dir=outputs\\easyphoto-user-id-infos\\Jille\\processed_images', '--caption_column=text', '--resolution=1024', '--random_flip', '--train_batch_size=1', '--gradient_accumulation_steps=4', '--dataloader_num_workers=0', '--max_train_steps=600', '--checkpointing_steps=100', '--learning_rate=0.0001', '--lr_scheduler=constant', '--lr_warmup_steps=0', '--train_text_encoder', '--seed=566250', '--rank=32', '--network_alpha=16', '--validation_prompt=easyphoto_face, easyphoto, 1person', '--validation_steps=100', '--output_dir=outputs\\easyphoto-user-id-infos\\Jille\\user_weights', '--logging_dir=outputs\\easyphoto-user-id-infos\\Jille\\user_weights', '--enable_xformers_memory_efficient_attention', '--mixed_precision=fp16', '--template_dir=extensions\\sd-webui-EasyPhoto\\models\\training_templates', '--template_mask', '--merge_best_lora_based_face_id', '--merge_best_lora_name=Jille', '--cache_log_file=C:\\StableDiffusion\\stable-diffusion-webui\\outputs/easyphoto-tmp/train_kohya_log.txt', '--original_config=C:\\StableDiffusion\\stable-diffusion-webui\\repositories\\generative-models\\configs\\inference\\sd_xl_base.yaml', '--pretrained_vae_model_name_or_path=C:\\StableDiffusion\\stable-diffusion-webui\\extensions\\sd-webui-EasyPhoto\\models/stable-diffusion-xl\\madebyollin_sdxl_vae_fp16_fix']' returned non-zero exit status 1.
Applying attention optimization: xformers... done.

Additional information

No response

aigc-apps / sd-webui-EasyPhoto

[Bug]: Training not working #389

Is there an existing issue for this?

Is EasyPhoto the latest version?

What happened?

Steps to reproduce the problem

What should have happened?

Commit where the problem happens

What browsers do you use to access the UI ?

Command Line Arguments

List of enabled extensions

Console logs

Additional information