aigc-apps / sd-webui-EasyPhoto

📷 EasyPhoto | Your Smart AI Photo Generator.
Apache License 2.0
4.98k stars 399 forks source link

Failed to obtain Lora after training, please check the training process. #360

Open dxh8286239 opened 10 months ago

dxh8286239 commented 10 months ago

Python 3.10.11 (tags/v3.10.11:7d4cc5a, Apr 5 2023, 00:38:17) [MSC v.1929 64 bit (AMD64)] Version: v1.6.0 Commit hash: 5ef669de080814067961f28357256e8fe27544f4 is_installed check for tensorflow-cpu failed as 'spec is None' Installing requirements for easyphoto-webui Installing requirements for tensorflow is_installed check for imageio[pyav] failed as 'spec is None' Installing requirements for easyphoto-webui Installing requirements for imageio[pyav] Installing requirements for easyphoto-webui Installing requirements for invisible-watermark Launching Web UI with arguments: --medvram --theme dark --xformers --precision full --no-half --no-half-vae --api --autolaunch Tag Autocomplete: Could not locate model-keyword extension, Lora trigger word completion will be limited to those added through the extra networks menu. 2024-01-02 18:17:25,317 - modelscope - INFO - PyTorch version 2.0.1+cu118 Found. 2024-01-02 18:17:25,320 - modelscope - INFO - TensorFlow version 2.15.0 Found. 2024-01-02 18:17:25,320 - modelscope - INFO - Loading ast index from G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\ast_indexer 2024-01-02 18:17:25,393 - modelscope - INFO - Loading done! Current index file version is 1.9.3, with md5 9f2009ec6ab21081fddfc5975e735b86 and a total number of 943 components indexed 2024-01-02 18:17:26,830 - ControlNet - INFO - ControlNet v1.1.406 ControlNet preprocessor location: G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\extensions\sd-webui-controlnet\annotator\downloads 2024-01-02 18:17:27,036 - ControlNet - INFO - ControlNet v1.1.406 sd-webui-prompt-all-in-one background API service started successfully. Loading weights [7f96a1a9ca] from G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\models\Stable-diffusion\anything-v5-PrtRE.safetensors AnimateDiffScript init AnimateDiffScript init Creating model from config: G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\configs\v1-inference.yaml Running on local URL: http://127.0.0.1:7860

To create a public link, set share=True in launch(). Startup time: 34.2s (prepare environment: 17.5s, import torch: 8.6s, import gradio: 0.9s, setup paths: 0.6s, initialize shared: 0.2s, other imports: 0.5s, setup codeformer: 0.1s, load scripts: 4.0s, create ui: 1.2s, gradio launch: 0.3s, app_started_callback: 0.1s). Loading VAE weights specified in settings: G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\models\VAE\animevae.pt Applying attention optimization: xformers... done. Model loaded in 7.3s (load weights from disk: 0.9s, create model: 0.8s, apply weights to model: 0.6s, apply float(): 0.6s, load VAE: 2.4s, calculate empty prompt: 2.0s). Unloaded weights 0.0s. 2024-01-02 18:18:24,195 - EasyPhoto - G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\models\Stable-diffusion/Chilloutmix-Ni-pruned-fp16-fix.safetensors : Hash match 2024-01-02 18:18:24,961 - EasyPhoto - G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\models\ControlNet/control_v11p_sd15_canny.pth : Hash match 2024-01-02 18:18:25,620 - EasyPhoto - G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\models\ControlNet/control_sd15_random_color.pth : Hash match 2024-01-02 18:18:26,284 - EasyPhoto - G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\models\VAE/vae-ft-mse-840000-ema-pruned.ckpt : Hash match 2024-01-02 18:18:26,923 - EasyPhoto - G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\models\ControlNet/control_v11p_sd15_openpose.pth : Hash match 2024-01-02 18:18:27,590 - EasyPhoto - G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\models\ControlNet/control_v11f1e_sd15_tile.pth : Hash match 2024-01-02 18:18:28,278 - EasyPhoto - G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\models\Lora/FilmVelvia3.safetensors : Hash match 2024-01-02 18:18:28,917 - EasyPhoto - G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\extensions\sd-webui-controlnet\annotator/downloads/openpose\body_pose_model.pth : Hash match 2024-01-02 18:18:29,592 - EasyPhoto - G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\extensions\sd-webui-controlnet\annotator/downloads/openpose\facenet.pth : Hash match 2024-01-02 18:18:30,281 - EasyPhoto - G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\extensions\sd-webui-controlnet\annotator/downloads/openpose\hand_pose_model.pth : Hash match 2024-01-02 18:18:30,955 - EasyPhoto - G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\extensions\sd-webui-EasyPhoto\models\face_skin.pth : Hash match 2024-01-02 18:18:31,614 - EasyPhoto - G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\extensions\sd-webui-EasyPhoto\models\face_landmarks.pth : Hash match 2024-01-02 18:18:32,238 - EasyPhoto - G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\extensions\sd-webui-EasyPhoto\models\makeup_transfer.pth : Hash match 2024-01-02 18:18:32,895 - EasyPhoto - G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\extensions\sd-webui-EasyPhoto\models\training_templates\1.jpg : Hash match 2024-01-02 18:18:33,560 - EasyPhoto - G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\extensions\sd-webui-EasyPhoto\models\training_templates\2.jpg : Hash match 2024-01-02 18:18:34,205 - EasyPhoto - G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\extensions\sd-webui-EasyPhoto\models\training_templates\3.jpg : Hash match 2024-01-02 18:18:34,843 - EasyPhoto - G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\extensions\sd-webui-EasyPhoto\models\training_templates\4.jpg : Hash match Loading weights [59ffe2243a] from G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\models\Stable-diffusion\Chilloutmix-Ni-pruned-fp16-fix.safetensors 2024-01-02 18:18:38,544 - modelscope - INFO - PyTorch version 2.0.1+cu118 Found. 2024-01-02 18:18:38,548 - modelscope - INFO - TensorFlow version 2.15.0 Found. 2024-01-02 18:18:38,548 - modelscope - INFO - Loading ast index from G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\ast_indexer 2024-01-02 18:18:38,620 - modelscope - INFO - Loading done! Current index file version is 1.9.3, with md5 9f2009ec6ab21081fddfc5975e735b86 and a total number of 943 components indexed 2024-01-02 18:18:39,934 - modelscope - INFO - Use user-specified model revision: v1.0.3 2024-01-02 18:18:40,438 - modelscope - WARNING - ('PIPELINES', 'face_recognition', 'face_recognition') not found in ast index file 2024-01-02 18:18:40,438 - modelscope - INFO - initiate model from G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\bubbliiiing\cv_retinafce_recognition 2024-01-02 18:18:40,439 - modelscope - INFO - initiate model from location G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\bubbliiiing\cv_retinafce_recognition. 2024-01-02 18:18:40,513 - modelscope - INFO - initialize model from G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\bubbliiiing\cv_retinafce_recognition 2024-01-02 18:18:40,610 - modelscope - WARNING - ('MODELS', 'face_recognition', 'face_recognition') not found in ast index file 2024-01-02 18:18:41,171 - modelscope - INFO - Model revision not specified, use revision: v2.0.2 2024-01-02 18:18:43,441 - modelscope - INFO - initiate model from G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface 2024-01-02 18:18:43,441 - modelscope - INFO - initiate model from location G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface. 2024-01-02 18:18:43,667 - modelscope - WARNING - No preprocessor field found in cfg. 2024-01-02 18:18:43,667 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file. 2024-01-02 18:18:43,667 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': 'G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface'}. trying to build by task and model information. 2024-01-02 18:18:43,667 - modelscope - WARNING - Find task: face-detection, model type: None. Insufficient information to build preprocessor, skip building preprocessor 2024-01-02 18:18:43,742 - modelscope - INFO - loading model from G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface\pytorch_model.pt 2024-01-02 18:18:44,254 - modelscope - INFO - load model done 2024-01-02 18:18:45,114 - modelscope - INFO - load facefusion models done 2024-01-02 18:18:45,114 - modelscope - INFO - init done 2024-01-02 18:18:45,295 - modelscope - WARNING - No preprocessor field found in cfg. 2024-01-02 18:18:45,295 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file. 2024-01-02 18:18:45,295 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': 'G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\.cache\modelscope\hub\bubbliiiing\cv_retinafce_recognition'}. trying to build by task and model information. 2024-01-02 18:18:45,295 - modelscope - WARNING - No preprocessor key ('face_recognition', 'face_recognition') found in PREPROCESSOR_MAP, skip building preprocessor. 2024-01-02 18:18:45,379 - modelscope - INFO - image face recognition model init done 2024-01-02 18:18:46,058 - modelscope - INFO - Use user-specified model revision: v2.0.2 2024-01-02 18:18:48,452 - modelscope - INFO - initiate model from G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface 2024-01-02 18:18:48,452 - modelscope - INFO - initiate model from location G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface. 2024-01-02 18:18:48,678 - modelscope - WARNING - No preprocessor field found in cfg. 2024-01-02 18:18:48,678 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file. 2024-01-02 18:18:48,678 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': 'G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface'}. trying to build by task and model information. 2024-01-02 18:18:48,678 - modelscope - WARNING - Find task: face-detection, model type: None. Insufficient information to build preprocessor, skip building preprocessor 2024-01-02 18:18:48,753 - modelscope - INFO - loading model from G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface\pytorch_model.pt 2024-01-02 18:18:49,210 - modelscope - INFO - load model done 2024-01-02 18:18:49,703 - modelscope - INFO - Use user-specified model revision: v1.0.0 2024-01-02 18:18:50,053 - modelscope - INFO - initiate model from G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\damo\cv_u2net_salient-detection 2024-01-02 18:18:50,053 - modelscope - INFO - initiate model from location G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\damo\cv_u2net_salient-detection. 2024-01-02 18:18:50,127 - modelscope - INFO - initialize model from G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\damo\cv_u2net_salient-detection 2024-01-02 18:18:50,672 - modelscope - WARNING - No preprocessor field found in cfg. 2024-01-02 18:18:50,673 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file. 2024-01-02 18:18:50,673 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': 'G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\.cache\modelscope\hub\damo\cv_u2net_salient-detection'}. trying to build by task and model information. 2024-01-02 18:18:50,673 - modelscope - WARNING - No preprocessor key ('detection', 'semantic-segmentation') found in PREPROCESSOR_MAP, skip building preprocessor. 2024-01-02 18:18:51,243 - modelscope - INFO - Use user-specified model revision: v1.0.2 2024-01-02 18:18:51,763 - modelscope - WARNING - ('PIPELINES', 'skin-retouching-torch', 'skin-retouching-torch') not found in ast index file 2024-01-02 18:18:51,763 - modelscope - INFO - initiate model from G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\damo\cv_unet_skin_retouching_torch 2024-01-02 18:18:51,764 - modelscope - INFO - initiate model from location G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\damo\cv_unet_skin_retouching_torch. 2024-01-02 18:18:51,989 - modelscope - WARNING - No preprocessor field found in cfg. 2024-01-02 18:18:51,989 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file. 2024-01-02 18:18:51,989 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': 'G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\.cache\modelscope\hub\damo\cv_unet_skin_retouching_torch'}. trying to build by task and model information. 2024-01-02 18:18:51,989 - modelscope - WARNING - Find task: skin-retouching-torch, model type: None. Insufficient information to build preprocessor, skip building preprocessor 2024-01-02 18:18:52,810 - modelscope - INFO - Model revision not specified, use revision: v2.0.2 2024-01-02 18:18:54,694 - modelscope - INFO - initiate model from G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface 2024-01-02 18:18:54,694 - modelscope - INFO - initiate model from location G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface. 2024-01-02 18:18:54,915 - modelscope - WARNING - No preprocessor field found in cfg. 2024-01-02 18:18:54,915 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file. 2024-01-02 18:18:54,915 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': 'G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface'}. trying to build by task and model information. 2024-01-02 18:18:54,916 - modelscope - WARNING - Find task: face-detection, model type: None. Insufficient information to build preprocessor, skip building preprocessor 2024-01-02 18:18:54,993 - modelscope - INFO - loading model from G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface\pytorch_model.pt 2024-01-02 18:18:55,421 - modelscope - INFO - load model done 2024-01-02 18:18:56,936 - modelscope - INFO - Use user-specified model revision: v1.0.0 2024-01-02 18:18:57,428 - modelscope - INFO - initiate model from G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\damo\cv_gpen_image-portrait-enhancement 2024-01-02 18:18:57,428 - modelscope - INFO - initiate model from location G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\damo\cv_gpen_image-portrait-enhancement. 2024-01-02 18:18:57,502 - modelscope - INFO - initialize model from G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\damo\cv_gpen_image-portrait-enhancement Loading ResNet ArcFace 2024-01-02 18:19:00,044 - modelscope - INFO - load face enhancer model done 2024-01-02 18:19:00,538 - modelscope - INFO - load face detector model done 2024-01-02 18:19:00,850 - modelscope - INFO - load sr model done 2024-01-02 18:19:01,739 - modelscope - INFO - load fqa model done ERROR:root:Photo skin_retouching error, error info: 'NoneType' object is not callable 2024-01-02 18:19:05,809 - modelscope - WARNING - task face_recognition input definition is missing 2024-01-02 18:19:06,142 - modelscope - INFO - model inference done 2024-01-02 18:19:06,142 - modelscope - WARNING - task face_recognition output keys are missing ERROR:root:Photo skin_retouching error, error info: 'NoneType' object is not callable 2024-01-02 18:19:06,519 - modelscope - INFO - model inference done ERROR:root:Photo skin_retouching error, error info: 'NoneType' object is not callable 2024-01-02 18:19:08,106 - modelscope - INFO - model inference done ERROR:root:Photo skin_retouching error, error info: 'NoneType' object is not callable 2024-01-02 18:19:08,534 - modelscope - INFO - model inference done ERROR:root:Photo skin_retouching error, error info: 'NoneType' object is not callable 2024-01-02 18:19:08,952 - modelscope - INFO - model inference done ERROR:root:Photo skin_retouching error, error info: 'NoneType' object is not callable 2024-01-02 18:19:09,377 - modelscope - INFO - model inference done ERROR:root:Photo skin_retouching error, error info: 'NoneType' object is not callable 2024-01-02 18:19:09,800 - modelscope - INFO - model inference done ERROR:root:Photo skin_retouching error, error info: 'NoneType' object is not callable 2024-01-02 18:19:09,912 - modelscope - INFO - model inference done selected paths: G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\outputs/easyphoto-user-id-infos\zjz01\original_backup\4.jpg total scores: 0.7956722275017799 face angles 0.9941124623776384 selected paths: G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\outputs/easyphoto-user-id-infos\zjz01\original_backup\5.jpg total scores: 0.7816950377219372 face angles 0.9762583776107918 selected paths: G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\outputs/easyphoto-user-id-infos\zjz01\original_backup\2.jpg total scores: 0.7690628875893735 face angles 0.9827681975562925 selected paths: G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\outputs/easyphoto-user-id-infos\zjz01\original_backup\1.jpg total scores: 0.7643805766350197 face angles 0.9996851503533405 selected paths: G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\outputs/easyphoto-user-id-infos\zjz01\original_backup\7.jpg total scores: 0.7608450757102984 face angles 0.9973636326061834 selected paths: G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\outputs/easyphoto-user-id-infos\zjz01\original_backup\0.jpg total scores: 0.7604795822728029 face angles 0.9988849279944916 selected paths: G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\outputs/easyphoto-user-id-infos\zjz01\original_backup\3.jpg total scores: 0.7550114113792332 face angles 0.9770806277830567 selected paths: G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\outputs/easyphoto-user-id-infos\zjz01\original_backup\6.jpg total scores: 0.7133341383199893 face angles 0.9686359732726513 jpg: 5.jpg face_id_scores 0.7816950377219372 jpg: 4.jpg face_id_scores 0.7956722275017799 jpg: 2.jpg face_id_scores 0.7690628875893735 jpg: 3.jpg face_id_scores 0.7550114113792332 jpg: 1.jpg face_id_scores 0.7643805766350197 jpg: 7.jpg face_id_scores 0.7608450757102984 jpg: 0.jpg face_id_scores 0.7604795822728029 jpg: 6.jpg face_id_scores 0.7133341383199893 save processed image to G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\outputs/easyphoto-user-id-infos\zjz01\processed_images\train\0.jpg save processed image to G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\outputs/easyphoto-user-id-infos\zjz01\processed_images\train\1.jpg save processed image to G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\outputs/easyphoto-user-id-infos\zjz01\processed_images\train\2.jpg save processed image to G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\outputs/easyphoto-user-id-infos\zjz01\processed_images\train\3.jpg save processed image to G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\outputs/easyphoto-user-id-infos\zjz01\processed_images\train\4.jpg save processed image to G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\outputs/easyphoto-user-id-infos\zjz01\processed_images\train\5.jpg save processed image to G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\outputs/easyphoto-user-id-infos\zjz01\processed_images\train\6.jpg save processed image to G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\outputs/easyphoto-user-id-infos\zjz01\processed_images\train\7.jpg train_file_path : G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\extensions\sd-webui-EasyPhoto\scripts\train_kohya/train_lora.py cache_log_file_path: G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\outputs/easyphoto-tmp/train_kohya_log.txt The following values were not passed to accelerate launch and had defaults used instead: --num_processes was set to a value of 1 --num_machines was set to a value of 1 --dynamo_backend was set to a value of 'no' To avoid this warning pass in values for each of the problematic parameters or run accelerate config. 2024-01-02 18:19:44,688 - modelscope - INFO - PyTorch version 2.0.1+cu118 Found. 2024-01-02 18:19:44,691 - modelscope - INFO - TensorFlow version 2.15.0 Found. 2024-01-02 18:19:44,691 - modelscope - INFO - Loading ast index from G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\ast_indexer 2024-01-02 18:19:44,764 - modelscope - INFO - Loading done! Current index file version is 1.9.3, with md5 9f2009ec6ab21081fddfc5975e735b86 and a total number of 943 components indexed 01/02/2024 18:19:45 - INFO - main - Distributed environment: NO Num processes: 1 Process index: 0 Local process index: 0 Device: cuda

Mixed precision type: fp16 {'thresholding', 'timestep_spacing', 'clip_sample_range', 'variance_type', 'prediction_type', 'dynamic_thresholding_ratio', 'sample_max_value'} was not found in config. Values will be initialized to default values. UNet2DConditionModel: 64, 8, 768, False, False loading u-net: loading vae: loading text encoder: create LoRA network. base dim (rank): 128, alpha: 64 neuron dropout: p=None, rank dropout: p=None, module dropout: p=None create LoRA for Text Encoder: create LoRA for Text Encoder: 72 modules. create LoRA for U-Net: 192 modules. enable LoRA for text encoder enable LoRA for U-Net Downloading and preparing dataset imagefolder/default to G:/stable diffusion/sd-webui-aki/sd-webui-aki-v4.4/.cache/huggingface/datasets/imagefolder/default-9fcdd5e5f89dbcab/0.0.0/37fbb85cc714a338bea574ac6c7d0b5be5aff46c1862c1989b20e0771199e93f... Dataset imagefolder downloaded and prepared to G:/stable diffusion/sd-webui-aki/sd-webui-aki-v4.4/.cache/huggingface/datasets/imagefolder/default-9fcdd5e5f89dbcab/0.0.0/37fbb85cc714a338bea574ac6c7d0b5be5aff46c1862c1989b20e0771199e93f. Subsequent calls will reuse this data. 01/02/2024 18:19:56 - INFO - main - Running training 01/02/2024 18:19:56 - INFO - main - Num examples = 8 01/02/2024 18:19:56 - INFO - main - Num Epochs = 400 01/02/2024 18:19:56 - INFO - main - Instantaneous batch size per device = 1 01/02/2024 18:19:56 - INFO - main - Total train batch size (w. parallel, distributed & accumulation) = 4 01/02/2024 18:19:56 - INFO - main - Gradient Accumulation steps = 4 01/02/2024 18:19:56 - INFO - main - Total optimization steps = 800 2024-01-02 18:19:56,685 - modelscope - INFO - Model revision not specified, use revision: v2.0.2 2024-01-02 18:19:58,920 - modelscope - INFO - initiate model from G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface 2024-01-02 18:19:58,920 - modelscope - INFO - initiate model from location G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface. 2024-01-02 18:19:59,148 - modelscope - WARNING - No preprocessor field found in cfg. 2024-01-02 18:19:59,148 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file. 2024-01-02 18:19:59,148 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': 'G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface'}. trying to build by task and model information. 2024-01-02 18:19:59,149 - modelscope - WARNING - Find task: face-detection, model type: None. Insufficient information to build preprocessor, skip building preprocessor 2024-01-02 18:19:59,224 - modelscope - INFO - loading model from G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface\pytorch_model.pt 2024-01-02 18:19:59,655 - modelscope - INFO - load model done Traceback (most recent call last): File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\extensions\sd-webui-EasyPhoto\scripts\train_kohya\train_lora.py", line 1370, in main() File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\extensions\sd-webui-EasyPhoto\scripts\train_kohya\utils\gpu_info.py", line 195, in wrapper result = func(*args, kwargs) File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\extensions\sd-webui-EasyPhoto\scripts\train_kohya\train_lora.py", line 1146, in main model_pred = unet(noisy_latents, timesteps, encoder_hidden_states).sample File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\python\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl return forward_call(*args, *kwargs) File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\python\lib\site-packages\accelerate\utils\operations.py", line 581, in forward return model_forward(args, kwargs) File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\python\lib\site-packages\accelerate\utils\operations.py", line 569, in call return convert_to_fp32(self.model_forward(*args, kwargs)) File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\python\lib\site-packages\torch\amp\autocast_mode.py", line 14, in decorate_autocast return func(*args, *kwargs) File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\extensions\sd-webui-EasyPhoto\scripts\train_kohya\utils\original_unet.py", line 1448, in forward sample = upsample_block( File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\python\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl return forward_call(args, kwargs) File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\extensions\sd-webui-EasyPhoto\scripts\train_kohya\utils\original_unet.py", line 1136, in forward hidden_states = resnet(hidden_states, temb) File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\python\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl return forward_call(*args, *kwargs) File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\extensions\sd-webui-EasyPhoto\scripts\train_kohya\utils\original_unet.py", line 349, in forward hidden_states = self.conv2(hidden_states) File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\python\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl return forward_call(args, **kwargs) File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\python\lib\site-packages\torch\nn\modules\conv.py", line 463, in forward return self._conv_forward(input, self.weight, self.bias) File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\python\lib\site-packages\torch\nn\modules\conv.py", line 459, in _conv_forward return F.conv2d(input, weight, bias, self.stride, RuntimeError: FIND was unable to find an engine to execute this computation Traceback (most recent call last): File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\python\lib\runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\python\lib\runpy.py", line 86, in _run_code exec(code, run_globals) File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\python\lib\site-packages\accelerate\commands\launch.py", line 989, in main() File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\python\lib\site-packages\accelerate\commands\launch.py", line 985, in main launch_command(args) File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\python\lib\site-packages\accelerate\commands\launch.py", line 979, in launch_command simple_launcher(args) File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\python\lib\site-packages\accelerate\commands\launch.py", line 628, in simple_launcher raise subprocess.CalledProcessError(returncode=process.returncode, cmd=cmd) subprocess.CalledProcessError: Command '['G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\python\python.exe', 'G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\extensions\sd-webui-EasyPhoto\scripts\train_kohya/train_lora.py', '--pretrained_model_name_or_path=extensions\sd-webui-EasyPhoto\models\stable-diffusion-v1-5', '--pretrained_model_ckpt=models\Stable-diffusion\Chilloutmix-Ni-pruned-fp16-fix.safetensors', '--train_data_dir=outputs\easyphoto-user-id-infos\zjz01\processed_images', '--caption_column=text', '--resolution=512', '--random_flip', '--train_batch_size=1', '--gradient_accumulation_steps=4', '--dataloader_num_workers=0', '--max_train_steps=800', '--checkpointing_steps=100', '--learning_rate=0.0001', '--lr_scheduler=constant', '--lr_warmup_steps=0', '--train_text_encoder', '--seed=72275', '--rank=128', '--network_alpha=64', '--validation_prompt=easyphoto_face, easyphoto, 1person', '--validation_steps=100', '--output_dir=outputs\easyphoto-user-id-infos\zjz01\user_weights', '--logging_dir=outputs\easyphoto-user-id-infos\zjz01\user_weights', '--enable_xformers_memory_efficient_attention', '--mixed_precision=fp16', '--template_dir=extensions\sd-webui-EasyPhoto\models\training_templates', '--template_mask', '--merge_best_lora_based_face_id', '--merge_best_lora_name=zjz01', '--cache_log_file=G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\outputs/easyphoto-tmp/train_kohya_log.txt', '--validation']' returned non-zero exit status 1. Error executing the command: Command '['G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\python\python.exe', '-m', 'accelerate.commands.launch', '--mixed_precision=fp16', '--main_process_port=3456', 'G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\extensions\sd-webui-EasyPhoto\scripts\train_kohya/train_lora.py', '--pretrained_model_name_or_path=extensions\sd-webui-EasyPhoto\models\stable-diffusion-v1-5', '--pretrained_model_ckpt=models\Stable-diffusion\Chilloutmix-Ni-pruned-fp16-fix.safetensors', '--train_data_dir=outputs\easyphoto-user-id-infos\zjz01\processed_images', '--caption_column=text', '--resolution=512', '--random_flip', '--train_batch_size=1', '--gradient_accumulation_steps=4', '--dataloader_num_workers=0', '--max_train_steps=800', '--checkpointing_steps=100', '--learning_rate=0.0001', '--lr_scheduler=constant', '--lr_warmup_steps=0', '--train_text_encoder', '--seed=72275', '--rank=128', '--network_alpha=64', '--validation_prompt=easyphoto_face, easyphoto, 1person', '--validation_steps=100', '--output_dir=outputs\easyphoto-user-id-infos\zjz01\user_weights', '--logging_dir=outputs\easyphoto-user-id-infos\zjz01\user_weights', '--enable_xformers_memory_efficient_attention', '--mixed_precision=fp16', '--template_dir=extensions\sd-webui-EasyPhoto\models\training_templates', '--template_mask', '--merge_best_lora_based_face_id', '--merge_best_lora_name=zjz01', '--cache_log_file=G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\outputs/easyphoto-tmp/train_kohya_log.txt', '--validation']' returned non-zero exit status 1. Using already loaded model anything-v5-PrtRE.safetensors [7f96a1a9ca]: done in 0.0s Applying attention optimization: xformers... done.

有大佬知道是咋回事吗?

wuziheng commented 10 months ago

具体报错在这一段 return self._conv_forward(input, self.weight, self.bias) File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\python\lib\site-packages\torch\nn\modules\conv.py", line 459, in _conv_forward return F.conv2d(input, weight, bias, self.stride, RuntimeError: FIND was unable to find an engine to execute this computation Traceback (most recent call last): File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\python\lib\runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\python\lib\runpy.py", line 86, in _run_code exec(code, run_globals) File "G:\stable diffusion\sd-webui-aki\sd-webui-aki-v4.4\python\lib\site-packages\accelerate\commands\launch.py", line 989, in

RuntimeError: FIND was unable to find an engine to execute this computation 提供一下你的显卡,机器,驱动信息,还有环境信息

wuziheng commented 10 months ago

根据我查到的信息 你的pytorch 可能有问题,没法支持训练 https://github.com/Megvii-BaseDetection/YOLOX/issues/1642 确认一下你的sdwebui环境里面的pytorch是否是正常的,如果不是,重装一个即可。