Gourieff / sd-webui-reactor

Fast and Simple Face Swap Extension for StableDiffusion WebUI (A1111 SD WebUI, SD WebUI Forge, SD.Next, Cagliostro)
GNU Affero General Public License v3.0
2.17k stars 235 forks source link

Unable to load face-restoration model #408

Open syliang2020 opened 1 month ago

syliang2020 commented 1 month ago

First, confirm

What happened?

After upgrading to 1.8 in the stable diffusion webui, it seems to be throwing errors.

Steps to reproduce the problem

image image

Sysinfo

{ "Platform": "Linux-5.4.0-153-generic-x86_64-with-glibc2.31", "Python": "3.10.6", "Version": "v1.8.0", "Commit": "bef51aed032c0aaa5cfd80445bc4cf0d85b408b5", "Script path": "/root/stable-diffusion-webui", "Data path": "/root/stable-diffusion-webui", "Extensions dir": "/root/stable-diffusion-webui/extensions", "Checksum": "fbc1e7bbfd4c4a08acc57e81eccdda57887282c4f45089f4e864265c51a60675", "Commandline": [ "launch.py", "--skip-prepare-environment", "--xformers", "--listen", "--enable-insecure-extension-access", "--port=6889" ], "Torch env info": { "torch_version": "2.0.1+cu118", "is_debug_build": "False", "cuda_compiled_version": "11.8", "gcc_version": "(Ubuntu 9.4.0-1ubuntu1~20.04.1) 9.4.0", "clang_version": null, "cmake_version": "version 3.27.7", "os": "Ubuntu 20.04.6 LTS (x86_64)", "libc_version": "glibc-2.31", "python_version": "3.10.6 (main, Oct 24 2022, 16:07:47) [GCC 11.2.0] (64-bit runtime)", "python_platform": "Linux-5.4.0-153-generic-x86_64-with-glibc2.31", "is_cuda_available": "True", "cuda_runtime_version": "11.7.99", "cuda_module_loading": "LAZY", "nvidia_driver_version": "525.105.17", "nvidia_gpu_models": "GPU 0: Tesla T4", "cudnn_version": [ "Probably one of the following:", "/usr/lib/x86_64-linux-gnu/libcudnn.so.8.5.0", "/usr/lib/x86_64-linux-gnu/libcudnn_adv_infer.so.8.5.0", "/usr/lib/x86_64-linux-gnu/libcudnn_adv_train.so.8.5.0", "/usr/lib/x86_64-linux-gnu/libcudnn_cnn_infer.so.8.5.0", "/usr/lib/x86_64-linux-gnu/libcudnn_cnn_train.so.8.5.0", "/usr/lib/x86_64-linux-gnu/libcudnn_ops_infer.so.8.5.0", "/usr/lib/x86_64-linux-gnu/libcudnn_ops_train.so.8.5.0" ], "pip_version": "pip3", "pip_packages": [ "numpy==1.26.4", "open-clip-torch==2.20.0", "pytorch-lightning==1.9.4", "pytorch_optimizer==2.12.0", "torch==2.0.1+cu118", "torchdiffeq==0.2.3", "torchmetrics==1.2.0", "torchsde==0.2.5", "torchvision==0.15.2+cu118" ], "conda_packages": [ "numpy 1.26.4 pypi_0 pypi", "open-clip-torch 2.20.0 pypi_0 pypi", "pytorch-lightning 1.9.4 pypi_0 pypi", "pytorch-optimizer 2.12.0 pypi_0 pypi", "torch 2.0.1+cu118 pypi_0 pypi", "torchdiffeq 0.2.3 pypi_0 pypi", "torchmetrics 1.2.0 pypi_0 pypi", "torchsde 0.2.5 pypi_0 pypi", "torchvision 0.15.2+cu118 pypi_0 pypi" ], "hip_compiled_version": "N/A", "hip_runtime_version": "N/A", "miopen_runtime_version": "N/A", "caching_allocator_config": "", "is_xnnpack_available": "True", "cpu_info": [ "Architecture: x86_64", "CPU op-mode(s): 32-bit, 64-bit", "Byte Order: Little Endian", "Address sizes: 46 bits physical, 48 bits virtual", "CPU(s): 8", "On-line CPU(s) list: 0-7", "Thread(s) per core: 1", "Core(s) per socket: 8", "Socket(s): 1", "NUMA node(s): 1", "Vendor ID: GenuineIntel", "CPU family: 6", "Model: 85", "Model name: Intel(R) Xeon(R) Platinum 8255C CPU @ 2.50GHz", "Stepping: 5", "CPU MHz: 2494.134", "BogoMIPS: 4988.26", "Hypervisor vendor: KVM", "Virtualization type: full", "L1d cache: 256 KiB", "L1i cache: 256 KiB", "L2 cache: 32 MiB", "L3 cache: 35.8 MiB", "NUMA node0 CPU(s): 0-7", "Vulnerability Itlb multihit: KVM: Vulnerable", "Vulnerability L1tf: Mitigation; PTE Inversion", "Vulnerability Mds: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown", "Vulnerability Meltdown: Mitigation; PTI", "Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown", "Vulnerability Retbleed: Vulnerable", "Vulnerability Spec store bypass: Vulnerable", "Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization", "Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected", "Vulnerability Srbds: Not affected", "Vulnerability Tsx async abort: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown", "Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl cpuid tsc_known_freq pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 arat avx512_vnni" ] }, "Exceptions": [ { "exception": "No module named 'xformers'", "traceback": [ [ "/root/stable-diffusion-webui/modules/sd_hijack_optimizations.py, line 160, ", "import xformers.ops" ] ] } ], "CPU": { "model": "x86_64", "count logical": 8, "count physical": 8 }, "RAM": { "total": "31GB", "used": "2GB", "free": "22GB", "active": "2GB", "inactive": "6GB", "buffers": "76MB", "cached": "6GB", "shared": "16MB" }, "Extensions": [ { "name": ".ipynb_checkpoints", "path": "/root/stable-diffusion-webui/extensions/.ipynb_checkpoints", "version": "", "branch": null, "remote": null }, { "name": "dataset-tag-editor", "path": "/root/stable-diffusion-webui/extensions/dataset-tag-editor", "version": "7a2f4c53", "branch": "main", "remote": "https://github.com/toshiaki1729/stable-diffusion-webui-dataset-tag-editor.git" }, { "name": "sd-face-editor", "path": "/root/stable-diffusion-webui/extensions/sd-face-editor", "version": "34210176", "branch": "main", "remote": "https://github.com/ototadana/sd-face-editor.git" }, { "name": "sd-webui-controlnet", "path": "/root/stable-diffusion-webui/extensions/sd-webui-controlnet", "version": "10bd9b25", "branch": "main", "remote": "https://github.com/Mikubill/sd-webui-controlnet" }, { "name": "sd-webui-prompt-all-in-one", "path": "/root/stable-diffusion-webui/extensions/sd-webui-prompt-all-in-one", "version": "90bc20f3", "branch": "main", "remote": "https://github.com/Physton/sd-webui-prompt-all-in-one.git" }, { "name": "sd-webui-reactor", "path": "/root/stable-diffusion-webui/extensions/sd-webui-reactor", "version": "0185d7a2", "branch": "main", "remote": "https://github.com/Gourieff/sd-webui-reactor" }, { "name": "sd_dreambooth_extension", "path": "/root/stable-diffusion-webui/extensions/sd_dreambooth_extension", "version": "c548ede6", "branch": "main", "remote": "https://github.com/d8ahazard/sd_dreambooth_extension" }, { "name": "stable-diffusion-webui-chinese", "path": "/root/stable-diffusion-webui/extensions/stable-diffusion-webui-chinese", "version": "1db3194d", "branch": "main", "remote": "https://github.com/VinsonLaro/stable-diffusion-webui-chinese" }, { "name": "stable-diffusion-webui-wd14-tagger", "path": "/root/stable-diffusion-webui/extensions/stable-diffusion-webui-wd14-tagger", "version": "e72d984b", "branch": "master", "remote": "https://github.com/picobyte/stable-diffusion-webui-wd14-tagger.git" } ], "Inactive extensions": [], "Environment": { "GRADIO_ANALYTICS_ENABLED": "False" }, "Config": { "samples_save": true, "samples_format": "png", "samples_filename_pattern": "", "save_images_add_number": true, "grid_save": true, "grid_format": "png", "grid_extended_filename": false, "grid_only_if_multiple": true, "grid_prevent_empty_spots": false, "grid_zip_filename_pattern": "", "n_rows": -1, "font": "", "grid_text_active_color": "#000000", "grid_text_inactive_color": "#999999", "grid_background_color": "#ffffff", "enable_pnginfo": true, "save_txt": false, "save_images_before_face_restoration": false, "save_images_before_highres_fix": false, "save_images_before_color_correction": false, "save_mask": false, "save_mask_composite": false, "jpeg_quality": 80, "webp_lossless": false, "export_for_4chan": true, "img_downscale_threshold": 4.0, "target_side_length": 4000, "img_max_size_mp": 200, "use_original_name_batch": true, "use_upscaler_name_as_suffix": false, "save_selected_only": true, "save_init_img": false, "temp_dir": "", "clean_temp_dir_at_start": false, "save_incomplete_images": false, "outdir_samples": "", "outdir_txt2img_samples": "outputs/txt2img-images", "outdir_img2img_samples": "outputs/img2img-images", "outdir_extras_samples": "outputs/extras-images", "outdir_grids": "", "outdir_txt2img_grids": "outputs/txt2img-grids", "outdir_img2img_grids": "outputs/img2img-grids", "outdir_save": "log/images", "outdir_init_images": "outputs/init-images", "save_to_dirs": true, "grid_save_to_dirs": true, "use_save_to_dirs_for_ui": false, "directories_filename_pattern": "[date]", "directories_max_prompt_words": 8, "ESRGAN_tile": 192, "ESRGAN_tile_overlap": 8, "realesrgan_enabled_models": [ "R-ESRGAN 4x+", "R-ESRGAN 4x+ Anime6B" ], "upscaler_for_img2img": null, "face_restoration": true, "face_restoration_model": "CodeFormer", "code_former_weight": 0.5, "face_restoration_unload": false, "auto_launch_browser": "Local", "show_warnings": false, "show_gradio_deprecation_warnings": true, "memmon_poll_rate": 8, "samples_log_stdout": false, "multiple_tqdm": true, "print_hypernet_extra": false, "list_hidden_files": true, "disable_mmap_load_safetensors": false, "hide_ldm_prints": true, "api_enable_requests": true, "api_forbid_local_requests": true, "api_useragent": "", "unload_models_when_training": false, "pin_memory": false, "save_optimizer_state": false, "save_training_settings_to_txt": true, "dataset_filename_word_regex": "", "dataset_filename_join_string": " ", "training_image_repeats_per_epoch": 1, "training_write_csv_every": 500, "training_xattention_optimizations": false, "training_enable_tensorboard": false, "training_tensorboard_save_images": false, "training_tensorboard_flush_every": 120, "sd_model_checkpoint": "chilloutmix_NiPrunedFp32Fix.safetensors [fc2511737a]", "sd_checkpoints_limit": 1, "sd_checkpoints_keep_in_cpu": true, "sd_checkpoint_cache": 0, "sd_unet": "Automatic", "enable_quantization": false, "enable_emphasis": true, "enable_batch_seeds": true, "comma_padding_backtrack": 20, "CLIP_stop_at_last_layers": 1, "upcast_attn": false, "randn_source": "GPU", "tiling": false, "hires_fix_refiner_pass": "second pass", "sdxl_crop_top": 0, "sdxl_crop_left": 0, "sdxl_refiner_low_aesthetic_score": 2.5, "sdxl_refiner_high_aesthetic_score": 6.0, "sd_vae_explanation": "VAE is a neural network that transforms a standard RGB\nimage into latent space representation and back. Latent space representation is what stable diffusion is working on during sampling\n(i.e. when the progress bar is between empty and full). For txt2img, VAE is used to create a resulting image after the sampling is finished.\nFor img2img, VAE is used to process user's input image before the sampling, and to create an image after sampling.", "sd_vae_checkpoint_cache": 0, "sd_vae": "None", "sd_vae_overrides_per_model_preferences": true, "auto_vae_precision": true, "sd_vae_encode_method": "Full", "sd_vae_decode_method": "Full", "inpainting_mask_weight": 1.0, "initial_noise_multiplier": 1.0, "img2img_extra_noise": 0.0, "img2img_color_correction": false, "img2img_fix_steps": false, "img2img_background_color": "#ffffff", "img2img_editor_height": 720, "img2img_sketch_default_brush_color": "#ffffff", "img2img_inpaint_mask_brush_color": "#ffffff", "img2img_inpaint_sketch_default_brush_color": "#ffffff", "return_mask": false, "return_mask_composite": false, "cross_attention_optimization": "Automatic", "s_min_uncond": 0.0, "token_merging_ratio": 0.0, "token_merging_ratio_img2img": 0.0, "token_merging_ratio_hr": 0.0, "pad_cond_uncond": false, "persistent_cond_cache": true, "batch_cond_uncond": true, "use_old_emphasis_implementation": false, "use_old_karras_scheduler_sigmas": false, "no_dpmpp_sde_batch_determinism": false, "use_old_hires_fix_width_height": false, "dont_fix_second_order_samplers_schedule": false, "hires_fix_use_firstpass_conds": false, "use_old_scheduling": false, "interrogate_keep_models_in_memory": false, "interrogate_return_ranks": false, "interrogate_clip_num_beams": 1, "interrogate_clip_min_length": 24, "interrogate_clip_max_length": 48, "interrogate_clip_dict_limit": 1500, "interrogate_clip_skip_categories": [], "interrogate_deepbooru_score_threshold": 0.5, "deepbooru_sort_alpha": true, "deepbooru_use_spaces": true, "deepbooru_escape": true, "deepbooru_filter_tags": "", "extra_networks_show_hidden_directories": true, "extra_networks_hidden_models": "When searched", "extra_networks_default_multiplier": 1.0, "extra_networks_card_width": 0, "extra_networks_card_height": 0, "extra_networks_card_text_scale": 1.0, "extra_networks_card_show_desc": true, "extra_networks_add_text_separator": " ", "ui_extra_networks_tab_reorder": "", "textual_inversion_print_at_load": false, "textual_inversion_add_hashes_to_infotext": true, "sd_hypernetwork": "None", "localization": "chinese-all-0313", "gradio_theme": "Default", "gradio_themes_cache": true, "gallery_height": "", "return_grid": true, "do_not_show_images": false, "send_seed": true, "send_size": true, "js_modal_lightbox": true, "js_modal_lightbox_initially_zoomed": true, "js_modal_lightbox_gamepad": false, "js_modal_lightbox_gamepad_repeat": 250, "show_progress_in_title": true, "samplers_in_dropdown": true, "dimensions_and_batch_together": true, "keyedit_precision_attention": 0.1, "keyedit_precision_extra": 0.05, "keyedit_delimiters": ".,\/!?%^*;:{}=`~()", "keyedit_move": true, "quicksettings_list": [ "sd_model_checkpoint", "sd_vae" ], "ui_tab_order": [], "hidden_tabs": [], "ui_reorder_list": [], "hires_fix_show_sampler": true, "hires_fix_show_prompts": true, "disable_token_counters": false, "add_model_hash_to_info": true, "add_model_name_to_info": true, "add_user_name_to_info": false, "add_version_to_infotext": true, "disable_weights_auto_swap": true, "infotext_styles": "Apply if any", "show_progressbar": true, "live_previews_enable": true, "live_previews_image_format": "png", "show_progress_grid": true, "show_progress_every_n_steps": 10, "show_progress_type": "Approx NN", "live_preview_allow_lowvram_full": false, "live_preview_content": "Prompt", "live_preview_refresh_period": 1000, "live_preview_fast_interrupt": false, "hide_samplers": [], "eta_ddim": 0.0, "eta_ancestral": 1.0, "ddim_discretize": "uniform", "s_churn": 0.0, "s_tmin": 0.0, "s_tmax": 0.0, "s_noise": 1.0, "k_sched_type": "Automatic", "sigma_min": 0.0, "sigma_max": 0.0, "rho": 0.0, "eta_noise_seed_delta": 0, "always_discard_next_to_last_sigma": false, "sgm_noise_multiplier": false, "uni_pc_variant": "bh1", "uni_pc_skip_type": "time_uniform", "uni_pc_order": 3, "uni_pc_lower_order_final": true, "postprocessing_enable_in_main_ui": [], "postprocessing_operation_order": [], "upscaling_max_images_in_cache": 5, "disabled_extensions": [], "disable_all_extensions": "none", "restore_config_state_file": "", "sd_checkpoint_hash": "fc2511737a54c5e80b89ab03e0ab4b98d051ab187f92860f3cd664dc9d08b271", "ldsr_steps": 100, "ldsr_cached": false, "SCUNET_tile": 256, "SCUNET_tile_overlap": 8, "SWIN_tile": 192, "SWIN_tile_overlap": 8, "SWIN_torch_compile": false, "lora_functional": false, "sd_lora": "None", "lora_preferred_name": "Alias from file", "lora_add_hashes_to_infotext": true, "lora_show_all": false, "lora_hide_unknown_for_versions": [], "lora_in_memory_limit": 0, "extra_options_txt2img": [ "tiling", "face_restoration" ], "extra_options_img2img": [ "tiling", "face_restoration" ], "extra_options_cols": 1, "extra_options_accordion": false, "canvas_hotkey_zoom": "Alt", "canvas_hotkey_adjust": "Ctrl", "canvas_hotkey_move": "F", "canvas_hotkey_fullscreen": "S", "canvas_hotkey_reset": "R", "canvas_hotkey_overlap": "O", "canvas_show_tooltip": true, "canvas_auto_expand": true, "canvas_blur_prompt": false, "canvas_disabled_functions": [ "Overlap" ], "dataset_editor_image_columns": 6.0, "dataset_editor_max_res": 0.0, "dataset_editor_use_temp_files": false, "dataset_editor_use_raw_clip_token": true, "control_net_detectedmap_dir": "detected_maps", "control_net_models_path": "", "control_net_modules_path": "", "control_net_unit_count": 3, "control_net_model_cache_size": 1, "control_net_inpaint_blur_sigma": 7, "control_net_no_high_res_fix": false, "control_net_no_detectmap": false, "control_net_detectmap_autosaving": false, "control_net_allow_script_control": false, "control_net_sync_field_args": true, "controlnet_show_batch_images_in_ui": false, "controlnet_increment_seed_during_batch": false, "controlnet_disable_openpose_edit": false, "controlnet_ignore_noninpaint_mask": false, "hypertile_enable_unet": false, "hypertile_enable_unet_secondpass": false, "hypertile_max_depth_unet": 3, "hypertile_max_tile_unet": 256, "hypertile_swap_size_unet": 3, "hypertile_enable_vae": false, "hypertile_max_depth_vae": 3, "hypertile_max_tile_vae": 128, "hypertile_swap_size_vae": 3, "face_editor_search_subdirectories": false, "face_editor_additional_components": [], "face_editor_save_original_on_detection_fail": true, "face_editor_correct_tilt": false, "face_editor_auto_face_size_by_model": false, "face_editor_script_index": 99, "tagger_out_filename_fmt": "[name].[output_extension]", "tagger_count_threshold": 100.0, "tagger_batch_recursive": true, "tagger_auto_serde_json": true, "tagger_store_images": false, "tagger_weighted_tags_files": false, "tagger_verbose": false, "tagger_repl_us": true, "tagger_repl_us_excl": "00, (o)(o), ++, +-, .., , <|><|>, ==, >_<, 3_3, 6_9, >o, @@, ^_^, o_o, u_u, xx, ||, ||_||", "tagger_escape": false, "tagger_batch_size": 1024, "tagger_hf_cache_dir": "/root/stable-diffusion-webui/models/interrogators", "save_images_replace_action": "Replace", "notification_audio": true, "notification_volume": 100, "auto_backcompat": true, "use_downcasted_alpha_bar": false, "extra_networks_dir_button_function": false, "extra_networks_card_description_is_html": false, "extra_networks_card_order_field": "Path", "extra_networks_card_order": "Ascending", "extra_networks_tree_view_default_enabled": false, "lora_not_found_warning_console": false, "lora_not_found_gradio_warning": false, "pad_cond_uncond_v0": false, "fp8_storage": "Disable", "cache_fp16_weight": false, "sd_noise_schedule": "Default", "emphasis": "Original", "enable_prompt_comments": true, "auto_vae_precision_bfloat16": false, "img2img_batch_show_results_limit": 32, "overlay_inpaint": true, "sd_webui_modal_lightbox_icon_opacity": 1, "sd_webui_modal_lightbox_toolbar_opacity": 0.9, "open_dir_button_choice": "Subdirectory", "add_vae_name_to_info": true, "add_vae_hash_to_info": true, "infotext_skip_pasting": [], "js_live_preview_in_modal_lightbox": false, "keyedit_delimiters_whitespace": [ "Tab", "Carriage Return", "Line Feed" ], "include_styles_into_token_counters": true, "compact_prompt_box": false, "sd_checkpoint_dropdown_use_short": false, "txt2img_settings_accordion": false, "img2img_settings_accordion": false, "interrupt_after_current": true, "enable_console_prompts": false, "enable_upscale_progressbar": true, "dump_stacks_on_signal": false, "postprocessing_existing_caption_action": "Ignore", "dat_enabled_models": [ "DAT x2", "DAT x3", "DAT x4" ], "DAT_tile": 192, "DAT_tile_overlap": 8, "canvas_hotkey_shrink_brush": "Q", "canvas_hotkey_grow_brush": "W" }, "Startup": { "total": 37.021774768829346, "records": { "initial startup": 0.015271186828613281, "prepare environment": 7.867813110351562e-06, "launcher": 0.002959012985229492, "import torch": 17.420794248580933, "import gradio": 0.8793044090270996, "setup paths": 1.3410532474517822, "import ldm": 0.012694835662841797, "import sgm": 6.198883056640625e-06, "initialize shared": 0.6038780212402344, "other imports": 1.067413330078125, "opts onchange": 0.0005061626434326172, "setup SD model": 0.0004029273986816406, "setup codeformer": 0.0022780895233154297, "setup gfpgan": 0.030414819717407227, "set samplers": 3.790855407714844e-05, "list extensions": 0.002201557159423828, "restore config state file": 1.1444091796875e-05, "list SD models": 0.016147136688232422, "list localizations": 0.0032815933227539062, "load scripts/custom_code.py": 0.019906282424926758, "load scripts/img2imgalt.py": 0.000835418701171875, "load scripts/loopback.py": 0.0007405281066894531, "load scripts/outpainting_mk_2.py": 0.0007126331329345703, "load scripts/poor_mans_outpainting.py": 0.0006668567657470703, "load scripts/postprocessing_caption.py": 0.0005159378051757812, "load scripts/postprocessing_codeformer.py": 0.0005927085876464844, "load scripts/postprocessing_create_flipped_copies.py": 0.00037932395935058594, "load scripts/postprocessing_focal_crop.py": 0.001255035400390625, "load scripts/postprocessing_gfpgan.py": 0.0005519390106201172, "load scripts/postprocessing_split_oversized.py": 0.0005338191986083984, "load scripts/postprocessing_upscale.py": 0.0006284713745117188, "load scripts/processing_autosized_crop.py": 0.000743865966796875, "load scripts/prompt_matrix.py": 0.0008869171142578125, "load scripts/prompts_from_file.py": 0.0008013248443603516, "load scripts/sd_upscale.py": 0.0005602836608886719, "load scripts/xyz_grid.py": 0.0028297901153564453, "load scripts/ldsr_model.py": 0.4632713794708252, "load scripts/lora_script.py": 0.2219386100769043, "load scripts/scunet_model.py": 0.036449432373046875, "load scripts/swinir_model.py": 0.03517913818359375, "load scripts/hotkey_config.py": 0.0023539066314697266, "load scripts/extra_options_section.py": 0.002103567123413086, "load scripts/hypertile_script.py": 0.0726470947265625, "load scripts/hypertile_xyz.py": 0.0001614093780517578, "load scripts/soft_inpainting.py": 0.0015368461608886719, "load scripts/dte_instance.py": 0.02080368995666504, "load scripts/main.py": 0.16035819053649902, "load scripts/singleton.py": 0.0001323223114013672, "load scripts/face_editor.py": 1.5469839572906494, "load scripts/face_editor_extension.py": 0.0006642341613769531, "load scripts/adapter.py": 0.0017414093017578125, "load scripts/api.py": 1.1961877346038818, "load scripts/batch_hijack.py": 0.002033710479736328, "load scripts/cldm.py": 0.0009534358978271484, "load scripts/controlmodel_ipadapter.py": 0.0010454654693603516, "load scripts/controlnet.py": 0.18073701858520508, "load scripts/controlnet_diffusers.py": 0.00024390220642089844, "load scripts/controlnet_lllite.py": 0.00023698806762695312, "load scripts/controlnet_lora.py": 0.00019049644470214844, "load scripts/controlnet_model_guess.py": 0.00018167495727539062, "load scripts/controlnet_version.py": 0.00019025802612304688, "load scripts/enums.py": 0.0006756782531738281, "load scripts/external_code.py": 0.0001552104949951172, "load scripts/global_state.py": 0.00038361549377441406, "load scripts/hook.py": 0.0004742145538330078, "load scripts/infotext.py": 0.0001964569091796875, "load scripts/logging.py": 0.00034809112548828125, "load scripts/lvminthin.py": 0.0003535747528076172, "load scripts/movie2movie.py": 0.0008115768432617188, "load scripts/processor.py": 0.00039958953857421875, "load scripts/utils.py": 0.0003802776336669922, "load scripts/xyz_grid_support.py": 0.0008161067962646484, "load scripts/on_app_started.py": 0.06606364250183105, "load scripts/console_log_patch.py": 0.637261152267456, "load scripts/reactor_api.py": 0.10608673095703125, "load scripts/reactor_faceswap.py": 0.005870819091796875, "load scripts/reactor_globals.py": 0.00022983551025390625, "load scripts/reactor_helpers.py": 0.00019478797912597656, "load scripts/reactor_logger.py": 0.0003294944763183594, "load scripts/reactor_swapper.py": 0.0021314620971679688, "load scripts/reactor_version.py": 0.00013494491577148438, "load scripts/reactor_xyz.py": 0.00012183189392089844, "load scripts/init.py": 0.0009033679962158203, "load scripts/tagger.py": 0.11940765380859375, "load scripts/comments.py": 0.037397146224975586, "load scripts/refiner.py": 0.0009238719940185547, "load scripts/seed.py": 0.0007770061492919922, "load scripts": 4.964343309402466, "load upscalers": 0.005102872848510742, "refresh VAE": 0.0020635128021240234, "refresh textual inversion templates": 0.0004360675811767578, "scripts list_optimizers": 0.00028824806213378906, "scripts list_unets": 6.9141387939453125e-06, "reload hypernetworks": 0.006524801254272461, "initialize extra networks": 0.04275155067443848, "scripts before_ui_callback": 0.008940935134887695, "create ui": 1.5252845287322998, "gradio launch": 6.2586350440979, "add APIs": 0.03369259834289551, "app_started_callback/lora_script.py": 0.00045037269592285156, "app_started_callback/api.py": 0.0025446414947509766, "app_started_callback/on_app_started.py": 2.7664411067962646, "app_started_callback/reactor_api.py": 0.0027761459350585938, "app_started_callback/tagger.py": 0.0028395652770996094, "app_started_callback": 2.77506160736084 } }, "Packages": [ "absl-py==2.0.0", "accelerate==0.21.0", "addict==2.4.0", "aenum==3.1.15", "aiofiles==23.2.1", "aiohttp==3.9.0", "aiosignal==1.3.1", "albumentations==1.4.1", "aliyun-python-sdk-alimt==3.2.0", "aliyun-python-sdk-core==2.13.10", "altair==5.1.2", "antlr4-python3-runtime==4.9.3", "anyio==3.7.1", "archspec==0.2.1", "argon2-cffi-bindings==21.2.0", "argon2-cffi==23.1.0", "arrow==1.3.0", "asttokens==2.4.1", "astunparse==1.6.3", "async-lru==2.0.4", "async-timeout==4.0.3", "attrs==23.1.0", "babel==2.13.1", "basicsr==1.4.2", "beautifulsoup4==4.12.2", "bleach==6.1.0", "blendmodes==2022", "boltons==23.0.0", "boto3==1.34.63", "botocore==1.34.63", "brotli==1.0.9", "cachetools==5.3.2", "certifi==2023.11.17", "cffi==1.15.1", "chardet==5.2.0", "charset-normalizer==2.0.4", "clean-fid==0.1.35", "click==8.1.7", "clip==1.0", "cmake==3.27.7", "coloredlogs==15.0.1", "comm==0.2.0", "conda-content-trust==0.2.0", "conda-libmamba-solver==23.9.3", "conda-package-handling==2.2.0", "conda-package-streaming==0.9.0", "conda==23.9.0", "contourpy==1.2.0", "cryptography==41.0.3", "cssselect2==0.7.0", "cycler==0.12.1", "cython==3.0.9", "dadaptation==3.1", "debugpy==1.8.0", "decorator==5.1.1", "deepdanbooru==1.0.0", "defusedxml==0.7.1", "deprecation==2.1.0", "diffusers==0.23.1", "dill==0.3.8", "discord-webhook==1.3.0", "distro==1.9.0", "easydict==1.13", "einops==0.4.1", "exceptiongroup==1.1.3", "executing==2.0.1", "facexlib==0.3.0", "fastapi==0.94.0", "fastjsonschema==2.18.1", "ffmpy==0.3.1", "filelock==3.13.1", "filterpy==1.4.5", "flatbuffers==23.5.26", "fonttools==4.44.0", "fqdn==1.5.1", "frozenlist==1.4.0", "fsspec==2023.10.0", "ftfy==6.1.1", "future==0.18.3", "fvcore==0.1.5.post20221221", "gast==0.5.4", "gdown==4.7.1", "gfpgan==1.3.8", "gitdb==4.0.11", "gitpython==3.1.40", "google-auth-oauthlib==1.0.0", "google-auth==2.23.4", "google-pasta==0.2.0", "gradio-client==0.5.0", "gradio==3.41.2", "grpcio==1.59.2", "h11==0.12.0", "h5py==3.10.0", "httpcore==0.15.0", "httpx==0.24.1", "huggingface-hub==0.19.4", "humanfriendly==10.0", "idna==3.4", "imageio==2.33.0", "importlib-metadata==6.8.0", "importlib-resources==6.1.1", "inflection==0.5.1", "insightface==0.7.3", "iopath==0.1.9", "ipykernel==6.26.0", "ipython==8.17.2", "isoduration==20.11.0", "jedi==0.19.1", "jinja2==3.1.2", "jmespath==0.10.0", "joblib==1.3.2", "json5==0.9.14", "jsonmerge==1.8.0", "jsonpatch==1.32", "jsonpointer==2.1", "jsonschema-specifications==2023.7.1", "jsonschema==4.19.2", "jupyter-client==8.6.0", "jupyter-core==5.5.0", "jupyter-events==0.9.0", "jupyter-lsp==2.2.0", "jupyter-server-terminals==0.4.4", "jupyter-server==2.11.0", "jupyterlab-pygments==0.2.2", "jupyterlab-server==2.25.0", "jupyterlab==4.0.8", "keras==3.1.0", "kiwisolver==1.4.5", "kornia==0.6.7", "lark==1.1.2", "lazy-loader==0.3", "libclang==18.1.1", "libmambapy==1.5.1", "lightning-utilities==0.9.0", "lit==17.0.4", "llvmlite==0.41.1", "lmdb==1.4.1", "lpips==0.1.4", "lxml==4.9.3", "markdown-it-py==3.0.0", "markdown==3.5.1", "markupsafe==2.1.3", "matplotlib-inline==0.1.6", "matplotlib==3.8.1", "mdurl==0.1.2", "mediapipe==0.10.7", "mistune==3.0.2", "ml-dtypes==0.3.2", "mpmath==1.3.0", "multidict==6.0.4", "multiprocess==0.70.16", "namex==0.0.7", "nbclient==0.9.0", "nbconvert==7.11.0", "nbformat==5.9.2", "nest-asyncio==1.5.8", "networkx==3.2.1", "notebook-shim==0.2.3", "numba==0.58.1", "numpy==1.26.4", "oauthlib==3.2.2", "omegaconf==2.2.3", "onnx==1.15.0", "onnxruntime==1.17.1", "open-clip-torch==2.20.0", "openai==1.14.0", "opencv-contrib-python==4.8.1.78", "opencv-python-headless==4.9.0.80", "opencv-python==4.8.1.78", "opt-einsum==3.3.0", "optree==0.10.0", "orjson==3.9.10", "overrides==7.4.0", "packaging==23.1", "pandas==2.1.2", "pandocfilters==1.5.0", "parso==0.8.3", "pathos==0.3.2", "pexpect==4.8.0", "piexif==1.1.3", "pillow==9.5.0", "pip==24.0", "platformdirs==3.11.0", "pluggy==1.0.0", "portalocker==2.8.2", "pox==0.3.4", "ppft==1.7.6.8", "prettytable==3.10.0", "prometheus-client==0.18.0", "prompt-toolkit==3.0.39", "protobuf==4.25.3", "psutil==5.9.5", "ptyprocess==0.7.0", "pure-eval==0.2.2", "pyasn1-modules==0.3.0", "pyasn1==0.5.0", "pycosat==0.6.6", "pycparser==2.21", "pydantic==1.10.13", "pydub==0.25.1", "pyexecjs==1.5.1", "pygments==2.16.1", "pyopenssl==23.2.0", "pyparsing==3.1.1", "pysocks==1.7.1", "python-dateutil==2.8.2", "python-json-logger==2.0.7", "python-multipart==0.0.6", "pytorch-lightning==1.9.4", "pytorch-optimizer==2.12.0", "pytz==2023.3.post1", "pywavelets==1.4.1", "pyyaml==6.0.1", "pyzmq==25.1.1", "realesrgan==0.3.0", "referencing==0.30.2", "regex==2023.10.3", "reportlab==4.0.7", "requests-oauthlib==1.3.1", "requests==2.31.0", "resize-right==0.0.2", "rfc3339-validator==0.1.4", "rfc3986-validator==0.1.1", "rich==13.7.1", "rpds-py==0.12.0", "rsa==4.9", "ruamel.yaml.clib==0.2.6", "ruamel.yaml==0.17.21", "s3transfer==0.10.1", "safetensors==0.3.1", "scikit-image==0.21.0", "scikit-learn==1.4.1.post1", "scipy==1.11.3", "semantic-version==2.10.0", "send2trash==1.8.2", "sentencepiece==0.1.99", "setuptools==68.0.0", "six==1.16.0", "smmap==5.0.1", "sniffio==1.3.0", "sounddevice==0.4.6", "soupsieve==2.5", "spandrel==0.3.0", "stack-data==0.6.3", "starlette==0.26.1", "svglib==1.5.1", "sympy==1.12", "tabulate==0.9.0", "tb-nightly==2.11.0a20220906", "tensorboard-data-server==0.7.2", "tensorboard-plugin-wit==1.8.1", "tensorboard==2.16.2", "tensorflow-io-gcs-filesystem==0.36.0", "tensorflow-io==0.36.0", "tensorflow==2.16.1", "termcolor==2.3.0", "terminado==0.17.1", "threadpoolctl==3.3.0", "tifffile==2023.9.26", "timm==0.9.2", "tinycss2==1.2.1", "tokenizers==0.13.3", "tomesd==0.1.3", "tomli==2.0.1", "toolz==0.12.0", "torch==2.0.1+cu118", "torchdiffeq==0.2.3", "torchmetrics==1.2.0", "torchsde==0.2.5", "torchvision==0.15.2+cu118", "tornado==6.3.3", "tqdm==4.65.0", "traitlets==5.13.0", "trampoline==0.1.2", "transformers==4.30.2", "triton==2.0.0", "truststore==0.8.0", "types-python-dateutil==2.8.19.14", "typing-extensions==4.10.0", "tzdata==2023.3", "uri-template==1.3.0", "urllib3==1.26.18", "uvicorn==0.24.0.post1", "wcwidth==0.2.9", "webcolors==1.13", "webencodings==0.5.1", "websocket-client==1.6.4", "websockets==11.0.3", "werkzeug==3.0.1", "wheel==0.41.3", "wrapt==1.16.0", "yacs==0.1.8", "yapf==0.40.2", "yarl==1.9.2", "zipp==3.17.0", "zstandard==0.19.0" ] }

Relevant console log

[2024-03-28 06:42:32,213][INFO][modules.shared_state] - Starting job task(1eiag23r82yinhk)
100%|██████████| 1/1 [00:03<00:00,  3.42s/it]
06:42:37 - ReActor - STATUS - Working: source face index [0], target face index [0]
06:42:37 - ReActor - STATUS - Analyzing Source Image...
06:42:41 - ReActor - STATUS - Analyzing Target Image...
06:42:43 - ReActor - STATUS - Detecting Source Face, Index = 0
06:42:43 - ReActor - STATUS - Detected: -30- y.o. Female
06:42:49 - ReActor - STATUS - Detecting Target Face, Index = 0
06:42:49 - ReActor - STATUS - Detected: -27- y.o. Male
06:42:49 - ReActor - STATUS - Swapping Source into Target
06:42:50 - ReActor - STATUS - Restoring the face with CodeFormer (weight: 0.5)
[2024-03-28 06:42:52,074][WARNING][modules.face_restoration_utils] - Unable to load face-restoration model
Traceback (most recent call last):
  File "/root/stable-diffusion-webui/modules/face_restoration_utils.py", line 150, in restore_with_helper
    self.net = self.load_net()
  File "/root/stable-diffusion-webui/modules/codeformer_model.py", line 37, in load_net
    return modelloader.load_spandrel_model(
  File "/root/stable-diffusion-webui/modules/modelloader.py", line 150, in load_spandrel_model
    model_descriptor = spandrel.ModelLoader(device=device).load_from_file(str(path))
  File "/root/miniconda3/lib/python3.10/site-packages/spandrel/__helpers/loader.py", line 44, in load_from_file
    return self.load_from_state_dict(state_dict)
  File "/root/miniconda3/lib/python3.10/site-packages/spandrel/__helpers/loader.py", line 81, in load_from_state_dict
    return self.registry.load(state_dict).to(self.device)
  File "/root/miniconda3/lib/python3.10/site-packages/spandrel/__helpers/registry.py", line 184, in load
    raise UnsupportedModelError
spandrel.__helpers.registry.UnsupportedModelError
number of faces: 0.  
Total progress: 100%|██████████| 1/1 [00:16<00:00, 16.38s/it]
[2024-03-28 06:42:52,927][INFO][modules.shared_state] - Ending job task(1eiag23r82yinhk) (20.71 seconds)

Additional information

No response

Gourieff commented 1 month ago

spandrel.__helpers.registry.UnsupportedModelError

Try to re-download the codeformer model from here https://huggingface.co/datasets/Gourieff/ReActor/resolve/main/models/facerestore_models/codeformer-v0.1.0.pth and put it into the "models/Codeformer" folder

syliang2020 commented 1 month ago

spandrel.__helpers.registry.UnsupportedModelError

Try to re-download the codeformer model from here https://huggingface.co/datasets/Gourieff/ReActor/resolve/main/models/facerestore_models/codeformer-v0.1.0.pth and put it into the "models/Codeformer" folder

I have tried, but the issue still persists.