lllyasviel / stable-diffusion-webui-forge

GNU Affero General Public License v3.0
8.7k stars 864 forks source link

[Bug]: Unable to use specific controllNet preprocessor #541

Open NaughtDZ opened 8 months ago

NaughtDZ commented 8 months ago

Checklist

What happened?

Unable to use specific controllNet preprocessor,console will show some erro

Steps to reproduce the problem

Using controlnet with specific preprocessor

What should have happened?

preprocessor will all useable

What browsers do you use to access the UI ?

No response

Sysinfo

{ "Platform": "Windows-10-10.0.22635-SP0", "Python": "3.10.11", "Version": "f0.0.17v1.8.0rc-latest-276-g29be1da7", "Commit": "29be1da7cf2b5dccfc70fbdd33eb35c56a31ffb7", "Script path": "I:\stable-diffusion-webui-forge", "Data path": "I:\stable-diffusion-webui-forge", "Extensions dir": "I:\stable-diffusion-webui-forge\extensions", "Checksum": "5a4d66a0c2ab90cb2b4c43d12e577386737e37c41069ad7b3787d63dd85def1c", "Commandline": [ "launch.py", "--autolaunch", "--api", "--ad-no-huggingface", "--xformers", "--theme=dark", "--cuda-stream", "--no-gradio-queue" ], "Torch env info": { "torch_version": "2.1.2+cu121", "is_debug_build": "False", "cuda_compiled_version": "12.1", "gcc_version": null, "clang_version": null, "cmake_version": null, "os": "Microsoft Windows 11 Enterprise", "libc_version": "N/A", "python_version": "3.10.11 (tags/v3.10.11:7d4cc5a, Apr 5 2023, 00:38:17) [MSC v.1929 64 bit (AMD64)] (64-bit runtime)", "python_platform": "Windows-10-10.0.22635-SP0", "is_cuda_available": "True", "cuda_runtime_version": "11.1.105\r", "cuda_module_loading": "LAZY", "nvidia_driver_version": "551.61", "nvidia_gpu_models": "GPU 0: NVIDIA GeForce RTX 3070", "cudnn_version": null, "pip_version": "pip3", "pip_packages": [ "numpy==1.26.2", "open-clip-torch==2.20.0", "pytorch-lightning==1.9.4", "torch==2.1.2+cu121", "torchdiffeq==0.2.3", "torchmetrics==1.3.1", "torchsde==0.2.6", "torchvision==0.16.2+cu121" ], "conda_packages": null, "hip_compiled_version": "N/A", "hip_runtime_version": "N/A", "miopen_runtime_version": "N/A", "caching_allocator_config": "", "is_xnnpack_available": "True", "cpu_info": [ "Architecture=9", "CurrentClockSpeed=3801", "DeviceID=CPU0", "Family=107", "L2CacheSize=4096", "L2CacheSpeed=", "Manufacturer=AuthenticAMD", "MaxClockSpeed=3801", "Name=AMD Ryzen 7 5800X 8-Core Processor ", "ProcessorType=3", "Revision=8448" ] }, "Exceptions": [], "CPU": { "model": "AMD64 Family 25 Model 33 Stepping 0, AuthenticAMD", "count logical": 16, "count physical": 8 }, "RAM": { "total": "32GB", "used": "17GB", "free": "15GB" }, "Extensions": [ { "name": "OneButtonPrompt", "path": "I:\stable-diffusion-webui-forge\extensions\OneButtonPrompt", "version": "4dc3ceba", "branch": "main", "remote": "https://github.com/AIrjen/OneButtonPrompt" }, { "name": "a1111-sd-webui-tagcomplete", "path": "I:\stable-diffusion-webui-forge\extensions\a1111-sd-webui-tagcomplete", "version": "bec567fe", "branch": "main", "remote": "https://github.com/DominikDoom/a1111-sd-webui-tagcomplete.git" }, { "name": "adetailer", "path": "I:\stable-diffusion-webui-forge\extensions\adetailer", "version": "3f1d1b97", "branch": "main", "remote": "https://github.com/Bing-su/adetailer.git" }, { "name": "multi-subject-render", "path": "I:\stable-diffusion-webui-forge\extensions\multi-subject-render", "version": "03427e26", "branch": "main", "remote": "https://github.com/Extraltodeus/multi-subject-render.git" }, { "name": "sd-civitai-browser-plus", "path": "I:\stable-diffusion-webui-forge\extensions\sd-civitai-browser-plus", "version": "297f71bd", "branch": "main", "remote": "https://github.com/BlafKing/sd-civitai-browser-plus.git" }, { "name": "sd-forge-layerdiffuse", "path": "I:\stable-diffusion-webui-forge\extensions\sd-forge-layerdiffuse", "version": "e4d5060e", "branch": "main", "remote": "https://github.com/layerdiffusion/sd-forge-layerdiffuse.git" }, { "name": "sd-webui-aspect-ratio-helper", "path": "I:\stable-diffusion-webui-forge\extensions\sd-webui-aspect-ratio-helper", "version": "99fcf9b0", "branch": "main", "remote": "https://github.com/thomasasfk/sd-webui-aspect-ratio-helper.git" }, { "name": "sd-webui-e621-prompt", "path": "I:\stable-diffusion-webui-forge\extensions\sd-webui-e621-prompt", "version": "74ce0a50", "branch": "main", "remote": "https://github.com/nochnoe/sd-webui-e621-prompt.git" }, { "name": "sd-webui-infinite-image-browsing", "path": "I:\stable-diffusion-webui-forge\extensions\sd-webui-infinite-image-browsing", "version": "6efef975", "branch": "main", "remote": "https://github.com/zanllp/sd-webui-infinite-image-browsing.git" }, { "name": "sd-webui-prompt-all-in-one", "path": "I:\stable-diffusion-webui-forge\extensions\sd-webui-prompt-all-in-one", "version": "62178a29", "branch": "main", "remote": "https://github.com/Physton/sd-webui-prompt-all-in-one.git" }, { "name": "sd-webui-segment-anything", "path": "I:\stable-diffusion-webui-forge\extensions\sd-webui-segment-anything", "version": "982138cf", "branch": "master", "remote": "https://github.com/continue-revolution/sd-webui-segment-anything.git" }, { "name": "sd_delete_button", "path": "I:\stable-diffusion-webui-forge\extensions\sd_delete_button", "version": "9df37671", "branch": "main", "remote": "https://github.com/AlUlkesh/sd_delete_button.git" }, { "name": "stable-diffusion-webui-localization-zh_Hans", "path": "I:\stable-diffusion-webui-forge\extensions\stable-diffusion-webui-localization-zh_Hans", "version": "ba402f61", "branch": "master", "remote": "https://github.com/hanamizuki-ai/stable-diffusion-webui-localization-zh_Hans.git" }, { "name": "stable-diffusion-webui-promptgen", "path": "I:\stable-diffusion-webui-forge\extensions\stable-diffusion-webui-promptgen", "version": "84e58b5d", "branch": "master", "remote": "https://github.com/AUTOMATIC1111/stable-diffusion-webui-promptgen.git" }, { "name": "stable-diffusion-webui-rembg", "path": "I:\stable-diffusion-webui-forge\extensions\stable-diffusion-webui-rembg", "version": "a4c07b85", "branch": "master", "remote": "https://github.com/AUTOMATIC1111/stable-diffusion-webui-rembg.git" }, { "name": "ultimate-upscale-for-automatic1111", "path": "I:\stable-diffusion-webui-forge\extensions\ultimate-upscale-for-automatic1111", "version": "2322caa4", "branch": "master", "remote": "https://github.com/Coyote-A/ultimate-upscale-for-automatic1111" } ], "Inactive extensions": [ { "name": "Stable-Diffusion-Webui-Civitai-Helper", "path": "I:\stable-diffusion-webui-forge\extensions\Stable-Diffusion-Webui-Civitai-Helper", "version": "c333a93c", "branch": "master", "remote": "https://github.com/zixaphir/Stable-Diffusion-Webui-Civitai-Helper.git" }, { "name": "multidiffusion-upscaler-for-automatic1111", "path": "I:\stable-diffusion-webui-forge\extensions\multidiffusion-upscaler-for-automatic1111", "version": "76cde3c2", "branch": "main", "remote": "https://github.com/pkuliyi2015/multidiffusion-upscaler-for-automatic1111.git" }, { "name": "stable-diffusion-webui-localization-zh_CN", "path": "I:\stable-diffusion-webui-forge\extensions\stable-diffusion-webui-localization-zh_CN", "version": "eb67f8dc", "branch": "main", "remote": "https://github.com/dtlnor/stable-diffusion-webui-localization-zh_CN" } ], "Environment": { "COMMANDLINE_ARGS": " --autolaunch --api --ad-no-huggingface --xformers --theme=dark --cuda-stream --no-gradio-queue", "GRADIO_ANALYTICS_ENABLED": "False" }, "Config": { "ldsr_steps": 100, "ldsr_cached": false, "SCUNET_tile": 256, "SCUNET_tile_overlap": 8, "SWIN_tile": 192, "SWIN_tile_overlap": 8, "SWIN_torch_compile": false, "control_net_detectedmap_dir": "detected_maps", "control_net_models_path": "", "control_net_modules_path": "", "control_net_unit_count": 3, "control_net_model_cache_size": 5, "control_net_no_detectmap": false, "control_net_detectmap_autosaving": false, "control_net_allow_script_control": false, "control_net_sync_field_args": true, "controlnet_show_batch_images_in_ui": false, "controlnet_increment_seed_during_batch": false, "controlnet_disable_openpose_edit": false, "controlnet_disable_photopea_edit": false, "controlnet_photopea_warning": true, "controlnet_input_thumbnail": true, "tac_tagFile": "danbooru.csv", "tac_active": true, "tac_activeIn.txt2img": true, "tac_activeIn.img2img": true, "tac_activeIn.negativePrompts": true, "tac_activeIn.thirdParty": true, "tac_activeIn.modelList": "", "tac_activeIn.modelListMode": "Blacklist", "tac_slidingPopup": true, "tac_maxResults": 5, "tac_showAllResults": false, "tac_resultStepLength": 100, "tac_delayTime": 100, "tac_useWildcards": true, "tac_sortWildcardResults": true, "tac_wildcardExclusionList": "", "tac_skipWildcardRefresh": false, "tac_useEmbeddings": true, "tac_includeEmbeddingsInNormalResults": false, "tac_useHypernetworks": true, "tac_useLoras": true, "tac_useLycos": true, "tac_useLoraPrefixForLycos": true, "tac_showWikiLinks": false, "tac_showExtraNetworkPreviews": true, "tac_modelSortOrder": "Name", "tac_useStyleVars": false, "tac_replaceUnderscores": true, "tac_escapeParentheses": true, "tac_appendComma": true, "tac_appendSpace": true, "tac_alwaysSpaceAtEnd": true, "tac_modelKeywordCompletion": "Never", "tac_modelKeywordLocation": "Start of prompt", "tac_wildcardCompletionMode": "To next folder level", "tac_alias.searchByAlias": true, "tac_alias.onlyShowAlias": false, "tac_translation.translationFile": "Tags-zh-full-pack.csv", "tac_translation.oldFormat": false, "tac_translation.searchByTranslation": true, "tac_translation.liveTranslation": false, "tac_extra.extraFile": "extra-quality-tags.csv", "tac_extra.addMode": "Insert before", "tac_chantFile": "demo-chants.json", "tac_keymap": "{\n \"MoveUp\": \"ArrowUp\",\n \"MoveDown\": \"ArrowDown\",\n \"JumpUp\": \"PageUp\",\n \"JumpDown\": \"PageDown\",\n \"JumpToStart\": \"Home\",\n \"JumpToEnd\": \"End\",\n \"ChooseSelected\": \"Enter\",\n \"ChooseFirstOrSelected\": \"Tab\",\n \"Close\": \"Escape\"\n}", "tac_colormap": "{\n \"danbooru\": {\n \"-1\": [\"red\", \"maroon\"],\n \"0\": [\"lightblue\", \"dodgerblue\"],\n \"1\": [\"indianred\", \"firebrick\"],\n \"3\": [\"violet\", \"darkorchid\"],\n \"4\": [\"lightgreen\", \"darkgreen\"],\n \"5\": [\"orange\", \"darkorange\"]\n },\n \"e621\": {\n \"-1\": [\"red\", \"maroon\"],\n \"0\": [\"lightblue\", \"dodgerblue\"],\n \"1\": [\"gold\", \"goldenrod\"],\n \"3\": [\"violet\", \"darkorchid\"],\n \"4\": [\"lightgreen\", \"darkgreen\"],\n \"5\": [\"tomato\", \"darksalmon\"],\n \"6\": [\"red\", \"maroon\"],\n \"7\": [\"whitesmoke\", \"black\"],\n \"8\": [\"seagreen\", \"darkseagreen\"]\n }\n}", "tac_refreshTempFiles": "Refresh TAC temp files", "ad_max_models": 2, "ad_extra_models_dir": "", "ad_save_previews": false, "ad_save_images_before": false, "ad_only_seleted_scripts": true, "ad_script_names": "dynamic_prompting,dynamic_thresholding,wildcard_recursive,wildcards,lora_block_weight,negpip", "ad_bbox_sortby": "None", "ad_same_seed_for_each_tap": false, "use_aria2": true, "disable_dns": false, "show_log": false, "split_aria2": 64, "aria2_flags": "", "unpack_zip": false, "save_api_info": false, "auto_save_all_img": false, "custom_api_key": "0c0a964852e4f950a8fb27747a51778f", "hide_early_access": true, "use_LORA": true, "dot_subfolders": true, "use_local_html": false, "page_header": false, "video_playback": true, "individual_meta_btn": true, "update_log": true, "image_location": "", "sub_image_location": true, "local_path_in_html": false, "save_to_custom": false, "insert_sub_1": false, "insert_sub_2": false, "insert_sub_3": false, "insert_sub_4": false, "insert_sub_5": false, "insert_sub_6": false, "insert_sub_7": false, "insert_sub_8": false, "insert_sub_9": false, "insert_sub_10": false, "insert_sub_11": false, "insert_sub_12": false, "insert_sub_13": false, "insert_sub_14": false, "Checkpoint_subfolder": "None", "LORA_LoCon_subfolder": "None", "TextualInversion_subfolder": "None", "Poses_subfolder": "None", "Controlnet_subfolder": "None", "Hypernetwork_subfolder": "None", "MotionModule_subfolder": "None", "SWINIR_upscale_subfolder": "None", "REALESRGAN_upscale_subfolder": "None", "GFPGAN_upscale_subfolder": "None", "BSRGAN_upscale_subfolder": "None", "ESRGAN_upscale_subfolder": "None", "VAE_subfolder": "None", "AestheticGradient_subfolder": "None", "Wildcards_subfolder": "None", "Workflows_subfolder": "None", "Other_subfolder": "None", "openpose3d_use_online_version": false, "arh_javascript_aspect_ratio_show": true, "arh_javascript_aspect_ratio": "1:1, 3:2, 4:3, 5:4, 16:9", "arh_ui_javascript_selection_method": "Aspect Ratios Dropdown", "arh_hide_accordion_by_default": true, "arh_expand_by_default": false, "arh_ui_component_order_key": "MaxDimensionScaler, MinDimensionScaler, PredefinedAspectRatioButtons, PredefinedPercentageButtons", "arh_show_max_width_or_height": false, "arh_max_width_or_height": 1024.0, "arh_show_min_width_or_height": false, "arh_min_width_or_height": 1024.0, "arh_show_predefined_aspect_ratios": false, "arh_predefined_aspect_ratio_use_max_dim": false, "arh_predefined_aspect_ratios": "1:1, 4:3, 16:9, 9:16, 21:9", "arh_show_predefined_percentages": false, "arh_predefined_percentages": "25, 50, 75, 125, 150, 175, 200", "arh_predefined_percentages_display_key": "Incremental/decremental percentage (-50%, +50%)", "e621_prompt_username": "", "e621_prompt_api_key": "", "e621_prompt_user_agent": "sd-webui-e621-prompt (nochnoe)", "e621_prompt_use_proxy": false, "e621_prompt_proxy_url": "", "e621_prompt_excluded_tags": "comic, watermark, text, sign, patreon_logo, internal, censored, censored_genitalia, censored_penis, censored_pussy, censored_text, censored_anus, multiple_poses, multiple_images, dialogue, speech_bubble, english_text, dialogue_box, subtitled, thought_bubble, cutaway, conditional_dnp", "e621_prompt_appended_tags": "", "e621_prompt_replace_underscores": true, "e621_prompt_replace_underscores_in_appended": true, "e621_prompt_artist_prefix": "", "e621_prompt_meta_prefix": "", "e621_prompt_species_prefix": "", "e621_prompt_character_prefix": "", "e621_prompt_lore_prefix": "", "e621_prompt_general_prefix": "", "e621_prompt_copyright_prefix": "", "e621_prompt_invalid_prefix": "", "e621_prompt_rating_prefix": "rating:", "e621_prompt_rating_format": "short", "sam_use_local_groundingdino": false, "promptgen_names": "AUTOMATIC/promptgen-lexart, AUTOMATIC/promptgen-majinai-safe, AUTOMATIC/promptgen-majinai-unsafe", "promptgen_device": "gpu", "sd_checkpoint_hash": "ef3285adea0b7f20b4202b566c968e71cc7d887ac4b990c031f0e98a5a8abf58", "outdir_samples": "", "outdir_txt2img_samples": "H:\SD-GUI-1.5.0\output\txt2img-images", "outdir_img2img_samples": "H:\SD-GUI-1.5.0\output\img2img-images", "outdir_extras_samples": "H:\SD-GUI-1.5.0\output\extras-images", "outdir_grids": "", "outdir_txt2img_grids": "H:\SD-GUI-1.5.0\output\txt2img-grids", "outdir_img2img_grids": "H:\SD-GUI-1.5.0\output\img2img-grids", "outdir_save": "H:\SD-GUI-1.5.0\log\images", "outdir_init_images": "H:\SD-GUI-1.5.0\output\init-images", "samples_save": true, "samples_format": "png", "samples_filename_pattern": "", "save_images_add_number": true, "save_images_replace_action": "Replace", "grid_save": true, "grid_format": "png", "grid_extended_filename": false, "grid_only_if_multiple": true, "grid_prevent_empty_spots": false, "grid_zip_filename_pattern": "", "n_rows": -1, "font": "", "grid_text_active_color": "#000000", "grid_text_inactive_color": "#999999", "grid_background_color": "#ffffff", "save_images_before_face_restoration": false, "save_images_before_highres_fix": false, "save_images_before_color_correction": false, "save_mask": false, "save_mask_composite": false, "jpeg_quality": 80, "webp_lossless": false, "export_for_4chan": true, "img_downscale_threshold": 4.0, "target_side_length": 4000.0, "img_max_size_mp": 200.0, "use_original_name_batch": true, "use_upscaler_name_as_suffix": false, "save_selected_only": true, "save_init_img": false, "temp_dir": "", "clean_temp_dir_at_start": false, "save_incomplete_images": false, "notification_audio": true, "notification_volume": 100, "save_to_dirs": true, "grid_save_to_dirs": true, "use_save_to_dirs_for_ui": false, "directories_filename_pattern": "[date]", "directories_max_prompt_words": 8, "auto_backcompat": true, "use_old_emphasis_implementation": false, "use_old_karras_scheduler_sigmas": false, "no_dpmpp_sde_batch_determinism": false, "use_old_hires_fix_width_height": false, "dont_fix_second_order_samplers_schedule": false, "hires_fix_use_firstpass_conds": false, "use_old_scheduling": false, "use_downcasted_alpha_bar": false, "lora_functional": false, "extra_networks_show_hidden_directories": true, "extra_networks_dir_button_function": false, "extra_networks_hidden_models": "When searched", "extra_networks_default_multiplier": 1, "extra_networks_card_width": 0.0, "extra_networks_card_height": 0.0, "extra_networks_card_text_scale": 1, "extra_networks_card_show_desc": true, "extra_networks_card_description_is_html": false, "extra_networks_card_order_field": "Path", "extra_networks_card_order": "Ascending", "extra_networks_tree_view_default_enabled": false, "extra_networks_add_text_separator": " ", "ui_extra_networks_tab_reorder": "", "textual_inversion_print_at_load": false, "textual_inversion_add_hashes_to_infotext": true, "sd_hypernetwork": "None", "sd_lora": "None", "lora_preferred_name": "Alias from file", "lora_add_hashes_to_infotext": true, "lora_show_all": false, "lora_hide_unknown_for_versions": [], "lora_in_memory_limit": 0, "lora_not_found_warning_console": false, "lora_not_found_gradio_warning": false, "cross_attention_optimization": "Automatic", "s_min_uncond": 0, "token_merging_ratio": 0, "token_merging_ratio_img2img": 0, "token_merging_ratio_hr": 0, "pad_cond_uncond": false, "pad_cond_uncond_v0": false, "persistent_cond_cache": true, "batch_cond_uncond": true, "fp8_storage": "Enable", "cache_fp16_weight": false, "hide_samplers": [ "Heun", "DPM2 a", "DPM++ 2S a", "DPM++ 2M", "DPM++ SDE", "DPM++ 2M Karras", "DPM++ 2M SDE", "LMS", "DPM++ SDE Karras", "DPM++ 2M SDE Heun", "DPM++ 2M SDE Heun Karras", "DPM++ 2M SDE Exponential", "DPM++ 2M SDE Heun Exponential", "DPM++ 2M SDE Karras", "DPM++ 3M SDE", "DPM++ 3M SDE Karras", "DPM++ 3M SDE Exponential", "DPM fast", "DPM adaptive", "LMS Karras", "DPM2 Karras", "DPM2 a Karras", "DPM++ 2S a Karras", "DDIM", "PLMS", "LCM", "DDPM", "DDPM Karras", "LCM Karras" ], "eta_ddim": 0, "eta_ancestral": 1, "ddim_discretize": "uniform", "s_churn": 0, "s_tmin": 0, "s_tmax": 0, "s_noise": 1, "k_sched_type": "Automatic", "sigma_min": 0.0, "sigma_max": 0.0, "rho": 0.0, "eta_noise_seed_delta": 0, "always_discard_next_to_last_sigma": false, "sgm_noise_multiplier": false, "uni_pc_variant": "bh1", "uni_pc_skip_type": "time_uniform", "uni_pc_order": 3, "uni_pc_lower_order_final": true, "sd_noise_schedule": "Default", "sd_checkpoints_limit": 1, "sd_checkpoints_keep_in_cpu": true, "sd_checkpoint_cache": 0, "sd_unet": "Automatic", "enable_quantization": false, "emphasis": "Original", "enable_batch_seeds": true, "comma_padding_backtrack": 20, "upcast_attn": false, "randn_source": "GPU", "tiling": false, "hires_fix_refiner_pass": "second pass", "enable_prompt_comments": true, "sdxl_crop_top": 0.0, "sdxl_crop_left": 0.0, "sdxl_refiner_low_aesthetic_score": 2.5, "sdxl_refiner_high_aesthetic_score": 6.0, "sd_vae_checkpoint_cache": 0, "sd_vae_overrides_per_model_preferences": true, "auto_vae_precision_bfloat16": false, "auto_vae_precision": true, "sd_vae_encode_method": "Full", "sd_vae_decode_method": "Full", "inpainting_mask_weight": 1, "initial_noise_multiplier": 1, "img2img_extra_noise": 0, "img2img_color_correction": false, "img2img_fix_steps": false, "img2img_background_color": "#ffffff", "img2img_editor_height": 720, "img2img_sketch_default_brush_color": "#ffffff", "img2img_inpaint_mask_brush_color": "#ffffff", "img2img_inpaint_sketch_default_brush_color": "#ffffff", "return_mask": false, "return_mask_composite": false, "img2img_batch_show_results_limit": 32, "overlay_inpaint": true, "return_grid": true, "do_not_show_images": false, "js_modal_lightbox": true, "js_modal_lightbox_initially_zoomed": true, "js_modal_lightbox_gamepad": false, "js_modal_lightbox_gamepad_repeat": 250.0, "sd_webui_modal_lightbox_icon_opacity": 1, "sd_webui_modal_lightbox_toolbar_opacity": 0.9, "gallery_height": "", "open_dir_button_choice": "Subdirectory", "enable_pnginfo": true, "save_txt": false, "add_model_name_to_info": true, "add_model_hash_to_info": true, "add_vae_name_to_info": true, "add_vae_hash_to_info": true, "add_user_name_to_info": false, "add_version_to_infotext": true, "disable_weights_auto_swap": true, "infotext_skip_pasting": [], "infotext_styles": "Apply if any", "show_progressbar": true, "live_previews_enable": true, "live_previews_image_format": "jpeg", "show_progress_grid": true, "show_progress_every_n_steps": 1, "show_progress_type": "Approx NN", "live_preview_allow_lowvram_full": false, "live_preview_content": "Combined", "live_preview_refresh_period": 150.0, "live_preview_fast_interrupt": true, "js_live_preview_in_modal_lightbox": false, "keyedit_precision_attention": 0.1, "keyedit_precision_extra": 0.05, "keyedit_delimiters": ".,\/!?%^*;:{}=`~() ", "keyedit_delimiters_whitespace": [ "Tab", "Carriage Return", "Line Feed" ], "keyedit_move": true, "disable_token_counters": false, "include_styles_into_token_counters": true, "extra_options_txt2img": [], "extra_options_img2img": [], "extra_options_cols": 1, "extra_options_accordion": false, "compact_prompt_box": false, "samplers_in_dropdown": true, "dimensions_and_batch_together": true, "sd_checkpoint_dropdown_use_short": false, "hires_fix_show_sampler": false, "hires_fix_show_prompts": false, "txt2img_settings_accordion": false, "img2img_settings_accordion": false, "interrupt_after_current": true, "localization": "zh-Hans (Stable)", "quicksettings_list": [ "sd_model_checkpoint", "sd_vae", "CLIP_stop_at_last_layers" ], "ui_tab_order": [], "hidden_tabs": [], "ui_reorder_list": [], "gradio_theme": "Default", "gradio_themes_cache": true, "show_progress_in_title": true, "send_seed": true, "send_size": true, "api_enable_requests": true, "api_forbid_local_requests": true, "api_useragent": "", "auto_launch_browser": "Local", "enable_console_prompts": false, "show_warnings": false, "show_gradio_deprecation_warnings": true, "memmon_poll_rate": 8, "samples_log_stdout": false, "multiple_tqdm": true, "enable_upscale_progressbar": true, "print_hypernet_extra": false, "list_hidden_files": true, "disable_mmap_load_safetensors": false, "hide_ldm_prints": true, "dump_stacks_on_signal": false, "face_restoration": false, "face_restoration_model": "CodeFormer", "code_former_weight": 0.5, "face_restoration_unload": false, "postprocessing_enable_in_main_ui": [], "postprocessing_operation_order": [], "upscaling_max_images_in_cache": 5, "postprocessing_existing_caption_action": "Ignore", "ESRGAN_tile": 192, "ESRGAN_tile_overlap": 8, "realesrgan_enabled_models": [ "R-ESRGAN 4x+", "R-ESRGAN 4x+ Anime6B" ], "dat_enabled_models": [ "DAT x2", "DAT x3", "DAT x4" ], "DAT_tile": 192, "DAT_tile_overlap": 8, "unload_models_when_training": false, "pin_memory": false, "save_optimizer_state": false, "save_training_settings_to_txt": true, "dataset_filename_word_regex": "", "dataset_filename_join_string": " ", "training_image_repeats_per_epoch": 1, "training_write_csv_every": 500.0, "training_xattention_optimizations": false, "training_enable_tensorboard": false, "training_tensorboard_save_images": false, "training_tensorboard_flush_every": 120.0, "canvas_hotkey_zoom": "Alt", "canvas_hotkey_adjust": "Ctrl", "canvas_hotkey_shrink_brush": "Q", "canvas_hotkey_grow_brush": "W", "canvas_hotkey_move": "F", "canvas_hotkey_fullscreen": "S", "canvas_hotkey_reset": "R", "canvas_hotkey_overlap": "O", "canvas_show_tooltip": true, "canvas_auto_expand": true, "canvas_blur_prompt": false, "canvas_disabled_functions": [ "Overlap" ], "interrogate_keep_models_in_memory": false, "interrogate_return_ranks": false, "interrogate_clip_num_beams": 1, "interrogate_clip_min_length": 24, "interrogate_clip_max_length": 48, "interrogate_clip_dict_limit": 1500.0, "interrogate_clip_skip_categories": [], "interrogate_deepbooru_score_threshold": 0.5, "deepbooru_sort_alpha": false, "deepbooru_use_spaces": true, "deepbooru_escape": true, "deepbooru_filter_tags": "", "sd_model_checkpoint": "Useful\fiamixRebootHNSFW_v80.safetensors [ef3285adea]", "sd_vae": "anything-v4.5.pt", "disabled_extensions": [ "Stable-Diffusion-Webui-Civitai-Helper", "multidiffusion-upscaler-for-automatic1111", "sd-webui-controlnet", "stable-diffusion-webui-localization-zh_CN" ], "disable_all_extensions": "none", "CLIP_stop_at_last_layers": 2, "ch_civiai_api_key": "", "ch_dl_lyco_to_lora": false, "ch_open_url_with_js": true, "ch_hide_buttons": [], "ch_always_display": false, "ch_show_btn_on_thumb": true, "ch_max_size_preview": true, "ch_nsfw_preview_threshold": "Allow All", "ch_dl_webui_metadata": true, "ch_proxy": "", "regprp_debug": false, "regprp_hidepmask": false, "model_desc_to_json": true, "custom_civitai_proxy": "", "cabundle_path_proxy": "", "disable_sll_proxy": false }, "Startup": { "total": 40.217641830444336, "records": { "initial startup": 0.04804253578186035, "prepare environment/checks": 0.016629934310913086, "prepare environment/git version info": 0.1355447769165039, "prepare environment/torch GPU test": 3.1285510063171387, "prepare environment/clone repositores": 0.3350515365600586, "prepare environment/run extensions installers/a1111-sd-webui-tagcomplete": 0.0009999275207519531, "prepare environment/run extensions installers/adetailer": 0.36881089210510254, "prepare environment/run extensions installers/multi-subject-render": 0.3438394069671631, "prepare environment/run extensions installers/OneButtonPrompt": 0.0004990100860595703, "prepare environment/run extensions installers/sd-civitai-browser-plus": 0.3720738887786865, "prepare environment/run extensions installers/sd-forge-layerdiffuse": 0.0, "prepare environment/run extensions installers/sd-webui-aspect-ratio-helper": 0.0005016326904296875, "prepare environment/run extensions installers/sd-webui-e621-prompt": 0.0, "prepare environment/run extensions installers/sd-webui-infinite-image-browsing": 0.9932210445404053, "prepare environment/run extensions installers/sd-webui-prompt-all-in-one": 0.32576918601989746, "prepare environment/run extensions installers/sd-webui-segment-anything": 0.37536096572875977, "prepare environment/run extensions installers/sd_delete_button": 0.34474635124206543, "prepare environment/run extensions installers/stable-diffusion-webui-localization-zh_Hans": 0.0004987716674804688, "prepare environment/run extensions installers/stable-diffusion-webui-promptgen": 0.0, "prepare environment/run extensions installers/stable-diffusion-webui-rembg": 0.323641300201416, "prepare environment/run extensions installers/ultimate-upscale-for-automatic1111": 0.0004999637603759766, "prepare environment/run extensions installers": 3.4504623413085938, "prepare environment/run extensions_builtin installers/canvas-zoom-and-pan": 0.0009999275207519531, "prepare environment/run extensions_builtin installers/extra-options-section": 0.0004999637603759766, "prepare environment/run extensions_builtin installers/forge_legacy_preprocessors": 0.9503567218780518, "prepare environment/run extensions_builtin installers/forge_preprocessor_inpaint": 0.0, "prepare environment/run extensions_builtin installers/forge_preprocessor_marigold": 0.0, "prepare environment/run extensions_builtin installers/forge_preprocessor_normalbae": 0.0010066032409667969, "prepare environment/run extensions_builtin installers/forge_preprocessor_recolor": 0.0005059242248535156, "prepare environment/run extensions_builtin installers/forge_preprocessor_reference": 0.0, "prepare environment/run extensions_builtin installers/forge_preprocessor_revision": 0.0005006790161132812, "prepare environment/run extensions_builtin installers/forge_preprocessor_tile": 0.0005064010620117188, "prepare environment/run extensions_builtin installers/LDSR": 0.0, "prepare environment/run extensions_builtin installers/Lora": 0.0005044937133789062, "prepare environment/run extensions_builtin installers/mobile": 0.0, "prepare environment/run extensions_builtin installers/prompt-bracket-checker": 0.000499725341796875, "prepare environment/run extensions_builtin installers/ScuNET": 0.0005009174346923828, "prepare environment/run extensions_builtin installers/sd_forge_controlllite": 0.0, "prepare environment/run extensions_builtin installers/sd_forge_controlnet": 0.9364960193634033, "prepare environment/run extensions_builtin installers/sd_forge_controlnet_example": 0.0, "prepare environment/run extensions_builtin installers/sd_forge_dynamic_thresholding": 0.0005016326904296875, "prepare environment/run extensions_builtin installers/sd_forge_fooocus_inpaint": 0.0004994869232177734, "prepare environment/run extensions_builtin installers/sd_forge_freeu": 0.0, "prepare environment/run extensions_builtin installers/sd_forge_hypertile": 0.0005009174346923828, "prepare environment/run extensions_builtin installers/sd_forge_ipadapter": 0.0, "prepare environment/run extensions_builtin installers/sd_forge_kohya_hrfix": 0.0005006790161132812, "prepare environment/run extensions_builtin installers/sd_forge_latent_modifier": 0.0, "prepare environment/run extensions_builtin installers/sd_forge_multidiffusion": 0.0004992485046386719, "prepare environment/run extensions_builtin installers/sd_forge_neveroom": 0.0, "prepare environment/run extensions_builtin installers/sd_forge_photomaker": 0.0004999637603759766, "prepare environment/run extensions_builtin installers/sd_forge_sag": 0.0, "prepare environment/run extensions_builtin installers/sd_forge_stylealign": 0.0005002021789550781, "prepare environment/run extensions_builtin installers/sd_forge_svd": 0.0, "prepare environment/run extensions_builtin installers/sd_forge_z123": 0.0004994869232177734, "prepare environment/run extensions_builtin installers/soft-inpainting": 0.0, "prepare environment/run extensions_builtin installers/SwinIR": 0.0004987716674804688, "prepare environment/run extensions_builtin installers": 1.8968777656555176, "prepare environment": 9.027117729187012, "launcher": 0.004500865936279297, "import torch": 8.611764669418335, "import gradio": 1.9042775630950928, "setup paths": 1.4137825965881348, "import ldm": 0.013722658157348633, "import sgm": 0.0, "initialize shared": 0.24996733665466309, "other imports": 0.9595975875854492, "opts onchange": 0.0, "setup SD model": 0.000499725341796875, "setup codeformer": 0.0024995803833007812, "setup gfpgan": 0.17789459228515625, "set samplers": 0.0, "list extensions": 0.014509916305541992, "restore config state file": 0.0, "list SD models": 0.250363826751709, "list localizations": 0.008518457412719727, "load scripts/custom_code.py": 0.032536983489990234, "load scripts/img2imgalt.py": 0.0010004043579101562, "load scripts/loopback.py": 0.0, "load scripts/outpainting_mk_2.py": 0.0004987716674804688, "load scripts/poor_mans_outpainting.py": 0.0004999637603759766, "load scripts/postprocessing_caption.py": 0.0, "load scripts/postprocessing_codeformer.py": 0.0, "load scripts/postprocessing_create_flipped_copies.py": 0.0011374950408935547, "load scripts/postprocessing_focal_crop.py": 0.02891397476196289, "load scripts/postprocessing_gfpgan.py": 0.0, "load scripts/postprocessing_split_oversized.py": 0.0, "load scripts/postprocessing_upscale.py": 0.0010046958923339844, "load scripts/processing_autosized_crop.py": 0.0005066394805908203, "load scripts/prompt_matrix.py": 0.0, "load scripts/prompts_from_file.py": 0.0004990100860595703, "load scripts/sd_upscale.py": 0.0005002021789550781, "load scripts/xyz_grid.py": 0.001505136489868164, "load scripts/ldsr_model.py": 2.2333617210388184, "load scripts/lora_script.py": 0.4897310733795166, "load scripts/scunet_model.py": 0.056514739990234375, "load scripts/swinir_model.py": 0.043027639389038086, "load scripts/hotkey_config.py": 0.0004999637603759766, "load scripts/extra_options_section.py": 0.0005009174346923828, "load scripts/legacy_preprocessors.py": 0.03854990005493164, "load scripts/preprocessor_inpaint.py": 0.03499579429626465, "load scripts/preprocessor_marigold.py": 0.4463069438934326, "load scripts/preprocessor_normalbae.py": 0.02001786231994629, "load scripts/preprocessor_recolor.py": 0.0, "load scripts/forge_reference.py": 0.0004992485046386719, "load scripts/preprocessor_revision.py": 0.0005004405975341797, "load scripts/preprocessor_tile.py": 0.0004999637603759766, "load scripts/forge_controllllite.py": 0.04002094268798828, "load scripts/controlnet.py": 0.8486363887786865, "load scripts/xyz_grid_support.py": 0.0005016326904296875, "load scripts/sd_forge_controlnet_example.py": 0.0004990100860595703, "load scripts/forge_dynamic_thresholding.py": 0.012624740600585938, "load scripts/forge_fooocus_inpaint.py": 0.0005030632019042969, "load scripts/forge_freeu.py": 0.013515233993530273, "load scripts/forge_hypertile.py": 0.011499643325805664, "load scripts/forge_ipadapter.py": 0.01650857925415039, "load scripts/kohya_hrfix.py": 0.011000633239746094, "load scripts/forge_latent_modifier.py": 0.01250004768371582, "load scripts/forge_multidiffusion.py": 0.02551579475402832, "load scripts/forge_never_oom.py": 0.0, "load scripts/forge_photomaker.py": 0.011500120162963867, "load scripts/forge_sag.py": 0.011000633239746094, "load scripts/forge_stylealign.py": 0.0004992485046386719, "load scripts/forge_svd.py": 0.06819725036621094, "load scripts/forge_z123.py": 0.057098388671875, "load scripts/soft_inpainting.py": 0.0004999637603759766, "load scripts/api.py": 2.922767162322998, "load scripts/onebuttonprompt.py": 0.007009267807006836, "load scripts/model_keyword_support.py": 0.05104231834411621, "load scripts/shared_paths.py": 0.0030031204223632812, "load scripts/tag_autocomplete_helper.py": 0.3452763557434082, "load scripts/!adetailer.py": 0.23127245903015137, "load scripts/multirender.py": 0.0010004043579101562, "load scripts/simple_depthmap.py": 0.02803182601928711, "load scripts/civitai_api.py": 0.25066494941711426, "load scripts/civitai_download.py": 0.0025005340576171875, "load scripts/civitai_file_manage.py": 0.0009984970092773438, "load scripts/civitai_global.py": 0.0, "load scripts/civitai_gui.py": 0.12203669548034668, "load scripts/forge_layerdiffusion.py": 0.014508485794067383, "load scripts/sd_webui_aspect_ratio_helper.py": 0.09602785110473633, "load scripts/e621_prompt.py": 0.04650688171386719, "load scripts/iib_setup.py": 0.20460891723632812, "load scripts/on_app_started.py": 0.1627955436706543, "load scripts/auto.py": 0.000499725341796875, "load scripts/dino.py": 0.0005004405975341797, "load scripts/process_params.py": 0.0004994869232177734, "load scripts/sam.py": 0.09472894668579102, "load scripts/sd_delete_button.py": 0.090301513671875, "load scripts/promptgen.py": 0.13359737396240234, "load scripts/postprocessing_rembg.py": 0.0005004405975341797, "load scripts/ultimate-upscale.py": 0.000499725341796875, "load scripts/comments.py": 0.053521156311035156, "load scripts/refiner.py": 0.0004994869232177734, "load scripts/seed.py": 0.0004999637603759766, "load scripts": 9.44143033027649, "load upscalers": 0.002000093460083008, "refresh VAE": 0.0055119991302490234, "refresh textual inversion templates": 0.0005002021789550781, "scripts list_optimizers": 0.03202629089355469, "scripts list_unets": 0.0, "reload hypernetworks": 0.0005004405975341797, "initialize extra networks": 0.19240069389343262, "scripts before_ui_callback": 0.0025110244750976562, "create ui": 2.906383514404297, "gradio launch": 3.22060227394104, "add APIs": 0.6005697250366211, "app_started_callback/lora_script.py": 0.0, "app_started_callback/controlnet.py": 0.0015134811401367188, "app_started_callback/api.py": 0.008507251739501953, "app_started_callback/tag_autocomplete_helper.py": 0.001998424530029297, "app_started_callback/!adetailer.py": 0.0, "app_started_callback/iib_setup.py": 0.019042015075683594, "app_started_callback/on_app_started.py": 1.1590847969055176, "app_started_callback": 1.1901459693908691 } }, "Packages": [ "absl-py==2.1.0", "accelerate==0.21.0", "addict==2.4.0", "aenum==3.1.15", "aiofiles==23.2.1", "aiohttp==3.9.3", "aiosignal==1.3.1", "albumentations==1.4.1", "aliyun-python-sdk-alimt==3.2.0", "aliyun-python-sdk-core==2.13.10", "altair==5.2.0", "antlr4-python3-runtime==4.9.3", "anyio==3.7.1", "async-timeout==4.0.3", "attrs==23.2.0", "basicsr==1.4.2", "beautifulsoup4==4.12.3", "blendmodes==2022", "boto3==1.34.60", "botocore==1.34.60", "certifi==2024.2.2", "cffi==1.16.0", "chardet==5.2.0", "charset-normalizer==3.3.2", "clean-fid==0.1.35", "click==8.1.7", "clip==1.0", "colorama==0.4.6", "coloredlogs==15.0.1", "colorlog==6.8.2", "contourpy==1.2.0", "cryptography==42.0.5", "cssselect2==0.7.0", "cycler==0.12.1", "cython==3.0.9", "defusedxml==0.7.1", "deprecation==2.1.0", "depth-anything==2024.1.22.0", "diffusers==0.25.0", "dill==0.3.8", "distro==1.9.0", "easydict==1.13", "einops==0.4.1", "embreex==2.17.7.post4", "exceptiongroup==1.2.0", "facexlib==0.3.0", "fake-useragent==1.5.0", "fastapi==0.94.0", "ffmpy==0.3.2", "filelock==3.13.1", "filterpy==1.4.5", "flatbuffers==24.3.7", "fonttools==4.49.0", "frozenlist==1.4.1", "fsspec==2024.2.0", "ftfy==6.1.3", "future==1.0.0", "fvcore==0.1.5.post20221221", "gitdb==4.0.11", "gitpython==3.1.32", "gradio-client==0.5.0", "gradio==3.41.2", "grpcio==1.62.1", "h11==0.12.0", "handrefinerportable==2024.2.12.0", "httpcore==0.15.0", "httpx==0.24.1", "huggingface-hub==0.21.4", "humanfriendly==10.0", "idna==3.6", "imageio==2.34.0", "importlib-metadata==7.0.2", "importlib-resources==6.1.3", "inflection==0.5.1", "insightface==0.7.3", "iopath==0.1.9", "jax==0.4.25", "jinja2==3.1.3", "jmespath==0.10.0", "joblib==1.3.2", "jsonmerge==1.8.0", "jsonschema-specifications==2023.12.1", "jsonschema==4.21.1", "kiwisolver==1.4.5", "kornia==0.6.7", "lark==1.1.2", "lazy-loader==0.3", "lightning-utilities==0.10.1", "llvmlite==0.42.0", "lmdb==1.4.1", "lxml==5.1.0", "mapbox-earcut==1.0.1", "markdown-it-py==3.0.0", "markdown==3.5.2", "markupsafe==2.1.5", "matplotlib==3.8.3", "mdurl==0.1.2", "mediapipe==0.10.11", "ml-dtypes==0.3.2", "mpmath==1.3.0", "multidict==6.0.5", "multiprocess==0.70.16", "networkx==3.2.1", "numba==0.59.0", "numpy==1.26.2", "omegaconf==2.2.3", "onnx==1.15.0", "onnxruntime==1.17.1", "open-clip-torch==2.20.0", "openai==1.13.3", "opencv-contrib-python==4.9.0.80", "opencv-python-headless==4.9.0.80", "opencv-python==4.9.0.80", "opt-einsum==3.3.0", "orjson==3.9.15", "packaging==24.0", "pandas==2.2.1", "pathos==0.3.2", "piexif==1.1.3", "pillow==9.5.0", "pip==23.0.1", "platformdirs==4.2.0", "pooch==1.8.1", "portalocker==2.8.2", "pox==0.3.4", "ppft==1.7.6.8", "prettytable==3.10.0", "protobuf==3.20.3", "psutil==5.9.5", "py-cpuinfo==9.0.0", "pycocotools==2.0.7", "pycollada==0.8", "pycparser==2.21", "pydantic==1.10.14", "pydub==0.25.1", "pyexecjs==1.5.1", "pygments==2.17.2", "pymatting==1.1.12", "pyparsing==3.1.2", "pyreadline3==3.4.1", "pysocks==1.7.1", "python-dateutil==2.9.0.post0", "python-dotenv==1.0.1", "python-multipart==0.0.9", "pytorch-lightning==1.9.4", "pytz==2024.1", "pywavelets==1.5.0", "pywin32==306", "pyyaml==6.0.1", "referencing==0.33.0", "regex==2023.12.25", "rembg==2.0.50", "reportlab==4.1.0", "requests==2.31.0", "resize-right==0.0.2", "rich==13.7.1", "rpds-py==0.18.0", "rtree==1.2.0", "s3transfer==0.10.0", "safetensors==0.4.2", "scikit-image==0.21.0", "scikit-learn==1.4.1.post1", "scipy==1.12.0", "seaborn==0.13.2", "segment-anything==1.0", "semantic-version==2.10.0", "send2trash==1.8.2", "sentencepiece==0.2.0", "setuptools==65.5.0", "shapely==2.0.3", "six==1.16.0", "smmap==5.0.1", "sniffio==1.3.1", "sounddevice==0.4.6", "soupsieve==2.5", "spandrel==0.1.6", "starlette==0.26.1", "supervision==0.18.0", "svg.path==6.3", "svglib==1.5.1", "sympy==1.12", "tabulate==0.9.0", "tb-nightly==2.17.0a20240312", "tensorboard-data-server==0.7.2", "termcolor==2.4.0", "thop==0.1.1.post2209072238", "threadpoolctl==3.3.0", "tifffile==2024.2.12", "timm==0.9.16", "tinycss2==1.2.1", "tokenizers==0.13.3", "tomesd==0.1.3", "tomli==2.0.1", "toolz==0.12.1", "torch==2.1.2+cu121", "torchdiffeq==0.2.3", "torchmetrics==1.3.1", "torchsde==0.2.6", "torchvision==0.16.2+cu121", "tqdm==4.66.2", "trampoline==0.1.2", "transformers==4.30.2", "trimesh==4.2.0", "typing-extensions==4.10.0", "tzdata==2024.1", "ultralytics==8.1.27", "urllib3==2.0.7", "uvicorn==0.28.0", "vhacdx==0.0.5", "wcwidth==0.2.13", "webencodings==0.5.1", "websockets==11.0.3", "werkzeug==3.0.1", "xatlas==0.0.9", "xformers==0.0.23.post1", "xxhash==3.4.1", "yacs==0.1.8", "yapf==0.40.2", "yarl==1.9.4", "zipp==3.17.0", "zipunicode==1.1.1" ] } '+

Console logs

When I using softedge_pidinet:
Traceback (most recent call last):
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\routes.py", line 488, in run_predict
    output = await app.get_blocks().process_api(
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1431, in process_api
    result = await self.call_function(
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1103, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\to_thread.py", line 33, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 877, in run_sync_in_worker_thread
    return await future
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 807, in run
    result = context.run(func, *args)
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\utils.py", line 707, in wrapper
    response = f(*args, **kwargs)
  File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\lib_controlnet\controlnet_ui\controlnet_ui_group.py", line 847, in run_annotator
    result = preprocessor(
  File "I:\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\scripts\legacy_preprocessors.py", line 103, in __call__
    result, is_image = self.call_function(img=input_image, res=resolution, thr_a=slider_1, thr_b=slider_2, **kwargs)
  File "I:\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\legacy_preprocessors\preprocessor.py", line 335, in pidinet
    from annotator.pidinet import apply_pidinet
  File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\annotator\pidinet\__init__.py", line 9, in <module>
    from scripts.utils import load_state_dict
ModuleNotFoundError: No module named 'scripts.utils'

-------------------
When I using softedge_teed:

2024-03-13 00:01:47,323 - ControlNet - INFO - Preview Resolution = 640
Downloading: "https://huggingface.co/bdsqlsz/qinglong_controlnet-lllite/resolve/main/Annotators/7_model.pth" to I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\annotator\downloads\TEED\7_model.pth

Traceback (most recent call last):
  File "C:\Program Files\Python310\lib\urllib\request.py", line 1348, in do_open
    h.request(req.get_method(), req.selector, req.data, headers,
  File "C:\Program Files\Python310\lib\http\client.py", line 1283, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "C:\Program Files\Python310\lib\http\client.py", line 1329, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "C:\Program Files\Python310\lib\http\client.py", line 1278, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "C:\Program Files\Python310\lib\http\client.py", line 1038, in _send_output
    self.send(msg)
  File "C:\Program Files\Python310\lib\http\client.py", line 976, in send
    self.connect()
  File "C:\Program Files\Python310\lib\http\client.py", line 1455, in connect
    self.sock = self._context.wrap_socket(self.sock,
  File "C:\Program Files\Python310\lib\ssl.py", line 513, in wrap_socket
    return self.sslsocket_class._create(
  File "C:\Program Files\Python310\lib\ssl.py", line 1071, in _create
    self.do_handshake()
  File "C:\Program Files\Python310\lib\ssl.py", line 1342, in do_handshake
    self._sslobj.do_handshake()
FileNotFoundError: [Errno 2] No such file or directory

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\routes.py", line 488, in run_predict
    output = await app.get_blocks().process_api(
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1431, in process_api
    result = await self.call_function(
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1103, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\to_thread.py", line 33, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 877, in run_sync_in_worker_thread
    return await future
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 807, in run
    result = context.run(func, *args)
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\utils.py", line 707, in wrapper
    response = f(*args, **kwargs)
  File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\lib_controlnet\controlnet_ui\controlnet_ui_group.py", line 847, in run_annotator
    result = preprocessor(
  File "I:\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\scripts\legacy_preprocessors.py", line 103, in __call__
    result, is_image = self.call_function(img=input_image, res=resolution, thr_a=slider_1, thr_b=slider_2, **kwargs)
  File "I:\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\legacy_preprocessors\preprocessor.py", line 696, in te_hed
    model_te_hed = TEEDDector()
  File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\annotator\teed\__init__.py", line 30, in __init__
    model_path = load_model(
  File "I:\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\annotator\util.py", line 18, in load_model
    load_file_from_url(remote_url, model_dir=model_dir)
  File "I:\stable-diffusion-webui-forge\modules\modelloader.py", line 39, in load_file_from_url
    download_url_to_file(url, cached_file, progress=progress)
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\torch\hub.py", line 620, in download_url_to_file
    u = urlopen(req)
  File "C:\Program Files\Python310\lib\urllib\request.py", line 216, in urlopen
    return opener.open(url, data, timeout)
  File "C:\Program Files\Python310\lib\urllib\request.py", line 519, in open
    response = self._open(req, data)
  File "C:\Program Files\Python310\lib\urllib\request.py", line 536, in _open
    result = self._call_chain(self.handle_open, protocol, protocol +
  File "C:\Program Files\Python310\lib\urllib\request.py", line 496, in _call_chain
    result = func(*args)
  File "C:\Program Files\Python310\lib\urllib\request.py", line 1391, in https_open
    return self.do_open(http.client.HTTPSConnection, req,
  File "C:\Program Files\Python310\lib\urllib\request.py", line 1351, in do_open
    raise URLError(err)
urllib.error.URLError: <urlopen error [Errno 2] No such file or directory>

---------------------
When I using scribble_pidinet:

2024-03-13 00:02:11,665 - ControlNet - INFO - Preview Resolution = 640
Traceback (most recent call last):
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\routes.py", line 488, in run_predict
    output = await app.get_blocks().process_api(
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1431, in process_api
    result = await self.call_function(
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1103, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\to_thread.py", line 33, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 877, in run_sync_in_worker_thread
    return await future
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 807, in run
    result = context.run(func, *args)
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\utils.py", line 707, in wrapper
    response = f(*args, **kwargs)
  File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\lib_controlnet\controlnet_ui\controlnet_ui_group.py", line 847, in run_annotator
    result = preprocessor(
  File "I:\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\scripts\legacy_preprocessors.py", line 103, in __call__
    result, is_image = self.call_function(img=input_image, res=resolution, thr_a=slider_1, thr_b=slider_2, **kwargs)
  File "I:\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\legacy_preprocessors\preprocessor.py", line 362, in scribble_pidinet
    result, _ = pidinet(img, res)
  File "I:\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\legacy_preprocessors\preprocessor.py", line 335, in pidinet
    from annotator.pidinet import apply_pidinet
  File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\annotator\pidinet\__init__.py", line 9, in <module>
    from scripts.utils import load_state_dict
ModuleNotFoundError: No module named 'scripts.utils'
2024-03-13 00:02:41,989 - ControlNet - INFO - Preview Resolution = 640
Traceback (most recent call last):
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\routes.py", line 488, in run_predict
    output = await app.get_blocks().process_api(
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1431, in process_api
    result = await self.call_function(
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1103, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\to_thread.py", line 33, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 877, in run_sync_in_worker_thread
    return await future
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 807, in run
    result = context.run(func, *args)
  File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\utils.py", line 707, in wrapper
    response = f(*args, **kwargs)
  File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\lib_controlnet\controlnet_ui\controlnet_ui_group.py", line 847, in run_annotator
    result = preprocessor(
  File "I:\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\scripts\legacy_preprocessors.py", line 103, in __call__
    result, is_image = self.call_function(img=input_image, res=resolution, thr_a=slider_1, thr_b=slider_2, **kwargs)
  File "I:\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\legacy_preprocessors\preprocessor.py", line 362, in scribble_pidinet
    result, _ = pidinet(img, res)
  File "I:\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\legacy_preprocessors\preprocessor.py", line 335, in pidinet
    from annotator.pidinet import apply_pidinet
  File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\annotator\pidinet\__init__.py", line 9, in <module>
    from scripts.utils import load_state_dict
ModuleNotFoundError: No module named 'scripts.utils'
------------------------
When I using lineart_coarse:

*** Error running process: I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
    Traceback (most recent call last):
      File "I:\stable-diffusion-webui-forge\modules\scripts.py", line 798, in process
        script.process(p, *script_args)
      File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 450, in process
        self.process_unit_after_click_generate(p, unit, params, *args, **kwargs)
      File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 253, in process_unit_after_click_generate
        input_list, resize_mode = self.get_input_data(p, unit, preprocessor)
      File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 192, in get_input_data
        mask = HWC3(np.asarray(a1111_i2i_mask))
      File "I:\stable-diffusion-webui-forge\modules_forge\forge_util.py", line 13, in HWC3
        assert x.dtype == np.uint8
    AssertionError

---
To load target model AutoencoderKL
Begin to load 1 model
*** Error running process_before_every_sampling: I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
    Traceback (most recent call last):
      File "I:\stable-diffusion-webui-forge\modules\scripts.py", line 830, in process_before_every_sampling
        script.process_before_every_sampling(p, *script_args, **kwargs)
      File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 457, in process_before_every_sampling
        self.process_unit_before_every_sampling(p, unit, self.current_params[i], *args, **kwargs)
    KeyError: 0

---
To load target model BaseModel
Begin to load 1 model
Moving model(s) has taken 0.34 seconds
100%|██████████████████████████████████████████████████████████████████████████████████| 16/16 [00:02<00:00,  7.30it/s]
*** Error running postprocess_batch_list: I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
    Traceback (most recent call last):
      File "I:\stable-diffusion-webui-forge\modules\scripts.py", line 854, in postprocess_batch_list
        script.postprocess_batch_list(p, pp, *script_args, **kwargs)
      File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 463, in postprocess_batch_list
        self.process_unit_after_every_sampling(p, unit, self.current_params[i], pp, *args, **kwargs)
    KeyError: 0

---

------------------------------------

Additional information

The vast majority of preprocessors are usable for me, with only a few of them reporting errors. There were no related errors when using the regular Controlnet instead of the Forge version on a regular AAAA Webui

NaughtDZ commented 8 months ago

By the way,how do i use normal sd-webui-controlnet rather than sd_forge_controlnet? The webui always force uncheck sd-webui-controlnet

lipeng1109 commented 8 months ago

By the way,how do i use normal sd-webui-controlnet rather than sd_forge_controlnet? The webui always force uncheck sd-webui-controlnet

Vendaciousness commented 7 months ago

I had a similar error with the depth_midas preprocessor in SF:

venv "C:\Code\stable-diffusion-webui-forge\venv\Scripts\Python.exe"
Python 3.10.9 (tags/v3.10.9:1dd9be6, Dec  6 2022, 20:01:21) [MSC v.1934 64 bit (AMD64)]
Version: f0.0.17v1.8.0rc-latest-276-g29be1da7
Commit hash: 29be1da7cf2b5dccfc70fbdd33eb35c56a31ffb7
Launching Web UI with arguments: --always-gpu --pin-shared-memory --cuda-malloc --cuda-stream
Using cudaMallocAsync backend.
Total VRAM 10239 MB, total RAM 32448 MB
Set vram state to: HIGH_VRAM
Always pin shared GPU memory
Device: cuda:0 NVIDIA GeForce RTX 3080 : cudaMallocAsync
VAE dtype: torch.bfloat16
CUDA Stream Activated:  True
Using pytorch cross attention
ControlNet preprocessor location: C:\Code\stable-diffusion-webui-forge\models\ControlNetPreprocessor
Loading weights [be9b9fccd2] from C:\Code\stable-diffusion-webui-forge\models\Stable-diffusion\lightningFusionXL_v12Experimental.safetensors
2024-05-05 07:57:57,937 - ControlNet - INFO - ControlNet UI callback registered.
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
model_type EPS
UNet ADM Dimension 2816
Startup time: 25.8s (prepare environment: 4.8s, import torch: 5.4s, import gradio: 1.6s, setup paths: 1.5s, initialize shared: 1.1s, other imports: 1.0s, list SD models: 0.1s, load scripts: 3.6s, create ui: 5.3s, gradio launch: 1.4s).
Using pytorch attention in VAE
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
Using pytorch attention in VAE
extra {'cond_stage_model.clip_l.text_projection', 'cond_stage_model.clip_l.logit_scale', 'cond_stage_model.clip_g.transformer.text_model.embeddings.position_ids'}
loaded straight to GPU
To load target model SDXL
Begin to load 1 model
Moving model(s) has taken 0.04 seconds
To load target model SDXLClipModel
Begin to load 1 model
Moving model(s) has taken 0.72 seconds
Model loaded in 65.5s (load weights from disk: 5.9s, forge load real models: 58.3s, calculate empty prompt: 1.1s).
Traceback (most recent call last):
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\routes.py", line 488, in run_predict
    output = await app.get_blocks().process_api(
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1431, in process_api
    result = await self.call_function(
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1103, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\to_thread.py", line 33, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 877, in run_sync_in_worker_thread
    return await future
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 807, in run
    result = context.run(func, *args)
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\utils.py", line 707, in wrapper
    response = f(*args, **kwargs)
  File "C:\Code\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 703, in pages_html
    create_html()
  File "C:\Code\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 699, in create_html
    ui.pages_contents = [pg.create_html(ui.tabname) for pg in ui.stored_extra_pages]
  File "C:\Code\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 699, in <listcomp>
    ui.pages_contents = [pg.create_html(ui.tabname) for pg in ui.stored_extra_pages]
  File "C:\Code\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 518, in create_html
    self.items = {x["name"]: x for x in items_list}
  File "C:\Code\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 518, in <dictcomp>
    self.items = {x["name"]: x for x in items_list}
  File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\Lora\ui_extra_networks_lora.py", line 82, in list_items
    item = self.create_item(name, index)
  File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\Lora\ui_extra_networks_lora.py", line 69, in create_item
    elif shared.sd_model.is_sdxl and sd_version != network.SdVersion.SDXL:
AttributeError: 'NoneType' object has no attribute 'is_sdxl'
Traceback (most recent call last):
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\routes.py", line 488, in run_predict
    output = await app.get_blocks().process_api(
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1431, in process_api
    result = await self.call_function(
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1103, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\to_thread.py", line 33, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 877, in run_sync_in_worker_thread
    return await future
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 807, in run
    result = context.run(func, *args)
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\utils.py", line 707, in wrapper
    response = f(*args, **kwargs)
  File "C:\Code\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 703, in pages_html
    create_html()
  File "C:\Code\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 699, in create_html
    ui.pages_contents = [pg.create_html(ui.tabname) for pg in ui.stored_extra_pages]
  File "C:\Code\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 699, in <listcomp>
    ui.pages_contents = [pg.create_html(ui.tabname) for pg in ui.stored_extra_pages]
  File "C:\Code\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 518, in create_html
    self.items = {x["name"]: x for x in items_list}
  File "C:\Code\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 518, in <dictcomp>
    self.items = {x["name"]: x for x in items_list}
  File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\Lora\ui_extra_networks_lora.py", line 82, in list_items
    item = self.create_item(name, index)
  File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\Lora\ui_extra_networks_lora.py", line 69, in create_item
    elif shared.sd_model.is_sdxl and sd_version != network.SdVersion.SDXL:
AttributeError: 'NoneType' object has no attribute 'is_sdxl'
Calculating sha256 for C:\Code\stable-diffusion-webui-forge\models\Stable-diffusion\RevRPG.safetensors: 0f584388d8681397851ae63d68afd692a49f381bca28fae9d6eb27b37e8ae37a
Loading weights [0f584388d8] from C:\Code\stable-diffusion-webui-forge\models\Stable-diffusion\RevRPG.safetensors
model_type EPS
UNet ADM Dimension 0
Using pytorch attention in VAE
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
Using pytorch attention in VAE
extra {'cond_stage_model.clip_l.text_projection', 'cond_stage_model.clip_l.logit_scale'}
left over keys: dict_keys(['model_ema.decay', 'model_ema.num_updates'])
loaded straight to GPU
To load target model BaseModel
Begin to load 1 model
Moving model(s) has taken 0.03 seconds
To load target model SD1ClipModel
Begin to load 1 model
Moving model(s) has taken 0.25 seconds
Model loaded in 26.5s (unload existing model: 0.3s, calculate hash: 22.5s, load weights from disk: 0.2s, forge load real models: 2.9s, load VAE: 0.3s, calculate empty prompt: 0.3s).
2024-05-05 08:34:43,689 - ControlNet - INFO - Preview Resolution = 720
Downloading: "https://huggingface.co/lllyasviel/ControlNet/resolve/main/annotator/ckpts/dpt_hybrid-midas-501f0c75.pt" to C:\Code\stable-diffusion-webui-forge\models\ControlNetPreprocessor\midas\dpt_hybrid-midas-501f0c75.pt

100%|███████████████████████████████████████████████████████████████████████████████| 470M/470M [00:16<00:00, 29.9MB/s]
Traceback (most recent call last):
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\routes.py", line 488, in run_predict
    output = await app.get_blocks().process_api(
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1431, in process_api
    result = await self.call_function(
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1103, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\to_thread.py", line 33, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 877, in run_sync_in_worker_thread
    return await future
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 807, in run
    result = context.run(func, *args)
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\utils.py", line 707, in wrapper
    response = f(*args, **kwargs)
  File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\lib_controlnet\controlnet_ui\controlnet_ui_group.py", line 847, in run_annotator
    result = preprocessor(
  File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\scripts\legacy_preprocessors.py", line 103, in __call__
    result, is_image = self.call_function(img=input_image, res=resolution, thr_a=slider_1, thr_b=slider_2, **kwargs)
  File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\legacy_preprocessors\preprocessor.py", line 218, in midas
    result, _ = model_midas(img, a)
  File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\annotator\midas\__init__.py", line 31, in apply_midas
    depth = model(image_depth)[0]
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 1518, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 1527, in _call_impl
    return forward_call(*args, **kwargs)
  File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\annotator\midas\api.py", line 179, in forward
    prediction = self.model(x)
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 1518, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 1527, in _call_impl
    return forward_call(*args, **kwargs)
  File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\annotator\midas\midas\dpt_depth.py", line 108, in forward
    return super().forward(x).squeeze(dim=1)
  File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\annotator\midas\midas\dpt_depth.py", line 71, in forward
    layer_1, layer_2, layer_3, layer_4 = forward_vit(self.pretrained, x)
  File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\annotator\midas\midas\vit.py", line 59, in forward_vit
    glob = pretrained.model.forward_flex(x)
  File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\annotator\midas\midas\vit.py", line 127, in forward_flex
    x = self.patch_embed.backbone(x)
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 1518, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 1527, in _call_impl
    return forward_call(*args, **kwargs)
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\timm\models\resnetv2.py", line 475, in forward
    x = self.forward_features(x)
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\timm\models\resnetv2.py", line 463, in forward_features
    x = self.stem(x)
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 1518, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 1527, in _call_impl
    return forward_call(*args, **kwargs)
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\container.py", line 215, in forward
    input = module(input)
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 1518, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 1527, in _call_impl
    return forward_call(*args, **kwargs)
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\timm\layers\pool2d_same.py", line 52, in forward
    x = pad_same(x, self.kernel_size, self.stride, value=-float('inf'))
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\timm\layers\padding.py", line 55, in pad_same
    x = F.pad(x, (pad_w // 2, pad_w - pad_w // 2, pad_h // 2, pad_h - pad_h // 2), value=value)
torch.cuda.OutOfMemoryError: Allocation on device 0 would exceed allowed memory. (out of memory)
Currently allocated     : 9.23 GiB
Requested               : 36.19 MiB
Device limit            : 10.00 GiB
Free (according to CUDA): 0 bytes
PyTorch limit (set by user-supplied memory fraction)
                        : 17179869184.00 GiB
Loading weights [fd9cdc26c3] from C:\Code\stable-diffusion-webui-forge\models\Stable-diffusion\dynavisionXLAllInOneStylized_release0557Bakedvae.safetensors
2024-05-05 08:35:37,969 - ControlNet - INFO - Preview Resolution = 720
Automatic Memory Management: 11 Modules in 1.32 seconds.
Traceback (most recent call last):
  File "C:\Code\stable-diffusion-webui-forge\modules_forge\main_thread.py", line 37, in loop
    task.work()
  File "C:\Code\stable-diffusion-webui-forge\modules_forge\main_thread.py", line 26, in work
    self.result = self.func(*self.args, **self.kwargs)
  File "C:\Code\stable-diffusion-webui-forge\modules\sd_models.py", line 628, in reload_model_weights
    return load_model(info)
  File "C:\Code\stable-diffusion-webui-forge\modules\sd_models.py", line 585, in load_model
    sd_model = forge_loader.load_model_for_a1111(timer=timer, checkpoint_info=checkpoint_info, state_dict=state_dict)
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
    return func(*args, **kwargs)
  File "C:\Code\stable-diffusion-webui-forge\modules_forge\forge_loader.py", line 154, in load_model_for_a1111
    forge_objects = load_checkpoint_guess_config(
  File "C:\Code\stable-diffusion-webui-forge\modules_forge\forge_loader.py", line 104, in load_checkpoint_guess_config
    model = model_config.get_model(sd, "model.diffusion_model.", device=inital_load_device)
  File "C:\Code\stable-diffusion-webui-forge\ldm_patched\modules\supported_models.py", line 176, in get_model
    out = model_base.SDXL(self, model_type=self.model_type(state_dict, prefix), device=device)
  File "C:\Code\stable-diffusion-webui-forge\ldm_patched\modules\model_base.py", line 299, in __init__
    super().__init__(model_config, model_type, device=device)
  File "C:\Code\stable-diffusion-webui-forge\ldm_patched\modules\model_base.py", line 56, in __init__
    self.diffusion_model = UNetModel(**unet_config, device=device, operations=operations)
  File "C:\Code\stable-diffusion-webui-forge\ldm_patched\ldm\modules\diffusionmodules\openaimodel.py", line 754, in __init__
    get_resblock(
  File "C:\Code\stable-diffusion-webui-forge\ldm_patched\ldm\modules\diffusionmodules\openaimodel.py", line 613, in get_resblock
    return ResBlock(
  File "C:\Code\stable-diffusion-webui-forge\ldm_patched\ldm\modules\diffusionmodules\openaimodel.py", line 224, in __init__
    operations.conv_nd(dims, self.out_channels, self.out_channels, kernel_size, padding=padding, dtype=dtype, device=device)
  File "C:\Code\stable-diffusion-webui-forge\ldm_patched\modules\ops.py", line 168, in conv_nd
    return s.Conv2d(*args, **kwargs)
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\conv.py", line 447, in __init__
    super().__init__(
  File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\conv.py", line 134, in __init__
    self.weight = Parameter(torch.empty(
torch.cuda.OutOfMemoryError: Allocation on device 0 would exceed allowed memory. (out of memory)
Currently allocated     : 9.26 GiB
Requested               : 28.12 MiB
Device limit            : 10.00 GiB
Free (according to CUDA): 0 bytes
PyTorch limit (set by user-supplied memory fraction)
                        : 17179869184.00 GiB
Allocation on device 0 would exceed allowed memory. (out of memory)
Currently allocated     : 9.26 GiB
Requested               : 28.12 MiB
Device limit            : 10.00 GiB
Free (according to CUDA): 0 bytes
PyTorch limit (set by user-supplied memory fraction)
                        : 17179869184.00 GiB

@lipeng1109

By the way,how do i use normal sd-webui-controlnet rather than sd_forge_controlnet? The webui always force uncheck sd-webui-controlnet

You don't. It's not built for SF, since SF has CN built into it and it also appears to be split up based on the CN function, such as Inpainting, regular ControlNet, etc.

If you want to use regular ControlNet, go to regular SD (Auto1111). You might as well try to run Photoshop in Linux or a PS4 game in your XBox.

I've seen extensions such as Deforum version for both SF and A1111 work in Forge, but that's not a built in repo from the same dev like this. If you weren't aware, ControlNet, for Stable Forge and FoOocus were all developed by the same devs.