AUTOMATIC1111 / stable-diffusion-webui

Stable Diffusion web UI
GNU Affero General Public License v3.0
143.35k stars 27k forks source link

[Bug]: after update hires. fix extremely slow #13897

Open vincentblokker opened 1 year ago

vincentblokker commented 1 year ago

Is there an existing issue for this?

What happened?

After a few days of not using my PC, I opened Automatic1111 after an update(version: v1.6.0-298-g5e80d9ee) and started generating images. I loaded my latest prompt and pressed run, it took 11 min to generate. Normally 30sec till 1 min. So I did it again after a reboot of my PC. Same, so I disabled hires. fix and within 15 sec I had an image. So I selected to most simple upscaler "Latent" which was somewhat faster... 8min to generate. So I started mixing with the Sampling method... same issue. So something has changed after the update.

Steps to reproduce the problem

  1. Start SD
  2. Automatic pull to update to latest version
  3. Launching Web UI with arguments: --xformers --no-half-vae
  4. Open Chrome
  5. Reload lastest prompt
  6. Hit generate.

Settings

System

What should have happened?

Generating images normally takes 30sec to 1 min.

Sysinfo

{ "Platform": "Windows-10-10.0.22621-SP0", "Python": "3.10.9", "Version": "v1.6.0-298-g5e80d9ee", "Commit": "5e80d9ee99c5899e5e2b130408ffb65a0585a62a", "Script path": "D:\StableDiffusion\-stable-diffusion-webui", "Data path": "D:\StableDiffusion\-stable-diffusion-webui", "Extensions dir": "D:\StableDiffusion\-stable-diffusion-webui\extensions", "Checksum": "8dee47442d6f822eae8506ba4017ef862755c831c5a8b2a830bce4f8d5a0838c", "Commandline": [ "launch.py", "--xformers", "--no-half-vae" ], "Torch env info": { "torch_version": "2.0.1+cu118", "is_debug_build": "False", "cuda_compiled_version": "11.8", "gcc_version": null, "clang_version": null, "cmake_version": null, "os": "Microsoft Windows 11 Pro", "libc_version": "N/A", "python_version": "3.10.9 (tags/v3.10.9:1dd9be6, Dec 6 2022, 20:01:21) [MSC v.1934 64 bit (AMD64)] (64-bit runtime)", "python_platform": "Windows-10-10.0.22621-SP0", "is_cuda_available": "True", "cuda_runtime_version": "11.7.64\r", "cuda_module_loading": "LAZY", "nvidia_driver_version": "546.01", "nvidia_gpu_models": "GPU 0: NVIDIA GeForce RTX 4070", "cudnn_version": null, "pip_version": "pip3", "pip_packages": [ "lion-pytorch==0.1.2", "numpy==1.23.5", "open-clip-torch==2.20.0", "pytorch-lightning==1.9.4", "torch==2.0.1+cu118", "torchdiffeq==0.2.3", "torchmetrics==0.11.4", "torchsde==0.2.6", "torchvision==0.15.2+cu118" ], "conda_packages": null, "hip_compiled_version": "N/A", "hip_runtime_version": "N/A", "miopen_runtime_version": "N/A", "caching_allocator_config": "", "is_xnnpack_available": "True", "cpu_info": [ "Architecture=9", "CurrentClockSpeed=3600", "DeviceID=CPU0", "Family=207", "L2CacheSize=2048", "L2CacheSpeed=", "Manufacturer=GenuineIntel", "MaxClockSpeed=3600", "Name=Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz", "ProcessorType=3", "Revision=" ] }, "Exceptions": [], "CPU": { "model": "Intel64 Family 6 Model 158 Stepping 12, GenuineIntel", "count logical": 16, "count physical": 8 }, "RAM": { "total": "32GB", "used": "28GB", "free": "4GB" }, "Extensions": [ { "name": "Stable-Diffusion-Webui-Civitai-Helper", "path": "D:\StableDiffusion\-stable-diffusion-webui\extensions\Stable-Diffusion-Webui-Civitai-Helper", "version": "ab8cac22", "branch": "main", "remote": "https://github.com/butaixianran/Stable-Diffusion-Webui-Civitai-Helper.git" }, { "name": "sd-dynamic-prompts", "path": "D:\StableDiffusion\-stable-diffusion-webui\extensions\sd-dynamic-prompts", "version": "e07ff1d7", "branch": "main", "remote": "https://github.com/adieyal/sd-dynamic-prompts.git" }, { "name": "sd-webui-aspect-ratio-helper", "path": "D:\StableDiffusion\-stable-diffusion-webui\extensions\sd-webui-aspect-ratio-helper", "version": "99fcf9b0", "branch": "main", "remote": "https://github.com/thomasasfk/sd-webui-aspect-ratio-helper.git" }, { "name": "sd-webui-infinite-image-browsing", "path": "D:\StableDiffusion\-stable-diffusion-webui\extensions\sd-webui-infinite-image-browsing", "version": "baab20bc", "branch": "main", "remote": "https://github.com/zanllp/sd-webui-infinite-image-browsing.git" }, { "name": "sdwebui-close-confirmation-dialogue", "path": "D:\StableDiffusion\-stable-diffusion-webui\extensions\sdwebui-close-confirmation-dialogue", "version": "f7cfa87d", "branch": "main", "remote": "https://github.com/w-e-w/sdwebui-close-confirmation-dialogue.git" }, { "name": "stable-diffusion-webui", "path": "D:\StableDiffusion\-stable-diffusion-webui\extensions\stable-diffusion-webui", "version": "6f1eebbe", "branch": "main", "remote": "https://github.com/catppuccin/stable-diffusion-webui.git" }, { "name": "stable-diffusion-webui-images-browser", "path": "D:\StableDiffusion\-stable-diffusion-webui\extensions\stable-diffusion-webui-images-browser", "version": "08fc2647", "branch": "main", "remote": "https://github.com/AlUlkesh/stable-diffusion-webui-images-browser.git" }, { "name": "stable-diffusion-webui-wildcards", "path": "D:\StableDiffusion\-stable-diffusion-webui\extensions\stable-diffusion-webui-wildcards", "version": "c7d49e18", "branch": "master", "remote": "https://github.com/AUTOMATIC1111/stable-diffusion-webui-wildcards.git" } ], "Inactive extensions": [ { "name": "CloneCleaner", "path": "D:\StableDiffusion\-stable-diffusion-webui\extensions\CloneCleaner", "version": "76348e1a", "branch": "main", "remote": "https://github.com/artyfacialintelagent/CloneCleaner.git" }, { "name": "adetailer", "path": "D:\StableDiffusion\-stable-diffusion-webui\extensions\adetailer", "version": "887155c8", "branch": "main", "remote": "https://github.com/Bing-su/adetailer.git" }, { "name": "sd-webui-controlnet", "path": "D:\StableDiffusion\-stable-diffusion-webui\extensions\sd-webui-controlnet", "version": "a43e5742", "branch": "main", "remote": "https://github.com/Mikubill/sd-webui-controlnet.git" } ], "Environment": { "COMMANDLINE_ARGS": "--xformers --no-half-vae", "GRADIO_ANALYTICS_ENABLED": "False" }, "Config": { "samples_save": true, "samples_format": "jpg", "samples_filename_pattern": "", "save_images_add_number": true, "grid_save": true, "grid_format": "jpg", "grid_extended_filename": false, "grid_only_if_multiple": true, "grid_prevent_empty_spots": true, "n_rows": -1, "enable_pnginfo": true, "save_txt": true, "save_images_before_face_restoration": false, "save_images_before_highres_fix": false, "save_images_before_color_correction": false, "save_mask": false, "save_mask_composite": false, "jpeg_quality": 80, "webp_lossless": false, "export_for_4chan": true, "img_downscale_threshold": 4.0, "target_side_length": 4000, "img_max_size_mp": 200, "use_original_name_batch": true, "use_upscaler_name_as_suffix": false, "save_selected_only": true, "save_init_img": false, "temp_dir": "", "clean_temp_dir_at_start": false, "outdir_samples": "", "outdir_txt2img_samples": "outputs/txt2img-images", "outdir_img2img_samples": "outputs/img2img-images", "outdir_extras_samples": "outputs/extras-images", "outdir_grids": "", "outdir_txt2img_grids": "outputs/txt2img-grids", "outdir_img2img_grids": "outputs/img2img-grids", "outdir_save": "log/images", "outdir_init_images": "outputs/init-images", "save_to_dirs": true, "grid_save_to_dirs": true, "use_save_to_dirs_for_ui": false, "directories_filename_pattern": "[date]", "directories_max_prompt_words": 8, "ESRGAN_tile": 192, "ESRGAN_tile_overlap": 8, "realesrgan_enabled_models": [], "upscaler_for_img2img": "None", "SCUNET_tile": 256, "SCUNET_tile_overlap": 8, "face_restoration_model": "GFPGAN", "code_former_weight": 0.5, "face_restoration_unload": true, "show_warnings": false, "memmon_poll_rate": 8, "samples_log_stdout": false, "multiple_tqdm": true, "print_hypernet_extra": false, "unload_models_when_training": false, "pin_memory": false, "save_optimizer_state": false, "save_training_settings_to_txt": true, "dataset_filename_word_regex": "", "dataset_filename_join_string": " ", "training_image_repeats_per_epoch": 1, "training_write_csv_every": 500, "training_xattention_optimizations": false, "training_enable_tensorboard": false, "training_tensorboard_save_images": false, "training_tensorboard_flush_every": 120, "sd_model_checkpoint": "SDXL\bluePencilXL_v100.safetensors [c4d7e01814]", "sd_checkpoint_cache": 1, "sd_vae_checkpoint_cache": 0, "sd_vae": "Automatic", "sd_vae_as_default": true, "inpainting_mask_weight": 1.0, "initial_noise_multiplier": 1.0, "img2img_color_correction": false, "img2img_fix_steps": false, "img2img_background_color": "#ffffff", "enable_quantization": false, "enable_emphasis": true, "enable_batch_seeds": true, "comma_padding_backtrack": 20, "CLIP_stop_at_last_layers": 1, "upcast_attn": false, "randn_source": "GPU", "use_old_emphasis_implementation": false, "use_old_karras_scheduler_sigmas": false, "no_dpmpp_sde_batch_determinism": true, "use_old_hires_fix_width_height": false, "dont_fix_second_order_samplers_schedule": false, "interrogate_keep_models_in_memory": false, "interrogate_return_ranks": false, "interrogate_clip_num_beams": 1, "interrogate_clip_min_length": 24, "interrogate_clip_max_length": 48, "interrogate_clip_dict_limit": 1500, "interrogate_clip_skip_categories": [], "interrogate_deepbooru_score_threshold": 0.5, "deepbooru_sort_alpha": true, "deepbooru_use_spaces": false, "deepbooru_escape": true, "deepbooru_filter_tags": "", "extra_networks_default_view": "cards", "extra_networks_default_multiplier": 1.0, "extra_networks_card_width": 0, "extra_networks_card_height": 0, "extra_networks_add_text_separator": " ", "sd_hypernetwork": "None", "return_grid": true, "return_mask": false, "return_mask_composite": false, "do_not_show_images": false, "send_seed": true, "send_size": true, "font": "", "js_modal_lightbox": true, "js_modal_lightbox_initially_zoomed": true, "js_modal_lightbox_gamepad": true, "js_modal_lightbox_gamepad_repeat": 250, "show_progress_in_title": true, "samplers_in_dropdown": true, "dimensions_and_batch_together": true, "keyedit_precision_attention": 0.1, "keyedit_precision_extra": 0.05, "keyedit_delimiters": ".,\/!?%^*;:{}=`~()", "quicksettings_list": [ "sd_model_checkpoint", "CLIP_stop_at_last_layers", "sd_vae", "initial_noise_multiplier" ], "hidden_tabs": [ "Train", "PNG Info" ], "ui_reorder": "inpaint, sampler, checkboxes, hires_fix, dimensions, cfg, seed, batch, override_settings, scripts", "ui_extra_networks_tab_reorder": "", "localization": "None", "gradio_theme": "Default", "add_model_hash_to_info": true, "add_model_name_to_info": true, "add_version_to_infotext": true, "disable_weights_auto_swap": true, "show_progressbar": true, "live_previews_enable": true, "show_progress_grid": true, "show_progress_every_n_steps": 10, "show_progress_type": "Approx NN", "live_preview_content": "Prompt", "live_preview_refresh_period": 1000, "hide_samplers": [ "LMS", "Euler", "DPM2", "DPM++ 2S a", "DPM fast", "DPM adaptive", "LMS Karras", "DPM2 Karras", "DPM2 a Karras", "DDIM", "PLMS", "UniPC", "DPM2 a", "Restart", "DPM++ 2S a Karras", "DPM++ SDE Karras", "DPM++ 2M SDE Heun", "DPM++ 2M SDE Heun Karras", "DPM++ 2M SDE Heun Exponential" ], "eta_ddim": 0.0, "eta_ancestral": 1.0, "ddim_discretize": "uniform", "s_churn": 0.0, "s_min_uncond": 0, "s_tmin": 0.0, "s_noise": 1.0, "eta_noise_seed_delta": 0, "always_discard_next_to_last_sigma": false, "uni_pc_variant": "bh1", "uni_pc_skip_type": "time_uniform", "uni_pc_order": 3, "uni_pc_lower_order_final": true, "postprocessing_enable_in_main_ui": [], "postprocessing_operation_order": [], "upscaling_max_images_in_cache": 5, "disabled_extensions": [ "CloneCleaner", "adetailer", "sd-webui-controlnet" ], "disable_all_extensions": "none", "restore_config_state_file": "", "sd_checkpoint_hash": "c4d7e01814f0eed57a7120629d3017ac018ad7cdecb48f7fbe6b12f9c9c4d6b9", "ldsr_steps": 100, "ldsr_cached": true, "SWIN_tile": 192, "SWIN_tile_overlap": 8, "lora_functional": false, "sd_lora": "None", "lora_preferred_name": "Alias from file", "image_browser_active_tabs": "txt2img, img2img, txt2img-grids, img2img-grids, Extras, Favorites, Others, All, Maintenance", "sd_lyco": "None", "ad_max_models": 2, "ad_save_previews": false, "ad_save_images_before": false, "ad_only_seleted_scripts": true, "ad_script_names": "dynamic_prompting,dynamic_thresholding,wildcards,wildcard_recursive", "ad_bbox_sortby": "None", "infzoom_outpath": "outputs", "infzoom_outSUBpath": "infinite-zooms", "infzoom_outsizeW": 512, "infzoom_outsizeH": 512, "infzoom_ffprobepath": "", "infzoom_defPrompt": "{\n\t\"prePrompt\": \"Huge spectacular Waterfall in \",\n\t\"prompts\": {\n\t\t\"data\": [\n\t\t\t[0, \"a dense tropical forest\"],\n\t\t\t[2, \"a Lush jungle\"],\n\t\t\t[3, \"a Thick rainforest\"],\n\t\t\t[5, \"a Verdant canopy\"]\n\t\t]\n\t},\n\t\"postPrompt\": \"epic perspective,(vegetation overgrowth:1.3)(intricate, ornamentation:1.1),(baroque:1.1), fantasy, (realistic:1) digital painting , (magical,mystical:1.2) , (wide angle shot:1.4), (landscape composed:1.2)(medieval:1.1),(tropical forest:1.4),(river:1.3) volumetric lighting ,epic, style by Alex Horley Wenjun Lin greg rutkowski Ruan Jia (Wayne Barlowe:1.2)\",\n\t\"negPrompt\": \"frames, border, edges, borderline, text, character, duplicate, error, out of frame, watermark, low quality, ugly, deformed, blur, bad-artist\"\n}", "infzoom_collectAllResources": false, "control_net_model_config": "models\cldm_v15.yaml", "control_net_model_adapter_config": "models\t2iadapter_sketch_sd14v1.yaml", "control_net_detectedmap_dir": "detected_maps", "control_net_models_path": "", "control_net_modules_path": "", "control_net_max_models_num": 1, "control_net_model_cache_size": 1, "control_net_no_detectmap": false, "control_net_detectmap_autosaving": false, "control_net_allow_script_control": false, "control_net_sync_field_args": false, "controlnet_show_batch_images_in_ui": false, "controlnet_increment_seed_during_batch": false, "modelscope_deforum_keep_model_in_vram": "None", "modelscope_deforum_vae_settings": "GPU (half precision)", "modelscope_deforum_show_n_videos": -1.0, "image_browser_hidden_components": [], "image_browser_with_subdirs": true, "image_browser_preload": false, "image_browser_copy_image": false, "image_browser_delete_message": true, "image_browser_txt_files": true, "image_browser_debug_level": "0 - none", "image_browser_delete_recycle": true, "image_browser_scan_exif": true, "image_browser_mod_shift": false, "image_browser_mod_ctrl_shift": false, "image_browser_enable_maint": true, "image_browser_ranking_pnginfo": false, "image_browser_page_columns": 6.0, "image_browser_page_rows": 6.0, "image_browser_pages_perload": 20.0, "image_browser_use_thumbnail": false, "image_browser_thumbnail_size": 200.0, "image_browser_swipe": false, "image_browser_img_tooltips": true, "image_browser_scoring_type": "aesthetic_score", "image_browser_show_progress": true, "dp_ignore_whitespace": false, "dp_write_raw_template": false, "dp_write_prompts_to_file": false, "dp_parser_variant_start": "{", "dp_parser_variant_end": "}", "dp_parser_wildcard_wrap": "__", "dp_limit_jinja_prompts": false, "dp_auto_purge_cache": false, "dp_magicprompt_default_model": "Gustavosta/MagicPrompt-Stable-Diffusion", "dp_magicprompt_batch_size": 1, "ctp_flavor": "latte", "accent_color": "blue", "arh_javascript_aspect_ratio_show": true, "arh_javascript_aspect_ratio": "1:1, 3:2, 4:3, 5:4, 16:9", "arh_ui_javascript_selection_method": "Aspect Ratios Dropdown", "arh_hide_accordion_by_default": true, "arh_expand_by_default": false, "arh_ui_component_order_key": "MaxDimensionScaler, PredefinedAspectRatioButtons, PredefinedPercentageButtons", "arh_show_max_width_or_height": false, "arh_max_width_or_height": 1024, "arh_show_predefined_aspect_ratios": false, "arh_predefined_aspect_ratio_use_max_dim": false, "arh_predefined_aspect_ratios": "1:1, 4:3, 16:9, 9:16, 21:9", "arh_show_predefined_percentages": false, "arh_predefined_percentages": "25, 50, 75, 125, 150, 175, 200", "arh_predefined_percentages_display_key": "Incremental/decremental percentage (-50%, +50%)", "ui_reorder_list": [ "inpaint", "sampler", "checkboxes", "hires_fix", "dimensions", "cfg", "seed", "batch", "override_settings", "scripts" ], "grid_zip_filename_pattern": "", "list_hidden_files": true, "sd_unet": "None", "cross_attention_optimization": "Automatic", "token_merging_ratio": 0, "token_merging_ratio_img2img": 0, "token_merging_ratio_hr": 0, "pad_cond_uncond": false, "extra_networks_show_hidden_directories": true, "extra_networks_hidden_models": "When searched", "lora_add_hashes_to_infotext": true, "img2img_editor_height": 720, "ui_tab_order": [], "hires_fix_show_sampler": true, "hires_fix_show_prompts": true, "disable_token_counters": false, "extra_options": [], "extra_options_accordion": false, "infotext_styles": "Apply if any", "live_previews_image_format": "jpeg", "k_sched_type": "Automatic", "sigma_min": 0.0, "sigma_max": 0.0, "rho": 0.0, "canvas_hotkey_move": "F", "canvas_hotkey_fullscreen": "S", "canvas_hotkey_reset": "R", "canvas_hotkey_overlap": "O", "canvas_show_tooltip": true, "canvas_swap_controls": false, "arh_show_min_width_or_height": false, "arh_min_width_or_height": 1024, "controlnet_disable_control_type": false, "inpaint_anything_save_folder": "inpaint-anything", "inpaint_anything_offline_inpainting": false, "hires_fix_use_firstpass_conds": false, "tac_tagFile": "danbooru.csv", "tac_active": true, "tac_activeIn.txt2img": true, "tac_activeIn.img2img": true, "tac_activeIn.negativePrompts": true, "tac_activeIn.thirdParty": true, "tac_activeIn.modelList": "", "tac_activeIn.modelListMode": "Blacklist", "tac_slidingPopup": true, "tac_maxResults": 5.0, "tac_showAllResults": false, "tac_resultStepLength": 100.0, "tac_delayTime": 100.0, "tac_useWildcards": true, "tac_useEmbeddings": true, "tac_useHypernetworks": true, "tac_useLoras": true, "tac_useLycos": true, "tac_showWikiLinks": false, "tac_replaceUnderscores": true, "tac_escapeParentheses": true, "tac_appendComma": true, "tac_alias.searchByAlias": true, "tac_alias.onlyShowAlias": false, "tac_translation.translationFile": "None", "tac_translation.oldFormat": false, "tac_translation.searchByTranslation": true, "tac_translation.liveTranslation": false, "tac_extra.extraFile": "extra-quality-tags.csv", "tac_extra.addMode": "Insert before", "tac_chantFile": "demo-chants.json", "tac_keymap": "{\n \"MoveUp\": \"ArrowUp\",\n \"MoveDown\": \"ArrowDown\",\n \"JumpUp\": \"PageUp\",\n \"JumpDown\": \"PageDown\",\n \"JumpToStart\": \"Home\",\n \"JumpToEnd\": \"End\",\n \"ChooseSelected\": \"Enter\",\n \"ChooseFirstOrSelected\": \"Tab\",\n \"Close\": \"Escape\"\n}", "tac_colormap": "{\n \"danbooru\": {\n \"-1\": [\"red\", \"maroon\"],\n \"0\": [\"lightblue\", \"dodgerblue\"],\n \"1\": [\"indianred\", \"firebrick\"],\n \"3\": [\"violet\", \"darkorchid\"],\n \"4\": [\"lightgreen\", \"darkgreen\"],\n \"5\": [\"orange\", \"darkorange\"]\n },\n \"e621\": {\n \"-1\": [\"red\", \"maroon\"],\n \"0\": [\"lightblue\", \"dodgerblue\"],\n \"1\": [\"gold\", \"goldenrod\"],\n \"3\": [\"violet\", \"darkorchid\"],\n \"4\": [\"lightgreen\", \"darkgreen\"],\n \"5\": [\"tomato\", \"darksalmon\"],\n \"6\": [\"red\", \"maroon\"],\n \"7\": [\"whitesmoke\", \"black\"],\n \"8\": [\"seagreen\", \"darkseagreen\"]\n }\n}", "tac_refreshTempFiles": "Refresh TAC temp files", "controlnet_disable_openpose_edit": false, "image_browser_info_add": false, "experimental_persistent_cond_cache": false, "disable_mmap_load_safetensors": false, "add_user_name_to_info": false, "canvas_hotkey_zoom": "Alt", "canvas_hotkey_adjust": "Ctrl", "canvas_disabled_functions": [ "Overlap" ], "sd_vae_overrides_per_model_preferences": false, "grid_text_active_color": "#000000", "grid_text_inactive_color": "#999999", "grid_background_color": "#ffffff", "save_incomplete_images": false, "face_restoration": false, "auto_launch_browser": "Local", "show_gradio_deprecation_warnings": true, "hide_ldm_prints": true, "api_enable_requests": true, "api_forbid_local_requests": true, "api_useragent": "", "sd_checkpoints_limit": 1, "sd_checkpoints_keep_in_cpu": true, "tiling": false, "sdxl_crop_top": 0.0, "sdxl_crop_left": 0.0, "sdxl_refiner_low_aesthetic_score": 2.5, "sdxl_refiner_high_aesthetic_score": 6.0, "auto_vae_precision": true, "sd_vae_encode_method": "Full", "sd_vae_decode_method": "Full", "img2img_extra_noise": 0, "img2img_sketch_default_brush_color": "#ffffff", "img2img_inpaint_mask_brush_color": "#ffffff", "img2img_inpaint_sketch_default_brush_color": "#ffffff", "persistent_cond_cache": true, "batch_cond_uncond": true, "use_old_scheduling": false, "extra_networks_card_text_scale": 1, "extra_networks_card_show_desc": true, "textual_inversion_print_at_load": false, "textual_inversion_add_hashes_to_infotext": true, "lora_show_all": false, "lora_hide_unknown_for_versions": [], "lora_in_memory_limit": 0, "gradio_themes_cache": true, "gallery_height": "", "keyedit_move": true, "extra_options_txt2img": [], "extra_options_img2img": [], "extra_options_cols": 1, "live_preview_allow_lowvram_full": false, "live_preview_fast_interrupt": false, "s_tmax": 0, "canvas_auto_expand": true, "canvas_blur_prompt": false, "control_net_inpaint_blur_sigma": 7, "control_net_no_high_res_fix": false, "controlnet_ignore_noninpaint_mask": false, "image_browser_height_auto": false, "hires_fix_refiner_pass": "second pass", "sgm_noise_multiplier": false, "control_net_unit_count": 3, "use_aria2": true, "disable_dns": false, "show_log": false, "split_aria2": 64, "insert_sub": true, "use_LORA": false, "save_images_replace_action": "Replace", "enable_console_prompts": false, "animatediff_model_path": "D:\StableDiffusion\-stable-diffusion-webui\extensions\sd-webui-animatediff\model", "animatediff_optimize_gif_palette": false, "animatediff_optimize_gif_gifsicle": false, "animatediff_xformers": "Optimize attention layers with xformers", "ch_max_size_preview": true, "ch_skip_nsfw_preview": false, "ch_open_url_with_js": true, "ch_proxy": "", "keyedit_delimiters_whitespace": [ "Tab", "Carriage Return", "Line Feed" ], "sd_checkpoint_dropdown_use_short": false, "faceswaplab_model": "D:\StableDiffusion\-stable-diffusion-webui\models\faceswaplab\inswapper_128.onnx", "faceswaplab_use_gpu": true, "faceswaplab_keep_original": false, "faceswaplab_units_count": 3, "faceswaplab_nsfw_threshold": 1, "faceswaplab_det_size": 640, "faceswaplab_auto_det_size": true, "faceswaplab_detection_threshold": 0.5, "faceswaplab_pp_default_face_restorer": null, "faceswaplab_pp_default_face_restorer_visibility": 1, "faceswaplab_pp_default_face_restorer_weight": 1, "faceswaplab_pp_default_upscaler": null, "faceswaplab_pp_default_upscaler_visibility": 1, "faceswaplab_pp_default_inpainting_prompt": "Portrait of a [gender]", "faceswaplab_pp_default_inpainting_negative_prompt": "blurry", "faceswaplab_default_upscaled_swapper_upscaler": null, "faceswaplab_default_upscaled_swapper_sharpen": false, "faceswaplab_default_upscaled_swapper_fixcolor": false, "faceswaplab_default_upscaled_swapper_improved_mask": false, "faceswaplab_default_upscaled_swapper_face_restorer": null, "faceswaplab_default_upscaled_swapper_face_restorer_visibility": 1, "faceswaplab_default_upscaled_swapper_face_restorer_weight": 1, "faceswaplab_default_upscaled_swapper_erosion": 1, "mov2mov_outpath_samples": "outputs/mov2mov-images", "mov2mov_output_dir": "outputs/mov2mov-videos", "animatediff_save_to_custom": false, "deforum_keep_3d_models_in_vram": false, "deforum_enable_persistent_settings": false, "deforum_persistent_settings_path": "models/Deforum/deforum_persistent_settings.txt", "deforum_ffmpeg_location": "D:\StableDiffusion\-stable-diffusion-webui\venv\lib\site-packages\imageio_ffmpeg\binaries\ffmpeg-win64-v4.2.2.exe", "deforum_ffmpeg_crf": 17, "deforum_ffmpeg_preset": "slow", "deforum_debug_mode_enabled": false, "deforum_save_gen_info_as_srt": false, "deforum_embed_srt": false, "deforum_save_gen_info_as_srt_params": [ "Noise Schedule" ], "deforum_preview": "Off", "deforum_preview_interval_frames": 100, "prompt_database_path": "prompt_tree.yml", "wildcards_same_seed": false, "dp_wildcard_manager_no_dedupe": false, "dp_wildcard_manager_no_sort": false, "dp_wildcard_manager_shuffle": false }, "Startup": { "total": 102.11117267608643, "records": { "initial startup": 0.0045049190521240234, "prepare environment/checks": 0.0266420841217041, "prepare environment/git version info": 0.2814021110534668, "prepare environment/torch GPU test": 50.64034056663513, "prepare environment/clone repositores": 0.344057559967041, "prepare environment/run extensions installers/sd-dynamic-prompts": 0.3126184940338135, "prepare environment/run extensions installers/sd-webui-aspect-ratio-helper": 0.0, "prepare environment/run extensions installers/sd-webui-infinite-image-browsing": 0.8166694641113281, "prepare environment/run extensions installers/sdwebui-close-confirmation-dialogue": 0.0, "prepare environment/run extensions installers/stable-diffusion-webui": 0.0, "prepare environment/run extensions installers/Stable-Diffusion-Webui-Civitai-Helper": 0.0, "prepare environment/run extensions installers/stable-diffusion-webui-images-browser": 0.17627573013305664, "prepare environment/run extensions installers/stable-diffusion-webui-wildcards": 0.0009980201721191406, "prepare environment/run extensions installers": 1.3065617084503174, "prepare environment": 52.78680968284607, "launcher": 0.009006261825561523, "import torch": 30.78106451034546, "import gradio": 3.091749668121338, "setup paths": 5.1705029010772705, "import ldm": 0.03113269805908203, "import sgm": 0.0, "initialize shared": 0.506026029586792, "other imports": 3.1236953735351562, "opts onchange": 0.0, "setup SD model": 0.015623092651367188, "setup codeformer": 0.49994802474975586, "setup gfpgan": 0.09498953819274902, "set samplers": 0.0, "list extensions": 0.015619516372680664, "restore config state file": 0.0, "list SD models": 0.12497210502624512, "list localizations": 0.0, "load scripts/custom_code.py": 0.015620708465576172, "load scripts/img2imgalt.py": 0.011243820190429688, "load scripts/loopback.py": 0.001996278762817383, "load scripts/outpainting_mk_2.py": 0.0029916763305664062, "load scripts/poor_mans_outpainting.py": 0.0019948482513427734, "load scripts/postprocessing_codeformer.py": 0.0019948482513427734, "load scripts/postprocessing_gfpgan.py": 0.0019948482513427734, "load scripts/postprocessing_upscale.py": 0.0019943714141845703, "load scripts/prompt_matrix.py": 0.0020112991333007812, "load scripts/prompts_from_file.py": 0.0020203590393066406, "load scripts/refiner.py": 0.0019953250885009766, "load scripts/sd_upscale.py": 0.0029671192169189453, "load scripts/seed.py": 0.001996278762817383, "load scripts/xyz_grid.py": 0.0029909610748291016, "load scripts/civitai_helper.py": 1.2999165058135986, "load scripts/dynamic_prompting.py": 0.20299839973449707, "load scripts/sd_webui_aspect_ratio_helper.py": 0.14145493507385254, "load scripts/iib_setup.py": 0.12651324272155762, "load scripts/main.py": 0.03169059753417969, "load scripts/image_browser.py": 0.07942962646484375, "load scripts/wildcards.py": 0.0316619873046875, "load scripts/ldsr_model.py": 0.057875633239746094, "load scripts/lora_script.py": 0.23553705215454102, "load scripts/scunet_model.py": 0.0477755069732666, "load scripts/swinir_model.py": 0.04736924171447754, "load scripts/hotkey_config.py": 0.0, "load scripts/extra_options_section.py": 0.013507843017578125, "load scripts": 2.3695433139801025, "load upscalers": 0.03413748741149902, "refresh VAE": 0.0, "refresh textual inversion templates": 0.015624284744262695, "scripts list_optimizers": 0.0, "scripts list_unets": 0.0, "reload hypernetworks": 0.0, "initialize extra networks": 0.07929444313049316, "scripts before_ui_callback": 0.015642166137695312, "create ui": 2.9500203132629395, "gradio launch": 0.5634467601776123, "add APIs": 0.0, "app_started_callback/iib_setup.py": 0.0156252384185791, "app_started_callback/lora_script.py": 0.0, "app_started_callback": 0.0156252384185791 } }, "Packages": [ "-.llow==9.5.0", "-0llow==9.5.0", "-==llow", "-illow==9.5.0", "-llow==9.5.0", "-ransformers==4.25.1", "-rotobuf==3.20.0", "absl-py==1.4.0", "accelerate==0.21.0", "addict==2.4.0", "aenum==3.1.12", "aiofiles==23.1.0", "aiohttp==3.8.4", "aiosignal==1.3.1", "albumentations==1.3.1", "altair==5.0.0", "antlr4-python3-runtime==4.9.3", "anyio==3.6.2", "astunparse==1.6.3", "async-timeout==4.0.2", "attrs==23.1.0", "av==10.0.0", "basicsr==1.4.2", "beautifulsoup4==4.12.2", "bitsandbytes==0.35.4", "blendmodes==2022", "blis==0.7.9", "boltons==23.0.0", "cachetools==5.3.0", "catalogue==2.0.8", "certifi==2023.5.7", "cffi==1.15.1", "chardet==4.0.0", "charset-normalizer==3.1.0", "clean-fid==0.1.35", "click==7.1.2", "clip==1.0", "colorama==0.4.6", "coloredlogs==15.0.1", "confection==0.0.4", "contourpy==1.0.7", "cssselect2==0.7.0", "cycler==0.11.0", "cymem==2.0.7", "cython==3.0.2", "dadaptation==3.1", "datasets==2.13.1", "decorator==4.0.11", "deprecation==2.1.0", "diffusers==0.16.1", "dill==0.3.6", "discord-webhook==1.1.0", "dynamicprompts==0.29.0", "easydict==1.10", "einops==0.4.1", "exceptiongroup==1.1.1", "facexlib==0.3.0", "fairscale==0.4.13", "fastapi==0.94.0", "ffmpy==0.3.0", "filelock==3.12.0", "filterpy==1.4.5", "flask-cors==3.0.10", "flask==1.1.4", "flaskwebgui==0.3.5", "flatbuffers==23.5.9", "font-roboto==0.0.1", "fonts==0.0.3", "fonttools==4.39.4", "freetype-py==2.3.0", "frozenlist==1.3.3", "fsspec==2023.5.0", "ftfy==6.1.1", "future==0.18.3", "fvcore==0.1.5.post20221221", "gast==0.4.0", "gdown==4.7.1", "gfpgan==1.3.8", "gitdb==4.0.10", "gitpython==3.1.32", "google-auth-oauthlib==1.0.0", "google-auth==2.18.1", "google-pasta==0.2.0", "gradio-client==0.5.0", "gradio==3.41.2", "grpcio==1.55.0", "h11==0.12.0", "h5py==3.8.0", "httpcore==0.15.0", "httpx==0.24.1", "huggingface-hub==0.14.1", "humanfriendly==10.0", "idna==2.10", "ifnude==0.0.3", "image-reward==1.2", "imageio-ffmpeg==0.4.8", "imageio==2.28.1", "importlib-metadata==6.6.0", "importlib-resources==6.0.1", "inflection==0.5.1", "iniconfig==2.0.0", "insightface==0.7.3", "iopath==0.1.9", "itsdangerous==1.1.0", "jax==0.4.10", "jinja2==3.1.2", "joblib==1.3.2", "jsonmerge==1.8.0", "jsonschema==4.17.3", "keras==2.12.0", "kiwisolver==1.4.4", "kornia==0.6.7", "lama-cleaner==1.1.2", "langcodes==3.3.0", "lark==1.1.2", "lazy-loader==0.2", "libclang==16.0.0", "lightning-utilities==0.8.0", "linkify-it-py==2.0.2", "lion-pytorch==0.1.2", "llvmlite==0.40.0", "lmdb==1.4.1", "loguru==0.7.0", "lpips==0.1.4", "lxml==4.9.2", "markdown-it-py==2.2.0", "markdown==3.4.3", "markupsafe==2.0.1", "matplotlib==3.7.1", "mdit-py-plugins==0.3.3", "mdurl==0.1.2", "mediapipe==0.10.7", "ml-dtypes==0.1.0", "moviepy==0.2.3.2", "mpmath==1.3.0", "multidict==6.0.4", "multiprocess==0.70.14", "murmurhash==1.0.9", "networkx==3.1", "numba==0.57.0", "numexpr==2.8.4", "numpy==1.23.5", "oauthlib==3.2.2", "omegaconf==2.2.3", "onnx==1.14.1", "onnxruntime-gpu==1.16.0", "onnxruntime==1.16.0", "open-clip-torch==2.20.0", "openai==0.28.0", "opencv-contrib-python==4.7.0.72", "opencv-python-headless==4.8.1.78", "opencv-python==4.8.0.76", "opt-einsum==3.3.0", "orjson==3.8.12", "packaging==23.1", "pandas==2.0.1", "pathy==0.10.1", "piexif==1.1.3", "pillow==9.5.0", "pims==0.6.0", "pip==22.2.1", "pluggy==1.0.0", "portalocker==2.7.0", "preshed==3.0.8", "prettytable==3.9.0", "protobuf==3.20.3", "psutil==5.9.5", "py-cpuinfo==9.0.0", "pyarrow==12.0.1", "pyasn1-modules==0.3.0", "pyasn1==0.5.0", "pycairo==1.23.0", "pycparser==2.21", "pydantic==1.10.9", "pydub==0.25.1", "pyfunctional==1.4.3", "pygments==2.15.1", "pyparsing==3.0.9", "pyreadline3==3.4.1", "pyrsistent==0.19.3", "pysocks==1.7.1", "pytest==7.3.1", "python-dateutil==2.8.2", "python-dotenv==1.0.0", "python-multipart==0.0.6", "pytorch-lightning==1.9.4", "pytz==2023.3", "pywavelets==1.4.1", "pywin32==306", "pyyaml==6.0", "qudida==0.0.4", "realesrgan==0.3.0", "regex==2023.5.5", "reportlab==4.0.0", "requests-oauthlib==1.3.1", "requests==2.31.0", "resize-right==0.0.2", "rich==13.3.5", "rlpycairo==0.2.0", "rsa==4.9", "safetensors==0.3.1", "scikit-image==0.21.0", "scikit-learn==1.3.1", "scipy==1.10.1", "seaborn==0.12.2", "segment-anything==1.0", "semantic-version==2.10.0", "send2trash==1.8.0", "sentencepiece==0.1.99", "sentry-sdk==1.24.0", "setuptools==63.2.0", "six==1.16.0", "slicerator==1.1.0", "smart-open==6.3.0", "smmap==5.0.0", "sniffio==1.3.0", "sounddevice==0.4.6", "soupsieve==2.4.1", "spacy-legacy==3.0.12", "spacy-loggers==1.0.4", "spacy==3.5.3", "srsly==2.4.6", "starlette==0.26.1", "svglib==1.5.1", "sympy==1.12", "tabulate==0.9.0", "tb-nightly==2.14.0a20230523", "tensorboard-data-server==0.7.0", "tensorboard-plugin-wit==1.8.1", "tensorboard==2.13.0", "tensorflow-estimator==2.12.0", "tensorflow-intel==2.12.0", "tensorflow-io-gcs-filesystem==0.31.0", "tensorflow==2.12.0", "termcolor==2.3.0", "thinc==8.1.10", "thop==0.1.1.post2209072238", "threadpoolctl==3.2.0", "tifffile==2023.4.12", "timm==0.9.2", "tinycss2==1.2.1", "tokenizers==0.13.3", "tomesd==0.1.3", "tomli==2.0.1", "toolz==0.12.0", "torch==2.0.1+cu118", "torchdiffeq==0.2.3", "torchmetrics==0.11.4", "torchsde==0.2.6", "torchvision==0.15.2+cu118", "tqdm==4.65.0", "trampoline==0.1.2", "transformers==4.30.2", "typer==0.7.0", "typing-extensions==4.6.0", "tzdata==2023.3", "uc-micro-py==1.0.2", "ultralytics==8.0.199", "urllib3==1.26.16", "uvicorn==0.22.0", "wasabi==1.1.1", "wcwidth==0.2.6", "webencodings==0.5.1", "websockets==11.0.3", "werkzeug==1.0.1", "wheel==0.40.0", "whichcraft==0.6.1", "win32-setctime==1.1.0", "wrapt==1.14.1", "xformers==0.0.20", "xxhash==3.2.0", "yacs==0.1.8", "yapf==0.33.0", "yarl==1.9.2", "zipp==3.15.0" ] }

What browsers do you use to access the UI ?

No response

Console logs

Already up to date.
venv "D:\StableDiffusion\-stable-diffusion-webui\venv\Scripts\Python.exe"
Python 3.10.9 (tags/v3.10.9:1dd9be6, Dec  6 2022, 20:01:21) [MSC v.1934 64 bit (AMD64)]
Version: v1.6.0-298-g5e80d9ee
Commit hash: 5e80d9ee99c5899e5e2b130408ffb65a0585a62a
Launching Web UI with arguments: --xformers --no-half-vae
D:\StableDiffusion\-stable-diffusion-webui\venv\lib\site-packages\pkg_resources\__init__.py:123: PkgResourcesDeprecationWarning: llow is an invalid version and will not be supported in a future release
  warnings.warn(
Civitai Helper: Get Custom Model Folder
Loading weights [c4d7e01814] from D:\StableDiffusion\-stable-diffusion-webui\models\Stable-diffusion\SDXL\bluePencilXL_v100.safetensors
Civitai Helper: Settings:
Civitai Helper: max_size_preview: True
Civitai Helper: skip_nsfw_preview: False
Civitai Helper: open_url_with_js: True
Civitai Helper: proxy:
Creating model from config: D:\StableDiffusion\-stable-diffusion-webui\repositories\generative-models\configs\inference\sd_xl_base.yaml
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Startup time: 102.1s (prepare environment: 52.8s, import torch: 30.8s, import gradio: 3.1s, setup paths: 5.2s, initialize shared: 0.5s, other imports: 3.1s, setup codeformer: 0.5s, list SD models: 0.1s, load scripts: 2.4s, create ui: 3.0s, gradio launch: 0.6s).
Applying attention optimization: xformers... done.
Model loaded in 13.6s (load weights from disk: 1.7s, create model: 0.5s, apply weights to model: 10.6s, move model to device: 0.2s, load textual inversion embeddings: 0.2s, calculate empty prompt: 0.2s).
100%|█████████████████████████████████████████████████████████| 35/35 [00:22<00:00,  1.55it/s]
100%|█████████████████████████████████████████████████████████| 35/35 [01:55<00:00,  3.29s/it]
Total progress: 100%|█████████████████████████████████████████| 70/70 [13:21<00:00, 11.45s/it]
Total progress: 100%|█████████████████████████████████████████| 70/70 [13:21<00:00,  3.30s/it]

Additional information

No response

themandroid commented 4 months ago

I have the same issue using a NVIDIA GeForce RTX 4060 TI (16 GB of RAM) and a similar setup (using an SDXL-based model). The "tiled upscale" steps are applied quite fast. However, the time it takes the system to actually start with the first upscaling iteration after this step, is very long (> 30s). The upscaling steps themselves (in may case: 10) are done acceptably fast, but then after all steps have been completed, the progress is stuck at about 95% of the generation for another minute. The GPU is active the whole time.