AUTOMATIC1111 / stable-diffusion-webui

Stable Diffusion web UI
GNU Affero General Public License v3.0
139.82k stars 26.5k forks source link

[Bug]: Poor performance when using Multi-Controlnet #12947

Closed vaishnav-vn closed 1 year ago

vaishnav-vn commented 1 year ago

Is there an existing issue for this?

What happened?

There was no issue till yesterday (before update - [c9c8485] ) while I used Multi-Controlnet for generating. The previous version of A1111 was performing great!

Controlnet 0: Invert Black and white. Controlne 1: Canny (hires fix enabled) Till yesterday 1 image generation took 1 min to complete Today after update, while using the exact same prompt, seed, model and all other settings... It is taking 4-6 minutes for 1 image. The image getting generated is entirely different and It seems like the canny lines are not getting detected (80% of the time).

Specs : i7 11th gen - RTX 3070 - 16GB Ram -

Steps to reproduce the problem

  1. Write some prompt
  2. Enable 2 controlnet ( in my case invert black and white + Canny )
  3. Give some input image to both controlnets
  4. Generate!

What should have happened?

Normally, The performance should have been better ( lower generation times ) and accurate images as output.

Sysinfo

{ "Platform": "Windows-10-10.0.22621-SP0", "Python": "3.10.6", "Version": "v1.5.2", "Commit": "c9c8485bc1e8720aba70f029d25cba1c4abf2b5c", "Script path": "C:\ALL\Apps\AI\stable-diffusion-webui", "Data path": "C:\ALL\Apps\AI\stable-diffusion-webui", "Extensions dir": "C:\ALL\Apps\AI\stable-diffusion-webui\extensions", "Checksum": "58e648775e88d2dd949a0117efb29cc4ab5367ed050146573f75a265e86ce6f2", "Commandline": [ "launch.py" ], "Torch env info": { "torch_version": "2.0.1+cu118", "is_debug_build": "False", "cuda_compiled_version": "11.8", "gcc_version": null, "clang_version": null, "cmake_version": null, "os": "Microsoft Windows 11 Home Single Language", "libc_version": "N/A", "python_version": "3.10.6 (tags/v3.10.6:9c7b4bd, Aug 1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)] (64-bit runtime)", "python_platform": "Windows-10-10.0.22621-SP0", "is_cuda_available": "True", "cuda_runtime_version": null, "cuda_module_loading": "LAZY", "nvidia_driver_version": "537.13", "nvidia_gpu_models": "GPU 0: NVIDIA GeForce RTX 3070 Laptop GPU", "cudnn_version": null, "pip_version": "pip3", "pip_packages": [ "numpy==1.23.5", "open-clip-torch==2.20.0", "pytorch-lightning==1.9.4", "torch==2.0.1+cu118", "torchdiffeq==0.2.3", "torchmetrics==1.0.1", "torchsde==0.2.5", "torchvision==0.15.2+cu118" ], "conda_packages": null, "hip_compiled_version": "N/A", "hip_runtime_version": "N/A", "miopen_runtime_version": "N/A", "caching_allocator_config": "", "is_xnnpack_available": "True", "cpu_info": [ "Architecture=9", "CurrentClockSpeed=2304", "DeviceID=CPU0", "Family=198", "L2CacheSize=10240", "L2CacheSpeed=", "Manufacturer=GenuineIntel", "MaxClockSpeed=2304", "Name=11th Gen Intel(R) Core(TM) i7-11800H @ 2.30GHz", "ProcessorType=3", "Revision=" ] }, "Exceptions": [ { "exception": "You have not selected any ControlNet Model.", "traceback": [ [ "C:\ALL\Apps\AI\stable-diffusion-webui\modules\scripts.py, line 519, process", "script.process(p, *script_args)" ], [ "C:\ALL\Apps\AI\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py, line 738, process", "model_net = Script.load_control_model(p, unet, unit.model, unit.low_vram)" ], [ "C:\ALL\Apps\AI\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py, line 311, load_control_model", "model_net = Script.build_control_model(p, unet, model, lowvram)" ], [ "C:\ALL\Apps\AI\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py, line 321, build_control_model", "raise RuntimeError(f\"You have not selected any ControlNet Model.\")" ] ] }, { "exception": "embedding file has multiple terms in it", "traceback": [ [ "C:\ALL\Apps\AI\stable-diffusion-webui\modules\textual_inversion\textual_inversion.py, line 227, load_from_dir", "self.load_from_file(fullfn, fn)" ], [ "C:\ALL\Apps\AI\stable-diffusion-webui\modules\textual_inversion\textual_inversion.py, line 192, load_from_file", "assert len(data.keys()) == 1, 'embedding file has multiple terms in it'" ] ] } ], "CPU": { "model": "Intel64 Family 6 Model 141 Stepping 1, GenuineIntel", "count logical": 16, "count physical": 8 }, "RAM": { "total": "16GB", "used": "10GB", "free": "6GB" }, "Extensions": [ { "name": "openpose-editor", "path": "C:\ALL\Apps\AI\stable-diffusion-webui\extensions\openpose-editor", "version": "722bca6f", "branch": "master", "remote": "https://github.com/fkunn1326/openpose-editor.git" }, { "name": "sd-webui-additional-networks", "path": "C:\ALL\Apps\AI\stable-diffusion-webui\extensions\sd-webui-additional-networks", "version": "e9f3d622", "branch": "main", "remote": "https://github.com/kohya-ss/sd-webui-additional-networks.git" }, { "name": "sd-webui-controlnet", "path": "C:\ALL\Apps\AI\stable-diffusion-webui\extensions\sd-webui-controlnet", "version": "c3b32f25", "branch": "main", "remote": "https://github.com/Mikubill/sd-webui-controlnet.git" }, { "name": "sd-webui-qrcode-toolkit", "path": "C:\ALL\Apps\AI\stable-diffusion-webui\extensions\sd-webui-qrcode-toolkit", "version": "ed244d07", "branch": "main", "remote": "https://github.com/antfu/sd-webui-qrcode-toolkit.git" }, { "name": "stable-diffusion-webui-composable-lora", "path": "C:\ALL\Apps\AI\stable-diffusion-webui\extensions\stable-diffusion-webui-composable-lora", "version": "d4963e48", "branch": "main", "remote": "https://github.com/opparco/stable-diffusion-webui-composable-lora.git" }, { "name": "stable-diffusion-webui-two-shot", "path": "C:\ALL\Apps\AI\stable-diffusion-webui\extensions\stable-diffusion-webui-two-shot", "version": "6b55dd52", "branch": "main", "remote": "https://github.com/ashen-sensored/stable-diffusion-webui-two-shot.git" } ], "Inactive extensions": [ { "name": "webui-qrcode-generator", "path": "C:\ALL\Apps\AI\stable-diffusion-webui\extensions\webui-qrcode-generator", "version": "0a09d2f3", "branch": "master", "remote": "https://github.com/missionfloyd/webui-qrcode-generator.git" } ], "Environment": { "GRADIO_ANALYTICS_ENABLED": "False" }, "Config": { "samples_save": true, "samples_format": "png", "samples_filename_pattern": "", "save_images_add_number": true, "grid_save": true, "grid_format": "png", "grid_extended_filename": false, "grid_only_if_multiple": true, "grid_prevent_empty_spots": false, "n_rows": -1, "enable_pnginfo": true, "save_txt": false, "save_images_before_face_restoration": false, "save_images_before_highres_fix": false, "save_images_before_color_correction": false, "save_mask": false, "save_mask_composite": false, "jpeg_quality": 80, "webp_lossless": false, "export_for_4chan": true, "img_downscale_threshold": 4.0, "target_side_length": 4000, "img_max_size_mp": 200, "use_original_name_batch": true, "use_upscaler_name_as_suffix": false, "save_selected_only": true, "do_not_add_watermark": false, "temp_dir": "", "clean_temp_dir_at_start": false, "outdir_samples": "", "outdir_txt2img_samples": "outputs/txt2img-images", "outdir_img2img_samples": "outputs/img2img-images", "outdir_extras_samples": "outputs/extras-images", "outdir_grids": "", "outdir_txt2img_grids": "outputs/txt2img-grids", "outdir_img2img_grids": "outputs/img2img-grids", "outdir_save": "log/images", "save_to_dirs": true, "grid_save_to_dirs": true, "use_save_to_dirs_for_ui": false, "directories_filename_pattern": "[date]", "directories_max_prompt_words": 8, "ESRGAN_tile": 192, "ESRGAN_tile_overlap": 8, "realesrgan_enabled_models": [ "R-ESRGAN 4x+", "R-ESRGAN 4x+ Anime6B" ], "upscaler_for_img2img": null, "face_restoration_model": "CodeFormer", "code_former_weight": 0.5, "face_restoration_unload": false, "show_warnings": false, "memmon_poll_rate": 8, "samples_log_stdout": false, "multiple_tqdm": true, "print_hypernet_extra": false, "unload_models_when_training": false, "pin_memory": false, "save_optimizer_state": false, "save_training_settings_to_txt": true, "dataset_filename_word_regex": "", "dataset_filename_join_string": " ", "training_image_repeats_per_epoch": 1, "training_write_csv_every": 500, "training_xattention_optimizations": false, "training_enable_tensorboard": false, "training_tensorboard_save_images": false, "training_tensorboard_flush_every": 120, "sd_model_checkpoint": "revAnimated_v122.safetensors [4199bcdd14]", "sd_checkpoint_cache": 0, "sd_vae_checkpoint_cache": 0, "sd_vae": "None", "sd_vae_as_default": true, "inpainting_mask_weight": 1.0, "initial_noise_multiplier": 1.0, "img2img_color_correction": false, "img2img_fix_steps": false, "img2img_background_color": "#ffffff", "enable_quantization": false, "enable_emphasis": true, "enable_batch_seeds": true, "comma_padding_backtrack": 20, "CLIP_stop_at_last_layers": 1, "upcast_attn": false, "use_old_emphasis_implementation": false, "use_old_karras_scheduler_sigmas": false, "no_dpmpp_sde_batch_determinism": false, "use_old_hires_fix_width_height": false, "interrogate_keep_models_in_memory": false, "interrogate_return_ranks": false, "interrogate_clip_num_beams": 1, "interrogate_clip_min_length": 24, "interrogate_clip_max_length": 48, "interrogate_clip_dict_limit": 1500, "interrogate_clip_skip_categories": [], "interrogate_deepbooru_score_threshold": 0.5, "deepbooru_sort_alpha": true, "deepbooru_use_spaces": false, "deepbooru_escape": true, "deepbooru_filter_tags": "", "extra_networks_default_view": "cards", "extra_networks_default_multiplier": 1.0, "extra_networks_card_width": 0, "extra_networks_card_height": 0, "extra_networks_add_text_separator": " ", "sd_hypernetwork": "None", "return_grid": true, "return_mask": false, "return_mask_composite": false, "do_not_show_images": false, "add_model_hash_to_info": true, "add_model_name_to_info": true, "disable_weights_auto_swap": true, "send_seed": true, "send_size": true, "font": "", "js_modal_lightbox": true, "js_modal_lightbox_initially_zoomed": true, "show_progress_in_title": true, "samplers_in_dropdown": true, "dimensions_and_batch_together": true, "keyedit_precision_attention": 0.1, "keyedit_precision_extra": 0.05, "quicksettings": "sd_model_checkpoint", "hidden_tabs": [], "ui_reorder": "inpaint, sampler, checkboxes, hires_fix, dimensions, cfg, seed, batch, override_settings, scripts", "ui_extra_networks_tab_reorder": "", "localization": "None", "show_progressbar": true, "live_previews_enable": true, "show_progress_grid": true, "show_progress_every_n_steps": 10, "show_progress_type": "Approx NN", "live_preview_content": "Prompt", "live_preview_refresh_period": 1000, "hide_samplers": [], "eta_ddim": 0.0, "eta_ancestral": 1.0, "ddim_discretize": "uniform", "s_churn": 0.0, "s_tmin": 0.0, "s_noise": 1.0, "eta_noise_seed_delta": 31337, "always_discard_next_to_last_sigma": false, "uni_pc_variant": "bh1", "uni_pc_skip_type": "time_uniform", "uni_pc_order": 3, "uni_pc_lower_order_final": true, "postprocessing_enable_in_main_ui": [], "postprocessing_operation_order": [], "upscaling_max_images_in_cache": 5, "disabled_extensions": [ "webui-qrcode-generator" ], "sd_checkpoint_hash": "4199bcdd147e11328d5f3560301d5a7ab4ac7eeefbf49dc3eb663cb3e772b9ac", "disable_all_extensions": "none", "ldsr_steps": 100, "ldsr_cached": false, "SWIN_tile": 192, "SWIN_tile_overlap": 8, "sd_lora": "None", "additional_networks_extra_lora_path": "", "additional_networks_sort_models_by": "name", "additional_networks_reverse_sort_order": false, "additional_networks_model_name_filter": "", "additional_networks_xy_grid_model_metadata": "", "additional_networks_hash_thread_count": 1.0, "additional_networks_back_up_model_when_saving": true, "additional_networks_show_only_safetensors": false, "additional_networks_show_only_models_with_metadata": "disabled", "additional_networks_max_top_tags": 20.0, "additional_networks_max_dataset_folders": 20.0, "control_net_model_config": "models\cldm_v15.yaml", "control_net_model_adapter_config": "models\sketch_adapter_v14.yaml", "control_net_detectedmap_dir": "detected_maps", "control_net_models_path": "", "control_net_max_models_num": 2, "control_net_model_cache_size": 2, "control_net_control_transfer": false, "control_net_no_detectmap": false, "control_net_detectmap_autosaving": false, "control_net_only_midctrl_hires": true, "control_net_allow_script_control": true, "control_net_skip_img2img_processing": false, "control_net_monocular_depth_optim": false, "control_net_only_mid_control": false, "control_net_cfg_based_guidance": false, "control_net_sync_field_args": false, "quicksettings_list": [ "sd_model_checkpoint", "sd_vae", "CLIP_stop_at_last_layers" ], "ui_reorder_list": [ "inpaint", "sampler", "checkboxes", "hires_fix", "dimensions", "cfg", "seed", "batch", "override_settings", "scripts" ], "grid_zip_filename_pattern": "", "save_init_img": false, "outdir_init_images": "outputs/init-images", "SCUNET_tile": 256, "SCUNET_tile_overlap": 8, "list_hidden_files": true, "sd_unet": "Automatic", "randn_source": "GPU", "cross_attention_optimization": "Automatic", "s_min_uncond": 0, "token_merging_ratio": 0, "token_merging_ratio_img2img": 0, "token_merging_ratio_hr": 0, "pad_cond_uncond": false, "experimental_persistent_cond_cache": false, "dont_fix_second_order_samplers_schedule": false, "hires_fix_use_firstpass_conds": false, "lora_functional": false, "extra_networks_show_hidden_directories": true, "extra_networks_hidden_models": "When searched", "lora_preferred_name": "Alias from file", "lora_add_hashes_to_infotext": true, "gradio_theme": "Default", "img2img_editor_height": 720, "js_modal_lightbox_gamepad": false, "js_modal_lightbox_gamepad_repeat": 250.0, "keyedit_delimiters": ".,\/!?%^*;:{}=`~()", "ui_tab_order": [], "hires_fix_show_sampler": false, "hires_fix_show_prompts": false, "disable_token_counters": false, "extra_options": [], "extra_options_accordion": false, "add_version_to_infotext": true, "infotext_styles": "Apply if any", "live_previews_image_format": "png", "k_sched_type": "Automatic", "sigma_min": 0.0, "sigma_max": 0.0, "rho": 0.0, "canvas_hotkey_zoom": "Alt", "canvas_hotkey_adjust": "Ctrl", "canvas_hotkey_move": "F", "canvas_hotkey_fullscreen": "S", "canvas_hotkey_reset": "R", "canvas_hotkey_overlap": "O", "canvas_show_tooltip": true, "canvas_disabled_functions": [ "Overlap" ], "control_net_modules_path": "", "controlnet_show_batch_images_in_ui": false, "controlnet_increment_seed_during_batch": false, "controlnet_disable_control_type": false, "controlnet_disable_openpose_edit": false, "sd_vae_overrides_per_model_preferences": false }, "Startup": { "total": 38.70025086402893, "records": { "start": 0.0, "launcher": 29.12527632713318, "import torch": 3.1714284420013428, "import gradio": 1.0648488998413086, "setup paths": 0.9012973308563232, "import ldm": 0.006901741027832031, "other imports": 1.5305562019348145, "opts onchange": 0.002001047134399414, "setup SD model": 0.0, "setup codeformer": 0.08341789245605469, "setup gfpgan": 0.0, "list extensions": 0.001005411148071289, "list SD models": 0.053003549575805664, "load scripts/custom_code.py": 0.0025243759155273438, "load scripts/img2imgalt.py": 0.001409292221069336, "load scripts/loopback.py": 0.0, "load scripts/outpainting_mk_2.py": 0.0010058879852294922, "load scripts/poor_mans_outpainting.py": 0.0, "load scripts/postprocessing_codeformer.py": 0.0010013580322265625, "load scripts/postprocessing_gfpgan.py": 0.0, "load scripts/postprocessing_upscale.py": 0.0009980201721191406, "load scripts/prompt_matrix.py": 0.0, "load scripts/prompts_from_file.py": 0.0010004043579101562, "load scripts/sd_upscale.py": 0.0, "load scripts/xyz_grid.py": 0.1314539909362793, "load scripts/main.py": 0.7384119033813477, "load scripts/additional_networks.py": 0.07616329193115234, "load scripts/addnet_xyz_grid_support.py": 0.00010418891906738281, "load scripts/lora_compvis.py": 0.0009036064147949219, "load scripts/metadata_editor.py": 0.0010075569152832031, "load scripts/model_util.py": 0.005003452301025391, "load scripts/safetensors_hack.py": 0.0003685951232910156, "load scripts/util.py": 0.00033974647521972656, "load scripts/adapter.py": 0.0010209083557128906, "load scripts/api.py": 0.2534666061401367, "load scripts/batch_hijack.py": 0.0, "load scripts/cldm.py": 0.0010006427764892578, "load scripts/controlnet.py": 0.1305370330810547, "load scripts/controlnet_version.py": 0.0015742778778076172, "load scripts/external_code.py": 0.0009474754333496094, "load scripts/global_state.py": 0.0, "load scripts/hook.py": 0.001073598861694336, "load scripts/infotext.py": 0.0010673999786376953, "load scripts/logging.py": 0.0, "load scripts/lvminthin.py": 0.0009644031524658203, "load scripts/movie2movie.py": 0.0009963512420654297, "load scripts/processor.py": 0.0, "load scripts/utils.py": 0.0009999275207519531, "load scripts/xyz_grid_support.py": 0.0009992122650146484, "load scripts/interface.py": 0.0003440380096435547, "load scripts/composable_lora_script.py": 0.015679597854614258, "load scripts/sketch_helper.py": 0.001644134521484375, "load scripts/two_shot.py": 0.017160415649414062, "load scripts/ldsr_model.py": 0.0189664363861084, "load scripts/lora_script.py": 0.1658637523651123, "load scripts/scunet_model.py": 0.025580167770385742, "load scripts/swinir_model.py": 0.017696142196655273, "load scripts/hotkey_config.py": 0.007771492004394531, "load scripts/extra_options_section.py": 0.009616374969482422, "load scripts": 1.6366660594940186, "load upscalers": 0.004912614822387695, "refresh VAE": 0.0019979476928710938, "refresh textual inversion templates": 0.0, "scripts list_optimizers": 0.0010046958923339844, "scripts list_unets": 0.0, "reload hypernetworks": 0.010507345199584961, "initialize extra networks": 0.05258798599243164, "scripts before_ui_callback": 0.00099945068359375, "create ui": 0.572223424911499, "gradio launch": 0.4711012840270996, "add APIs": 0.00651240348815918, "app_started_callback/api.py": 0.0010001659393310547, "app_started_callback/lora_script.py": 0.0010006427764892578, "app_started_callback": 0.0020008087158203125 } }, "Packages": [ "absl-py==1.4.0", "accelerate==0.18.0", "addict==2.4.0", "aenum==3.1.15", "aiofiles==23.1.0", "aiohttp==3.8.5", "aiosignal==1.3.1", "altair==5.0.1", "antlr4-python3-runtime==4.9.3", "anyio==3.7.1", "async-timeout==4.0.2", "attrs==23.1.0", "basicsr==1.4.2", "beautifulsoup4==4.12.2", "blendmodes==2022", "boltons==23.0.0", "cachetools==5.3.1", "certifi==2023.7.22", "cffi==1.15.1", "charset-normalizer==3.2.0", "clean-fid==0.1.35", "click==8.1.6", "clip==1.0", "colorama==0.4.6", "contourpy==1.1.0", "cssselect2==0.7.0", "cycler==0.11.0", "deprecation==2.1.0", "einops==0.4.1", "exceptiongroup==1.1.2", "facexlib==0.3.0", "fastapi==0.94.0", "ffmpy==0.3.1", "filelock==3.12.2", "filterpy==1.4.5", "flatbuffers==23.5.26", "fonttools==4.41.1", "frozenlist==1.4.0", "fsspec==2023.6.0", "ftfy==6.1.1", "future==0.18.3", "fvcore==0.1.5.post20221221", "gdown==4.7.1", "gfpgan==1.3.8", "gitdb==4.0.10", "gitpython==3.1.30", "google-auth-oauthlib==1.0.0", "google-auth==2.22.0", "gradio-client==0.5.0", "gradio==3.32.0", "grpcio==1.56.2", "h11==0.12.0", "httpcore==0.15.0", "httpx==0.24.1", "huggingface-hub==0.16.4", "idna==3.4", "imageio==2.31.1", "importlib-metadata==6.8.0", "importlib-resources==6.0.1", "inflection==0.5.1", "iopath==0.1.9", "jinja2==3.1.2", "jsonmerge==1.8.0", "jsonschema-specifications==2023.7.1", "jsonschema==4.18.4", "kiwisolver==1.4.4", "kornia==0.6.7", "lark==1.1.2", "lazy-loader==0.3", "lightning-utilities==0.9.0", "linkify-it-py==2.0.2", "llvmlite==0.40.1", "lmdb==1.4.1", "lpips==0.1.4", "lxml==4.9.3", "markdown-it-py==2.2.0", "markdown==3.4.4", "markupsafe==2.1.3", "matplotlib==3.7.2", "mdit-py-plugins==0.3.3", "mdurl==0.1.2", "mediapipe==0.10.2", "mpmath==1.3.0", "multidict==6.0.4", "networkx==3.1", "numba==0.57.1", "numpy==1.23.5", "oauthlib==3.2.2", "omegaconf==2.2.3", "open-clip-torch==2.20.0", "opencv-contrib-python==4.8.0.74", "opencv-python==4.8.0.74", "orjson==3.9.2", "packaging==23.1", "pandas==2.0.3", "piexif==1.1.3", "pillow==9.5.0", "pip==22.2.1", "platformdirs==3.9.1", "portalocker==2.7.0", "protobuf==3.20.0", "psutil==5.9.5", "pyasn1-modules==0.3.0", "pyasn1==0.5.0", "pycparser==2.21", "pydantic==1.10.12", "pydub==0.25.1", "pygments==2.15.1", "pyparsing==3.0.9", "pysocks==1.7.1", "python-dateutil==2.8.2", "python-multipart==0.0.6", "pytorch-lightning==1.9.4", "pytz==2023.3", "pywavelets==1.4.1", "pywin32==306", "pyyaml==6.0.1", "realesrgan==0.3.0", "referencing==0.30.0", "regex==2023.6.3", "reportlab==4.0.4", "requests-oauthlib==1.3.1", "requests==2.31.0", "resize-right==0.0.2", "rpds-py==0.9.2", "rsa==4.9", "safetensors==0.3.1", "scikit-image==0.20.0", "scipy==1.11.1", "segno==1.5.2", "semantic-version==2.10.0", "sentencepiece==0.1.99", "setuptools==63.2.0", "six==1.16.0", "smmap==5.0.0", "sniffio==1.3.0", "sounddevice==0.4.6", "soupsieve==2.4.1", "starlette==0.26.1", "svglib==1.5.1", "sympy==1.12", "tabulate==0.9.0", "tb-nightly==2.14.0a20230728", "tensorboard-data-server==0.7.1", "termcolor==2.3.0", "tifffile==2023.7.18", "timm==0.6.7", "tinycss2==1.2.1", "tokenizers==0.13.3", "tomesd==0.1.2", "tomli==2.0.1", "toolz==0.12.0", "torch==2.0.1+cu118", "torchdiffeq==0.2.3", "torchmetrics==1.0.1", "torchsde==0.2.5", "torchvision==0.15.2+cu118", "tqdm==4.65.0", "trampoline==0.1.2", "transformers==4.25.1", "typing-extensions==4.7.1", "tzdata==2023.3", "uc-micro-py==1.0.2", "urllib3==1.26.16", "uvicorn==0.23.1", "wcwidth==0.2.6", "webencodings==0.5.1", "websockets==11.0.3", "werkzeug==2.3.6", "wheel==0.41.0", "yacs==0.1.8", "yapf==0.40.1", "yarl==1.9.2", "zipp==3.16.2" ] }

What browsers do you use to access the UI ?

Google Chrome

Console logs

I have reverted to the older version...

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by switching back to a branch.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -c with the switch command. Example:

  git switch -c <new-branch-name>

Or undo this operation with:

  git switch -

Turn off this advice by setting config variable advice.detachedHead to false

HEAD is now at c9c8485b Merge branch 'release_candidate'
M       webui-user.bat
venv "C:\ALL\Apps\AI\stable-diffusion-webui\venv\Scripts\Python.exe"
Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug  1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Version: v1.5.2
Commit hash: c9c8485bc1e8720aba70f029d25cba1c4abf2b5c
Fetching updates for Stable Diffusion XL...
Checking out commit for Stable Diffusion XL with hash: 5c10deee76adad0032b412294130090932317a87...
Previous HEAD position was 45c443b Fix license-files setting for project (#71)
HEAD is now at 5c10dee Merge branch 'main' of https://github.com/Stability-AI/generative-models into main
Fetching updates for K-diffusion...
Checking out commit for K-diffusion with hash: c9fe758757e022f05ca5a53fa8fac28889e4f1cf...
Previous HEAD position was ab527a9 Release 0.0.16
HEAD is now at c9fe758 Release 0.0.15
Installing requirements

Launching Web UI with arguments:
no module 'xformers'. Processing without...
no module 'xformers'. Processing without...
No module 'xformers'. Proceeding without it.
[AddNet] Updating model hashes...
0it [00:00, ?it/s]
[AddNet] Updating model hashes...
0it [00:00, ?it/s]
2023-09-01 13:51:39,062 - ControlNet - INFO - ControlNet v1.1.313
ControlNet preprocessor location: C:\ALL\Apps\AI\stable-diffusion-webui\extensions\sd-webui-controlnet\annotator\downloads
2023-09-01 13:51:39,191 - ControlNet - INFO - ControlNet v1.1.313
Loading weights [4199bcdd14] from C:\ALL\Apps\AI\stable-diffusion-webui\models\Stable-diffusion\revAnimated_v122.safetensors
Creating model from config: C:\ALL\Apps\AI\stable-diffusion-webui\configs\v1-inference.yaml
LatentDiffusion: Running in eps-prediction mode
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Startup time: 38.7s (launcher: 29.1s, import torch: 3.2s, import gradio: 1.1s, setup paths: 0.9s, other imports: 1.5s, load scripts: 1.6s, create ui: 0.6s, gradio launch: 0.5s).
DiffusionWrapper has 859.52 M params.
Applying attention optimization: Doggettx... done.
*** Error loading embedding narutoStyleLora_v20.safetensors
    Traceback (most recent call last):
      File "C:\ALL\Apps\AI\stable-diffusion-webui\modules\textual_inversion\textual_inversion.py", line 227, in load_from_dir
        self.load_from_file(fullfn, fn)
      File "C:\ALL\Apps\AI\stable-diffusion-webui\modules\textual_inversion\textual_inversion.py", line 192, in load_from_file
        assert len(data.keys()) == 1, 'embedding file has multiple terms in it'
    AssertionError: embedding file has multiple terms in it

---
Model loaded in 8.5s (load weights from disk: 0.9s, create model: 0.7s, apply weights to model: 3.9s, apply half(): 1.6s, move model to device: 0.9s, load textual inversion embeddings: 0.4s).
                                  2023-09-01 13:53:08,858 - ControlNet - INFO - Loading model: control_v1p_sd15_qrcode_monster [a6e58995]it [00:00, ?it/s]
2023-09-01 13:53:08,956 - ControlNet - INFO - Loaded state_dict from [C:\ALL\Apps\AI\stable-diffusion-webui\models\ControlNet\control_v1p_sd15_qrcode_monster.safetensors]
2023-09-01 13:53:08,958 - ControlNet - INFO - Loading config: C:\ALL\Apps\AI\stable-diffusion-webui\extensions\sd-webui-controlnet\models\control_v1p_sd15_qrcode_monster.yaml
2023-09-01 13:53:12,464 - ControlNet - INFO - ControlNet model control_v1p_sd15_qrcode_monster [a6e58995] loaded.
2023-09-01 13:53:12,543 - ControlNet - INFO - Loading preprocessor: invert
2023-09-01 13:53:12,543 - ControlNet - INFO - preprocessor resolution = 512
*** Error running process: C:\ALL\Apps\AI\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py
    Traceback (most recent call last):
      File "C:\ALL\Apps\AI\stable-diffusion-webui\modules\scripts.py", line 519, in process
        script.process(p, *script_args)
      File "C:\ALL\Apps\AI\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py", line 738, in process
        model_net = Script.load_control_model(p, unet, unit.model, unit.low_vram)
      File "C:\ALL\Apps\AI\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py", line 311, in load_control_model
        model_net = Script.build_control_model(p, unet, model, lowvram)
      File "C:\ALL\Apps\AI\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py", line 321, in build_control_model
        raise RuntimeError(f"You have not selected any ControlNet Model.")
    RuntimeError: You have not selected any ControlNet Model.

---
100%|██████████████████████████████████████████████████████████████████████████████████| 20/20 [00:03<00:00,  5.35it/s]
100%|██████████████████████████████████████████████████████████████████████████████████| 20/20 [00:24<00:00,  1.23s/it]
Total progress: 100%|██████████████████████████████████████████████████████████████████| 40/40 [01:37<00:00,  2.44s/it]
2023-09-01 13:53:51,154 - ControlNet - INFO - Loading model from cache: control_v1p_sd15_qrcode_monster [a6e58995]s/it]
2023-09-01 13:53:51,155 - ControlNet - INFO - Loading preprocessor: invert
2023-09-01 13:53:51,155 - ControlNet - INFO - preprocessor resolution = 512
2023-09-01 13:53:51,194 - ControlNet - INFO - Loading model: control_v11p_sd15_canny [d14c016b]
2023-09-01 13:53:52,943 - ControlNet - INFO - Loaded state_dict from [C:\ALL\Apps\AI\stable-diffusion-webui\models\ControlNet\control_v11p_sd15_canny.pth]
2023-09-01 13:53:52,944 - ControlNet - INFO - Loading config: C:\ALL\Apps\AI\stable-diffusion-webui\extensions\sd-webui-controlnet\models\control_v11p_sd15_canny.yaml
2023-09-01 13:53:55,681 - ControlNet - INFO - ControlNet model control_v11p_sd15_canny [d14c016b] loaded.
2023-09-01 13:53:55,810 - ControlNet - INFO - Loading preprocessor: canny
2023-09-01 13:53:55,811 - ControlNet - INFO - preprocessor resolution = 512
100%|██████████████████████████████████████████████████████████████████████████████████| 20/20 [00:05<00:00,  3.66it/s]
100%|██████████████████████████████████████████████████████████████████████████████████| 20/20 [00:37<00:00,  1.87s/it]
Total progress: 100%|██████████████████████████████████████████████████████████████████| 40/40 [00:54<00:00,  1.37s/it]
2023-09-01 13:55:12,335 - ControlNet - INFO - Loading model from cache: control_v1p_sd15_qrcode_monster [a6e58995]s/it]
2023-09-01 13:55:12,337 - ControlNet - INFO - Loading preprocessor: invert
2023-09-01 13:55:12,337 - ControlNet - INFO - preprocessor resolution = 512
2023-09-01 13:55:12,378 - ControlNet - INFO - Loading model from cache: control_v11p_sd15_canny [d14c016b]
2023-09-01 13:55:12,404 - ControlNet - INFO - Loading preprocessor: canny
2023-09-01 13:55:12,404 - ControlNet - INFO - preprocessor resolution = 512
100%|██████████████████████████████████████████████████████████████████████████████████| 20/20 [00:05<00:00,  3.64it/s]
100%|██████████████████████████████████████████████████████████████████████████████████| 20/20 [00:37<00:00,  1.86s/it]
Total progress: 100%|██████████████████████████████████████████████████████████████████| 40/40 [00:54<00:00,  1.37s/it]
2023-09-01 13:56:31,118 - ControlNet - INFO - Loading model from cache: control_v1p_sd15_qrcode_monster [a6e58995]s/it]
2023-09-01 13:56:31,118 - ControlNet - INFO - Loading preprocessor: invert
2023-09-01 13:56:31,119 - ControlNet - INFO - preprocessor resolution = 512
2023-09-01 13:56:31,161 - ControlNet - INFO - Loading model from cache: control_v11p_sd15_canny [d14c016b]
2023-09-01 13:56:31,185 - ControlNet - INFO - Loading preprocessor: canny
2023-09-01 13:56:31,187 - ControlNet - INFO - preprocessor resolution = 512
100%|██████████████████████████████████████████████████████████████████████████████████| 20/20 [00:05<00:00,  3.67it/s]
100%|██████████████████████████████████████████████████████████████████████████████████| 20/20 [00:37<00:00,  1.89s/it]
Total progress: 100%|██████████████████████████████████████████████████████████████████| 40/40 [00:55<00:00,  1.38s/it]
Total progress: 100%|██████████████████████████████████████████████████████████████████| 40/40 [00:55<00:00,  1.94s/it]

Additional information

No response

catboxanon commented 1 year ago

This should be opened upstream in the ControlNet extension repo with better reproduction steps if you truly believe this is an issue. I get the same performance in ControlNet as I did months ago.