AUTOMATIC1111 / stable-diffusion-webui

Stable Diffusion web UI
GNU Affero General Public License v3.0
135.67k stars 25.9k forks source link

[Bug]: When FP8 is enabled, Only one lora applied #15995

Open Bocchi-Chan2023 opened 4 weeks ago

Bocchi-Chan2023 commented 4 weeks ago

Checklist

What happened?

branch: dev When FP8 is enabled, all but the last LoRA will no longer apply. In other words, applying more than one LoRA will not work This log is for ROCm, but the same problem was confirmed for NVIDIA

Steps to reproduce the problem

  1. Go to setting and enable FP8
  2. use 2+ LoRA at the same time

What should have happened?

Two or more LoRAs should be applied at the same time

What browsers do you use to access the UI ?

No response

Sysinfo

Sysinfo

```json { "Platform": "Linux-6.8.11-1-liquorix-amd64-x86_64-with-glibc2.35", "Python": "3.10.12", "Version": "v1.9.4-160-ge33bb8fe", "Commit": "e33bb8febeec70f11c630d9d4df3d73bd8c30330", "Script path": "/home/moon/softwares/stable-diffusion-webui", "Data path": "/home/moon/softwares/stable-diffusion-webui", "Extensions dir": "/home/moon/softwares/stable-diffusion-webui/extensions", "Checksum": "e9f2fe6bbe8bb28e150be80a179938c173850c4f7614235315e12acf6309e4e4", "Commandline": [ "launch.py", "--medvram-sdxl", "--opt-sdp-attention" ], "Torch env info": { "torch_version": "2.4.0", "is_debug_build": "False", "cuda_compiled_version": "N/A", "gcc_version": "(Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0", "clang_version": null, "cmake_version": "version 3.22.1", "os": "Ubuntu 22.04.4 LTS (x86_64)", "libc_version": "glibc-2.35", "python_version": "3.10.12 (main, Nov 20 2023, 15:14:05) [GCC 11.4.0] (64-bit runtime)", "python_platform": "Linux-6.8.11-1-liquorix-amd64-x86_64-with-glibc2.35", "is_cuda_available": "True", "cuda_runtime_version": null, "cuda_module_loading": "LAZY", "nvidia_driver_version": null, "nvidia_gpu_models": "AMD Radeon RX 6600 (gfx1030)", "cudnn_version": null, "pip_version": "pip3", "pip_packages": [ "numpy==1.26.2", "onnxruntime==1.18.0", "open-clip-torch==2.20.0", "optree==0.11.0", "pytorch-lightning==1.9.4", "pytorch-triton-rocm==3.0.0+bbe6246e37", "torch==2.4.0.dev20240607+rocm6.1", "torchaudio==2.4.0.dev20240608+rocm6.1", "torchdiffeq==0.2.3", "torchmetrics==1.4.0.post0", "torchsde==0.2.6", "torchvision==0.19.0.dev20240608+rocm6.1" ], "conda_packages": null, "hip_compiled_version": "6.1.40091-a8dbc0c19", "hip_runtime_version": "6.1.40091", "miopen_runtime_version": "3.1.0", "caching_allocator_config": "", "is_xnnpack_available": "True", "cpu_info": [ "Architecture: x86_64", "CPU op-mode(s): 32-bit, 64-bit", "Address sizes: 48 bits physical, 48 bits virtual", "Byte Order: Little Endian", "CPU(s): 12", "On-line CPU(s) list: 0-11", "Vendor ID: AuthenticAMD", "Model name: AMD Ryzen 5 5500", "CPU family: 25", "Model: 80", "Thread(s) per core: 2", "Core(s) per socket: 6", "Socket(s): 1", "Stepping: 0", "CPU max MHz: 4457.0000", "CPU min MHz: 400.0000", "BogoMIPS: 7200.43", "Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl nonstop_tsc cpuid extd_apicid aperfmperf rapl pni pclmulqdq monitor ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw ibs skinit wdt tce topoext perfctr_core perfctr_nb bpext perfctr_llc mwaitx cpb cat_l3 cdp_l3 hw_pstate ssbd mba ibrs ibpb stibp vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid cqm rdt_a rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local user_shstk clzero irperf xsaveerptr rdpru wbnoinvd cppc arat npt lbrv svm_lock nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold avic v_vmsave_vmload vgif v_spec_ctrl umip pku ospke vaes vpclmulqdq rdpid overflow_recov succor smca fsrm debug_swap", "Virtualization: AMD-V", "L1d cache: 192 KiB (6 instances)", "L1i cache: 192 KiB (6 instances)", "L2 cache: 3 MiB (6 instances)", "L3 cache: 16 MiB (1 instance)", "NUMA node(s): 1", "NUMA node0 CPU(s): 0-11", "Vulnerability Gather data sampling: Not affected", "Vulnerability Itlb multihit: Not affected", "Vulnerability L1tf: Not affected", "Vulnerability Mds: Not affected", "Vulnerability Meltdown: Not affected", "Vulnerability Mmio stale data: Not affected", "Vulnerability Reg file data sampling: Not affected", "Vulnerability Retbleed: Not affected", "Vulnerability Spec rstack overflow: Mitigation; Safe RET", "Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl", "Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization", "Vulnerability Spectre v2: Mitigation; Retpolines; IBPB conditional; IBRS_FW; STIBP always-on; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected", "Vulnerability Srbds: Not affected", "Vulnerability Tsx async abort: Not affected" ] }, "Exceptions": [], "CPU": { "model": "x86_64", "count logical": 12, "count physical": 6 }, "RAM": { "total": "31GB", "used": "17GB", "free": "315MB", "active": "24GB", "inactive": "6GB", "buffers": "143MB", "cached": "13GB", "shared": "169MB" }, "Extensions": [ { "name": "a1111-sd-webui-tagcomplete", "path": "/home/moon/softwares/stable-diffusion-webui/extensions/a1111-sd-webui-tagcomplete", "version": "29b5bf07", "branch": "main", "remote": "https://github.com/DominikDoom/a1111-sd-webui-tagcomplete.git" }, { "name": "adetailer", "path": "/home/moon/softwares/stable-diffusion-webui/extensions/adetailer", "version": "a89c01d3", "branch": "main", "remote": "https://github.com/Bing-su/adetailer" }, { "name": "multidiffusion-upscaler-for-automatic1111", "path": "/home/moon/softwares/stable-diffusion-webui/extensions/multidiffusion-upscaler-for-automatic1111", "version": "574a0963", "branch": "main", "remote": "https://github.com/pkuliyi2015/multidiffusion-upscaler-for-automatic1111.git" }, { "name": "sd-webui-lora-block-weight", "path": "/home/moon/softwares/stable-diffusion-webui/extensions/sd-webui-lora-block-weight", "version": "4d94d247", "branch": "main", "remote": "https://github.com/hako-mikan/sd-webui-lora-block-weight.git" }, { "name": "sd-webui-regional-prompter", "path": "/home/moon/softwares/stable-diffusion-webui/extensions/sd-webui-regional-prompter", "version": "4802faca", "branch": "main", "remote": "https://github.com/hako-mikan/sd-webui-regional-prompter.git" }, { "name": "sd-webui-supermerger", "path": "/home/moon/softwares/stable-diffusion-webui/extensions/sd-webui-supermerger", "version": "843ca282", "branch": "main", "remote": "https://github.com/hako-mikan/sd-webui-supermerger.git" }, { "name": "sd-webui-token-downsampling", "path": "/home/moon/softwares/stable-diffusion-webui/extensions/sd-webui-token-downsampling", "version": "f1f1cbae", "branch": "main", "remote": "https://github.com/feffy380/sd-webui-token-downsampling" }, { "name": "sd-webui-weight-helper", "path": "/home/moon/softwares/stable-diffusion-webui/extensions/sd-webui-weight-helper", "version": "ac4dea92", "branch": "main", "remote": "https://github.com/nihedon/sd-webui-weight-helper" }, { "name": "sdweb-easy-generate-forever", "path": "/home/moon/softwares/stable-diffusion-webui/extensions/sdweb-easy-generate-forever", "version": "2f507a03", "branch": "master", "remote": "https://github.com/blue-pen5805/sdweb-easy-generate-forever" }, { "name": "stable-diffusion-webui-dataset-tag-editor", "path": "/home/moon/softwares/stable-diffusion-webui/extensions/stable-diffusion-webui-dataset-tag-editor", "version": "74de5b7a", "branch": "main", "remote": "https://github.com/toshiaki1729/stable-diffusion-webui-dataset-tag-editor" }, { "name": "stable-diffusion-webui-localization-ja_JP", "path": "/home/moon/softwares/stable-diffusion-webui/extensions/stable-diffusion-webui-localization-ja_JP", "version": "d639f8ca", "branch": "main", "remote": "https://github.com/AI-Creators-Society/stable-diffusion-webui-localization-ja_JP" }, { "name": "stable-diffusion-webui-wd14-tagger", "path": "/home/moon/softwares/stable-diffusion-webui/extensions/stable-diffusion-webui-wd14-tagger", "version": "2d313188", "branch": "master", "remote": "https://github.com/Bocchi-Chan2023/stable-diffusion-webui-wd14-tagger" } ], "Inactive extensions": [], "Environment": { "COMMANDLINE_ARGS": "--medvram-sdxl\t--opt-sdp-attention", "GIT": "git", "GRADIO_ANALYTICS_ENABLED": "False", "TORCH_COMMAND": "pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/rocm5.7" }, "Config": { "ldsr_steps": 100, "ldsr_cached": false, "SCUNET_tile": 256, "SCUNET_tile_overlap": 8, "SWIN_tile": 192, "SWIN_tile_overlap": 8, "SWIN_torch_compile": false, "hypertile_enable_unet": false, "hypertile_enable_unet_secondpass": false, "hypertile_max_depth_unet": 3, "hypertile_max_tile_unet": 256, "hypertile_swap_size_unet": 3, "hypertile_enable_vae": true, "hypertile_max_depth_vae": 3, "hypertile_max_tile_vae": 128, "hypertile_swap_size_vae": 3, "sd_model_checkpoint": "ponyDiffusionV6XL_v6StartWithThisOne.safetensors [67ab2fd8ec]", "outdir_samples": "", "outdir_txt2img_samples": "outputs/txt2img-images", "outdir_img2img_samples": "outputs/img2img-images", "outdir_extras_samples": "outputs/extras-images", "outdir_grids": "", "outdir_txt2img_grids": "outputs/txt2img-grids", "outdir_img2img_grids": "outputs/img2img-grids", "outdir_save": "log/images", "outdir_init_images": "outputs/init-images", "samples_save": true, "samples_format": "webp", "samples_filename_pattern": "", "save_images_add_number": true, "save_images_replace_action": "Replace", "grid_save": true, "grid_format": "webp", "grid_extended_filename": false, "grid_only_if_multiple": true, "grid_prevent_empty_spots": false, "grid_zip_filename_pattern": "", "n_rows": -1, "font": "", "grid_text_active_color": "#000000", "grid_text_inactive_color": "#999999", "grid_background_color": "#ffffff", "save_images_before_face_restoration": false, "save_images_before_highres_fix": false, "save_images_before_color_correction": false, "save_mask": false, "save_mask_composite": false, "jpeg_quality": 100, "webp_lossless": false, "export_for_4chan": false, "img_downscale_threshold": 4.0, "target_side_length": 4000.0, "img_max_size_mp": 200.0, "use_original_name_batch": true, "use_upscaler_name_as_suffix": false, "save_selected_only": true, "save_init_img": false, "temp_dir": "", "clean_temp_dir_at_start": false, "save_incomplete_images": false, "notification_audio": true, "notification_volume": 100, "save_to_dirs": true, "grid_save_to_dirs": true, "use_save_to_dirs_for_ui": false, "directories_filename_pattern": "[date]", "directories_max_prompt_words": 8, "auto_backcompat": true, "use_old_emphasis_implementation": false, "use_old_karras_scheduler_sigmas": false, "no_dpmpp_sde_batch_determinism": false, "use_old_hires_fix_width_height": false, "dont_fix_second_order_samplers_schedule": false, "hires_fix_use_firstpass_conds": false, "use_old_scheduling": false, "use_downcasted_alpha_bar": false, "refiner_switch_by_sample_steps": false, "lora_functional": false, "extra_networks_show_hidden_directories": true, "extra_networks_dir_button_function": false, "extra_networks_hidden_models": "When searched", "extra_networks_default_multiplier": 1, "extra_networks_card_width": 0.0, "extra_networks_card_height": 0.0, "extra_networks_card_text_scale": 1, "extra_networks_card_show_desc": true, "extra_networks_card_description_is_html": false, "extra_networks_card_order_field": "Path", "extra_networks_card_order": "Ascending", "extra_networks_tree_view_style": "Dirs", "extra_networks_tree_view_default_enabled": true, "extra_networks_tree_view_default_width": 180.0, "extra_networks_add_text_separator": " ", "ui_extra_networks_tab_reorder": "", "textual_inversion_print_at_load": false, "textual_inversion_add_hashes_to_infotext": true, "sd_hypernetwork": "None", "sd_lora": "None", "lora_preferred_name": "Alias from file", "lora_add_hashes_to_infotext": true, "lora_bundled_ti_to_infotext": true, "lora_show_all": false, "lora_hide_unknown_for_versions": [], "lora_in_memory_limit": 0, "lora_not_found_warning_console": false, "lora_not_found_gradio_warning": false, "cross_attention_optimization": "sdp - scaled dot product", "s_min_uncond": 0, "s_min_uncond_all": false, "token_merging_ratio": 0, "token_merging_ratio_img2img": 0, "token_merging_ratio_hr": 0, "pad_cond_uncond": false, "pad_cond_uncond_v0": false, "persistent_cond_cache": true, "batch_cond_uncond": true, "fp8_storage": "Enable for SDXL", "cache_fp16_weight": true, "hide_samplers": [], "eta_ddim": 0, "eta_ancestral": 1, "ddim_discretize": "uniform", "s_churn": 0, "s_tmin": 0, "s_tmax": 0, "s_noise": 1, "sigma_min": 0.0, "sigma_max": 0.0, "rho": 0.0, "eta_noise_seed_delta": 0, "always_discard_next_to_last_sigma": false, "sgm_noise_multiplier": false, "uni_pc_variant": "bh1", "uni_pc_skip_type": "time_uniform", "uni_pc_order": 3, "uni_pc_lower_order_final": true, "sd_noise_schedule": "Default", "skip_early_cond": 0, "sd_checkpoints_limit": 1, "sd_checkpoints_keep_in_cpu": true, "sd_checkpoint_cache": 0, "sd_unet": "Automatic", "enable_quantization": false, "emphasis": "No norm", "enable_batch_seeds": true, "comma_padding_backtrack": 20, "CLIP_stop_at_last_layers": 2, "upcast_attn": false, "randn_source": "GPU", "tiling": false, "hires_fix_refiner_pass": "second pass", "enable_prompt_comments": true, "sdxl_crop_top": 0.0, "sdxl_crop_left": 0.0, "sdxl_refiner_low_aesthetic_score": 2.5, "sdxl_refiner_high_aesthetic_score": 6.0, "sd_vae_checkpoint_cache": 0, "sd_vae": "None", "sd_vae_overrides_per_model_preferences": true, "auto_vae_precision_bfloat16": true, "auto_vae_precision": false, "sd_vae_encode_method": "Full", "sd_vae_decode_method": "Full", "inpainting_mask_weight": 1, "initial_noise_multiplier": 1, "img2img_extra_noise": 0, "img2img_color_correction": false, "img2img_fix_steps": false, "img2img_background_color": "#ffffff", "img2img_editor_height": 720, "img2img_sketch_default_brush_color": "#ffffff", "img2img_inpaint_mask_brush_color": "#ffffff", "img2img_inpaint_sketch_default_brush_color": "#ffffff", "return_mask": false, "return_mask_composite": false, "img2img_batch_show_results_limit": 32, "overlay_inpaint": true, "return_grid": true, "do_not_show_images": false, "js_modal_lightbox": true, "js_modal_lightbox_initially_zoomed": true, "js_modal_lightbox_gamepad": false, "js_modal_lightbox_gamepad_repeat": 250.0, "sd_webui_modal_lightbox_icon_opacity": 1, "sd_webui_modal_lightbox_toolbar_opacity": 0.9, "gallery_height": "", "open_dir_button_choice": "Subdirectory", "enable_pnginfo": true, "save_txt": false, "add_model_name_to_info": true, "add_model_hash_to_info": true, "add_vae_name_to_info": true, "add_vae_hash_to_info": true, "add_user_name_to_info": false, "add_version_to_infotext": true, "disable_weights_auto_swap": true, "infotext_skip_pasting": [], "infotext_styles": "Apply if any", "show_progressbar": true, "live_previews_enable": true, "live_previews_image_format": "webp", "show_progress_grid": true, "show_progress_every_n_steps": 1, "show_progress_type": "Approx NN", "live_preview_allow_lowvram_full": false, "live_preview_content": "Prompt", "live_preview_refresh_period": 1000.0, "live_preview_fast_interrupt": false, "js_live_preview_in_modal_lightbox": false, "keyedit_precision_attention": 0.1, "keyedit_precision_extra": 0.05, "keyedit_delimiters": ".,\\/!?%^*;:{}=`~() ", "keyedit_delimiters_whitespace": [ "Tab", "Carriage Return", "Line Feed" ], "keyedit_move": true, "disable_token_counters": false, "include_styles_into_token_counters": true, "extra_options_txt2img": [], "extra_options_img2img": [], "extra_options_cols": 1, "extra_options_accordion": false, "compact_prompt_box": false, "samplers_in_dropdown": true, "dimensions_and_batch_together": true, "sd_checkpoint_dropdown_use_short": false, "hires_fix_show_sampler": false, "hires_fix_show_prompts": false, "txt2img_settings_accordion": false, "img2img_settings_accordion": false, "interrupt_after_current": true, "localization": "None", "quicksettings_list": [ "sd_model_checkpoint", "sd_vae", "CLIP_stop_at_last_layers", "face_restoration" ], "ui_tab_order": [], "hidden_tabs": [], "ui_reorder_list": [], "gradio_theme": "Default", "gradio_themes_cache": true, "show_progress_in_title": true, "send_seed": true, "send_size": true, "enable_reloading_ui_scripts": false, "api_enable_requests": true, "api_forbid_local_requests": true, "api_useragent": "", "prioritized_callbacks_app_started": [], "prioritized_callbacks_model_loaded": [], "prioritized_callbacks_ui_settings": [], "prioritized_callbacks_infotext_pasted": [], "prioritized_callbacks_script_unloaded": [], "prioritized_callbacks_before_ui": [], "prioritized_callbacks_list_optimizers": [], "prioritized_callbacks_before_token_counter": [], "prioritized_callbacks_script_before_process": [], "prioritized_callbacks_script_process": [], "prioritized_callbacks_script_post_sample": [], "prioritized_callbacks_script_on_mask_blend": [], "prioritized_callbacks_script_postprocess_maskoverlay": [], "auto_launch_browser": "Local", "enable_console_prompts": false, "show_warnings": false, "show_gradio_deprecation_warnings": true, "memmon_poll_rate": 8, "samples_log_stdout": false, "multiple_tqdm": true, "enable_upscale_progressbar": true, "print_hypernet_extra": false, "list_hidden_files": true, "disable_mmap_load_safetensors": false, "hide_ldm_prints": true, "dump_stacks_on_signal": false, "face_restoration": false, "face_restoration_model": "CodeFormer", "code_former_weight": 1, "face_restoration_unload": true, "postprocessing_enable_in_main_ui": [], "postprocessing_disable_in_extras": [], "postprocessing_operation_order": [], "upscaling_max_images_in_cache": 5, "postprocessing_existing_caption_action": "Ignore", "ESRGAN_tile": 192, "ESRGAN_tile_overlap": 8, "realesrgan_enabled_models": [ "R-ESRGAN 4x+", "R-ESRGAN 4x+ Anime6B" ], "dat_enabled_models": [ "DAT x2", "DAT x3", "DAT x4" ], "DAT_tile": 192, "DAT_tile_overlap": 8, "set_scale_by_when_changing_upscaler": false, "unload_models_when_training": true, "pin_memory": false, "save_optimizer_state": false, "save_training_settings_to_txt": true, "dataset_filename_word_regex": "", "dataset_filename_join_string": " ", "training_image_repeats_per_epoch": 1, "training_write_csv_every": 500.0, "training_xattention_optimizations": false, "training_enable_tensorboard": false, "training_tensorboard_save_images": false, "training_tensorboard_flush_every": 120.0, "canvas_hotkey_zoom": "Alt", "canvas_hotkey_adjust": "Ctrl", "canvas_hotkey_shrink_brush": "Q", "canvas_hotkey_grow_brush": "W", "canvas_hotkey_move": "F", "canvas_hotkey_fullscreen": "S", "canvas_hotkey_reset": "R", "canvas_hotkey_overlap": "O", "canvas_show_tooltip": true, "canvas_auto_expand": true, "canvas_blur_prompt": false, "canvas_disabled_functions": [ "Overlap" ], "interrogate_keep_models_in_memory": false, "interrogate_return_ranks": false, "interrogate_clip_num_beams": 1, "interrogate_clip_min_length": 24, "interrogate_clip_max_length": 48, "interrogate_clip_dict_limit": 1500.0, "interrogate_clip_skip_categories": [], "interrogate_deepbooru_score_threshold": 0.5, "deepbooru_sort_alpha": true, "deepbooru_use_spaces": true, "deepbooru_escape": true, "deepbooru_filter_tags": "", "sd_checkpoint_hash": "67ab2fd8ec439a89b3fedb15cc65f54336af163c7eb5e4f2acc98f090a29b0b3", "disabled_extensions": [], "disable_all_extensions": "none", "tac_tagFile": "e621.csv", "tac_active": true, "tac_activeIn.txt2img": true, "tac_activeIn.img2img": true, "tac_activeIn.negativePrompts": true, "tac_activeIn.thirdParty": true, "tac_activeIn.modelList": "", "tac_activeIn.modelListMode": "Blacklist", "tac_slidingPopup": true, "tac_maxResults": 8.0, "tac_showAllResults": false, "tac_resultStepLength": 100, "tac_delayTime": 100, "tac_useWildcards": true, "tac_sortWildcardResults": true, "tac_wildcardExclusionList": "", "tac_skipWildcardRefresh": false, "tac_useEmbeddings": true, "tac_includeEmbeddingsInNormalResults": false, "tac_useHypernetworks": true, "tac_useLoras": true, "tac_useLycos": true, "tac_useLoraPrefixForLycos": true, "tac_showWikiLinks": false, "tac_showExtraNetworkPreviews": true, "tac_modelSortOrder": "Name", "tac_useStyleVars": false, "tac_frequencySort": true, "tac_frequencyFunction": "Logarithmic (weak)", "tac_frequencyMinCount": 3, "tac_frequencyMaxAge": 30, "tac_frequencyRecommendCap": 10, "tac_frequencyIncludeAlias": false, "tac_replaceUnderscores": true, "tac_escapeParentheses": true, "tac_appendComma": true, "tac_appendSpace": true, "tac_alwaysSpaceAtEnd": true, "tac_modelKeywordCompletion": "Never", "tac_modelKeywordLocation": "Start of prompt", "tac_wildcardCompletionMode": "To next folder level", "tac_alias.searchByAlias": true, "tac_alias.onlyShowAlias": false, "tac_translation.translationFile": "None", "tac_translation.oldFormat": false, "tac_translation.searchByTranslation": true, "tac_translation.liveTranslation": false, "tac_extra.extraFile": "extra-pony.csv", "tac_extra.addMode": "Insert before", "tac_chantFile": "recommendation-chant.json", "tac_keymap": "{\n \"MoveUp\": \"ArrowUp\",\n \"MoveDown\": \"ArrowDown\",\n \"JumpUp\": \"PageUp\",\n \"JumpDown\": \"PageDown\",\n \"JumpToStart\": \"Home\",\n \"JumpToEnd\": \"End\",\n \"ChooseSelected\": \"Enter\",\n \"ChooseFirstOrSelected\": \"Tab\",\n \"Close\": \"Escape\"\n}", "tac_colormap": "{\n \"danbooru\": {\n \"-1\": [\"red\", \"maroon\"],\n \"0\": [\"lightblue\", \"dodgerblue\"],\n \"1\": [\"indianred\", \"firebrick\"],\n \"3\": [\"violet\", \"darkorchid\"],\n \"4\": [\"lightgreen\", \"darkgreen\"],\n \"5\": [\"orange\", \"darkorange\"]\n },\n \"e621\": {\n \"-1\": [\"red\", \"maroon\"],\n \"0\": [\"lightblue\", \"dodgerblue\"],\n \"1\": [\"gold\", \"goldenrod\"],\n \"3\": [\"violet\", \"darkorchid\"],\n \"4\": [\"lightgreen\", \"darkgreen\"],\n \"5\": [\"tomato\", \"darksalmon\"],\n \"6\": [\"red\", \"maroon\"],\n \"7\": [\"whitesmoke\", \"black\"],\n \"8\": [\"seagreen\", \"darkseagreen\"]\n },\n \"derpibooru\": {\n \"-1\": [\"red\", \"maroon\"],\n \"0\": [\"#60d160\", \"#3d9d3d\"],\n \"1\": [\"#fff956\", \"#918e2e\"],\n \"3\": [\"#fd9961\", \"#a14c2e\"],\n \"4\": [\"#cf5bbe\", \"#6c1e6c\"],\n \"5\": [\"#3c8ad9\", \"#1e5e93\"],\n \"6\": [\"#a6a6a6\", \"#555555\"],\n \"7\": [\"#47abc1\", \"#1f6c7c\"],\n \"8\": [\"#7871d0\", \"#392f7d\"],\n \"9\": [\"#df3647\", \"#8e1c2b\"],\n \"10\": [\"#c98f2b\", \"#7b470e\"],\n \"11\": [\"#e87ebe\", \"#a83583\"]\n }\n}", "tac_refreshTempFiles": "Refresh TAC temp files", "bilingual_localization_enabled": true, "bilingual_localization_logger": false, "bilingual_localization_file": "ja_JP", "bilingual_localization_order": "Translation First", "bilingual_localization_dirs": "{\"ja_JP\": \"extensions/stable-diffusion-webui-localization-ja_JP/localizations/ja_JP.json\", \"ks_JP\": \"extensions/stable-diffusion-webui-localization-ja_JP/localizations/ks_JP.json\"}", "tagger_out_filename_fmt": "[name].[output_extension]", "tagger_count_threshold": 100.0, "tagger_batch_recursive": true, "tagger_auto_serde_json": true, "tagger_store_images": false, "tagger_weighted_tags_files": false, "tagger_verbose": false, "tagger_repl_us": true, "tagger_repl_us_excl": "0_0, (o)_(o), +_+, +_-, ._., _, <|>_<|>, =_=, >_<, 3_3, 6_9, >_o, @_@, ^_^, o_o, u_u, x_x, |_|, ||_||", "tagger_escape": false, "tagger_batch_size": 1024, "tagger_hf_cache_dir": "/home/moon/softwares/stable-diffusion-webui/models/interrogators", "prioritized_callbacks_ui_tabs": [], "token_downsampling_factor": 1, "token_downsampling_factor2": 1.0, "token_downsampling_disable_after": 1, "prioritized_callbacks_script_process_batch": [], "deepcache_enable_pass": "disable", "deepcache_cache_resnet_level": 2, "deepcache_cache_enable_step_percentage": 0.3, "deepcache_full_run_step_rate": 3, "deepcache_hr_reuse": false, "deepcache_cache_enable_step_percentage_hr": 0.0, "prioritized_callbacks_script_postprocess_batch": [], "prioritized_callbacks_script_before_process_batch": [], "prioritized_callbacks_script_postprocess": [], "prioritized_callbacks_script_postprocess_batch_list": [], "regprp_debug": false, "regprp_hidepmask": false, "prioritized_callbacks_script_after_extra_networks_activate": [], "prioritized_callbacks_script_after_component": [], "weight_helper_enabled": true, "weight_helper_context_menu_scale": 0.8, "weight_helper_using_execCommand": false, "weight_helper_te_min": 0.0, "weight_helper_te_max": 1.0, "weight_helper_te_step": 0.05, "weight_helper_unet_min": 0.0, "weight_helper_unet_max": 1.0, "weight_helper_unet_step": 0.05, "weight_helper_dyn_min": 0.0, "weight_helper_dyn_max": 128.0, "weight_helper_dyn_step": 8.0, "weight_helper_lbw_min": 0.0, "weight_helper_lbw_max": 1.0, "weight_helper_lbw_step": 0.05, "weight_helper_show_preview": true, "weight_helper_preview_max_height": 300.0, "weight_helper_preview_position": "Top Right", "weight_helper_lbw_lora__block_points": "BASE, IN01-IN04, IN05-IN08, MID, OUT03-OUT06, OUT07-OUT11", "weight_helper_lbw_lora_sdxl_block_points": "BASE, IN04-IN08, MID, OUT00-OUT05", "weight_helper_lbw_lora_all_block_points": "BASE, IN00-IN05, IN06-IN11, MID, OUT00-OUT05, OUT06-OUT11", "weight_helper_lbw_lyco__block_points": "BASE, IN00-IN05, IN06-IN11, MID, OUT00-OUT05, OUT06-OUT11", "weight_helper_lbw_lyco_sdxl_block_points": "BASE, IN00-IN03, IN04-IN08, MID, OUT00-OUT03, OUT04-OUT08", "weight_helper_lbw_lyco_all_block_points": "BASE, IN00-IN05, IN06-IN11, MID, OUT00-OUT05, OUT06-OUT11", "ad_max_models": 4, "ad_extra_models_dir": "", "ad_save_previews": false, "ad_save_images_before": false, "ad_only_seleted_scripts": true, "ad_script_names": "dynamic_prompting,dynamic_thresholding,lora_block_weight,negpip,wildcard_recursive,wildcards", "ad_bbox_sortby": "None", "ad_same_seed_for_each_tap": false, "prioritized_callbacks_after_component": [], "prioritized_callbacks_script_postprocess_image": [], "dataset_editor_image_columns": 6, "dataset_editor_max_res": 0, "dataset_editor_use_temp_files": false, "dataset_editor_use_raw_clip_token": true, "dataset_editor_use_rating": false, "dataset_editor_num_cpu_workers": -1, "dataset_editor_batch_size_vit": 4, "dataset_editor_batch_size_convnext": 4, "dataset_editor_batch_size_swinv2": 4, "profiling_enable": false, "profiling_activities": [ "CPU" ], "profiling_record_shapes": true, "profiling_profile_memory": true, "profiling_with_stack": true, "profiling_filename": "trace.json" }, "Startup": { "total": 12.568988561630249, "records": { "initial startup": 0.005706071853637695, "prepare environment/checks": 5.91278076171875e-05, "prepare environment/git version info": 0.014247894287109375, "prepare environment/torch GPU test": 1.3537890911102295, "prepare environment/clone repositores": 0.029145479202270508, "prepare environment/run extensions installers/sd-webui-supermerger": 0.05754828453063965, "prepare environment/run extensions installers/sd-webui-regional-prompter": 4.267692565917969e-05, "prepare environment/run extensions installers/sd-webui-lora-block-weight": 1.239776611328125e-05, "prepare environment/run extensions installers/sdweb-easy-generate-forever": 1.0013580322265625e-05, "prepare environment/run extensions installers/multidiffusion-upscaler-for-automatic1111": 8.821487426757812e-06, "prepare environment/run extensions installers/sd-webui-token-downsampling": 1.33514404296875e-05, "prepare environment/run extensions installers/stable-diffusion-webui-dataset-tag-editor": 1.049041748046875e-05, "prepare environment/run extensions installers/adetailer": 0.06266927719116211, "prepare environment/run extensions installers/sd-webui-weight-helper": 4.506111145019531e-05, "prepare environment/run extensions installers/stable-diffusion-webui-wd14-tagger": 1.9945104122161865, "prepare environment/run extensions installers/stable-diffusion-webui-localization-ja_JP": 4.744529724121094e-05, "prepare environment/run extensions installers/a1111-sd-webui-tagcomplete": 1.5735626220703125e-05, "prepare environment/run extensions installers": 2.1149370670318604, "prepare environment": 3.5287821292877197, "launcher": 0.0005898475646972656, "import torch": 2.190972328186035, "import gradio": 0.44154787063598633, "setup paths": 3.340559482574463, "import ldm": 0.0019118785858154297, "import sgm": 4.5299530029296875e-06, "initialize shared": 0.04144597053527832, "other imports": 0.2884387969970703, "opts onchange": 0.00028324127197265625, "setup SD model": 4.291534423828125e-05, "setup codeformer": 0.0003578662872314453, "setup gfpgan": 0.0032501220703125, "set samplers": 2.6941299438476562e-05, "list extensions": 0.0012054443359375, "restore config state file": 8.821487426757812e-06, "list SD models": 0.006943702697753906, "list localizations": 0.0004172325134277344, "load scripts/custom_code.py": 0.0029151439666748047, "load scripts/img2imgalt.py": 0.0002143383026123047, "load scripts/loopback.py": 0.00010514259338378906, "load scripts/outpainting_mk_2.py": 0.00013327598571777344, "load scripts/poor_mans_outpainting.py": 8.96453857421875e-05, "load scripts/postprocessing_codeformer.py": 7.271766662597656e-05, "load scripts/postprocessing_gfpgan.py": 6.651878356933594e-05, "load scripts/postprocessing_upscale.py": 0.00012755393981933594, "load scripts/prompt_matrix.py": 9.298324584960938e-05, "load scripts/prompts_from_file.py": 0.00010061264038085938, "load scripts/sd_upscale.py": 8.249282836914062e-05, "load scripts/xyz_grid.py": 0.0011439323425292969, "load scripts/ldsr_model.py": 0.07891464233398438, "load scripts/lora_script.py": 0.13921499252319336, "load scripts/scunet_model.py": 0.020038127899169922, "load scripts/swinir_model.py": 0.018907546997070312, "load scripts/hotkey_config.py": 0.0001437664031982422, "load scripts/extra_options_section.py": 0.00013756752014160156, "load scripts/hypertile_script.py": 0.03507566452026367, "load scripts/postprocessing_autosized_crop.py": 0.000152587890625, "load scripts/postprocessing_caption.py": 8.678436279296875e-05, "load scripts/postprocessing_create_flipped_copies.py": 7.915496826171875e-05, "load scripts/postprocessing_focal_crop.py": 0.0004649162292480469, "load scripts/postprocessing_split_oversized.py": 8.296966552734375e-05, "load scripts/soft_inpainting.py": 0.00018167495727539062, "load scripts/model_keyword_support.py": 0.0006618499755859375, "load scripts/shared_paths.py": 0.00020694732666015625, "load scripts/tag_autocomplete_helper.py": 0.056221723556518555, "load scripts/tag_frequency_db.py": 0.0001366138458251953, "load scripts/!adetailer.py": 0.6588485240936279, "load scripts/tilediffusion.py": 0.0023407936096191406, "load scripts/tileglobal.py": 0.0004718303680419922, "load scripts/tilevae.py": 0.0003647804260253906, "load scripts/lora_block_weight.py": 0.0016551017761230469, "load scripts/attention.py": 0.0001609325408935547, "load scripts/latent.py": 0.0008730888366699219, "load scripts/regions.py": 0.00016021728515625, "load scripts/rp.py": 0.024626493453979492, "load scripts/rps.py": 0.004280805587768555, "load scripts/GenParamGetter.py": 0.26728248596191406, "load scripts/supermerger.py": 0.022200822830200195, "load scripts/token_downsampling.py": 0.03579068183898926, "load scripts/weight_helper.py": 0.034337520599365234, "load scripts/config.py": 0.007992029190063477, "load scripts/dte_instance.py": 6.818771362304688e-05, "load scripts/logger.py": 5.5789947509765625e-05, "load scripts/main.py": 0.04993891716003418, "load scripts/model_loader.py": 0.00011134147644042969, "load scripts/paths.py": 0.00011873245239257812, "load scripts/singleton.py": 6.461143493652344e-05, "load scripts/tagger.py": 0.11414980888366699, "load scripts/bilingual_localization_helper.py": 0.018930435180664062, "load scripts/comments.py": 0.01816415786743164, "load scripts/refiner.py": 0.0001316070556640625, "load scripts/sampler.py": 8.893013000488281e-05, "load scripts/seed.py": 0.00011491775512695312, "load scripts": 1.6192080974578857, "load upscalers": 0.0008976459503173828, "refresh VAE": 0.0006229877471923828, "refresh textual inversion templates": 0.0005555152893066406, "scripts list_optimizers": 0.0002472400665283203, "scripts list_unets": 2.3126602172851562e-05, "reload hypernetworks": 0.00021338462829589844, "initialize extra networks": 0.006959199905395508, "scripts before_ui_callback": 0.0005557537078857422, "create ui": 0.9163694381713867, "gradio launch": 0.12807941436767578, "add APIs": 0.004387855529785156, "app_started_callback/lora_script.py": 0.00021266937255859375, "app_started_callback/tag_autocomplete_helper.py": 0.002926349639892578, "app_started_callback/!adetailer.py": 0.00029397010803222656, "app_started_callback/GenParamGetter.py": 0.049367666244506836, "app_started_callback/weight_helper.py": 0.0002930164337158203, "app_started_callback/tagger.py": 0.0018825531005859375, "app_started_callback": 0.054982662200927734 } }, "Packages": [ "absl-py==2.1.0", "accelerate==0.21.0", "aenum==3.1.15", "aiofiles==23.2.1", "aiohttp==3.9.5", "aiosignal==1.3.1", "altair==5.3.0", "antlr4-python3-runtime==4.9.3", "anyio==3.7.1", "astunparse==1.6.3", "async-timeout==4.0.3", "attrs==23.2.0", "blendmodes==2022", "certifi==2024.6.2", "cffi==1.16.0", "charset-normalizer==3.3.2", "clean-fid==0.1.35", "click==8.1.7", "clip==1.0", "coloredlogs==15.0.1", "contourpy==1.2.1", "cycler==0.12.1", "deepdanbooru==1.0.2", "deprecation==2.1.0", "diffusers==0.28.2", "diskcache==5.6.3", "einops==0.4.1", "exceptiongroup==1.2.1", "facexlib==0.3.0", "fastapi==0.94.0", "ffmpy==0.3.2", "filelock==3.13.1", "filterpy==1.4.5", "flatbuffers==24.3.25", "fonttools==4.53.0", "frozenlist==1.4.1", "fsspec==2024.2.0", "ftfy==6.2.0", "gast==0.5.4", "gitdb==4.0.11", "gitpython==3.1.32", "google-pasta==0.2.0", "gradio-client==0.5.0", "gradio==3.41.2", "grpcio==1.64.1", "h11==0.12.0", "h5py==3.11.0", "httpcore==0.15.0", "httpx==0.24.1", "huggingface-hub==0.23.3", "humanfriendly==10.0", "idna==3.7", "imageio==2.34.1", "importlib-metadata==7.1.0", "importlib-resources==6.4.0", "inflection==0.5.1", "jax==0.4.28", "jaxlib==0.4.28", "jinja2==3.1.3", "joblib==1.4.2", "jsonmerge==1.8.0", "jsonschema-specifications==2023.12.1", "jsonschema==4.22.0", "keras==3.3.3", "kiwisolver==1.4.5", "kornia==0.6.7", "lark==1.1.2", "lazy-loader==0.4", "libclang==18.1.1", "lightning-utilities==0.11.2", "llvmlite==0.42.0", "markdown-it-py==3.0.0", "markdown==3.6", "markupsafe==2.1.5", "matplotlib==3.9.0", "mdurl==0.1.2", "mediapipe==0.10.14", "ml-dtypes==0.3.2", "mpmath==1.2.1", "multidict==6.0.5", "namex==0.0.8", "networkx==3.2.1", "numba==0.59.1", "numpy==1.26.2", "omegaconf==2.2.3", "onnxruntime==1.18.0", "open-clip-torch==2.20.0", "opencv-contrib-python==4.10.0.82", "opencv-python-headless==4.10.0.82", "opencv-python==4.10.0.82", "opt-einsum==3.3.0", "optree==0.11.0", "orjson==3.10.3", "packaging==24.0", "pandas==2.2.2", "piexif==1.1.3", "pillow-avif-plugin==1.4.3", "pillow==9.5.0", "pip==24.0", "platformdirs==4.2.2", "pooch==1.8.2", "protobuf==4.25.3", "psutil==5.9.5", "py-cpuinfo==9.0.0", "pycparser==2.22", "pydantic==1.10.15", "pydub==0.25.1", "pygments==2.18.0", "pymatting==1.1.12", "pyparsing==3.1.2", "python-dateutil==2.9.0.post0", "python-multipart==0.0.9", "pytorch-lightning==1.9.4", "pytorch-triton-rocm==3.0.0+bbe6246e37", "pytz==2024.1", "pywavelets==1.6.0", "pyyaml==6.0.1", "referencing==0.35.1", "regex==2024.5.15", "rembg==2.0.50", "requests==2.32.3", "resize-right==0.0.2", "rich==13.7.1", "rpds-py==0.18.1", "safetensors==0.4.2", "scikit-image==0.21.0", "scikit-learn==1.5.0", "scipy==1.13.1", "seaborn==0.13.2", "semantic-version==2.10.0", "sentencepiece==0.2.0", "setuptools==69.5.1", "six==1.16.0", "smmap==5.0.1", "sniffio==1.3.1", "sounddevice==0.4.7", "spandrel==0.1.6", "starlette==0.26.1", "sympy==1.12", "tensorboard-data-server==0.7.2", "tensorboard==2.16.2", "tensorflow-io-gcs-filesystem==0.37.0", "tensorflow==2.16.1", "termcolor==2.4.0", "threadpoolctl==3.5.0", "tifffile==2024.5.22", "timm==1.0.3", "tokenizers==0.13.3", "tomesd==0.1.3", "toolz==0.12.1", "torch==2.4.0.dev20240607+rocm6.1", "torchaudio==2.4.0.dev20240608+rocm6.1", "torchdiffeq==0.2.3", "torchmetrics==1.4.0.post0", "torchsde==0.2.6", "torchvision==0.19.0.dev20240608+rocm6.1", "tqdm==4.66.4", "trampoline==0.1.2", "transformers==4.30.2", "typing-extensions==4.8.0", "tzdata==2024.1", "ultralytics-thop==0.2.7", "ultralytics==8.2.29", "urllib3==2.2.1", "uvicorn==0.30.1", "wcwidth==0.2.13", "websockets==11.0.3", "werkzeug==3.0.3", "wheel==0.43.0", "wrapt==1.16.0", "yarl==1.9.4", "zipp==3.19.2" ] } ```

Console logs

Console logs

```Shell ################################################################ Launching launch.py... ################################################################ Python 3.10.12 (main, Nov 20 2023, 15:14:05) [GCC 11.4.0] Version: v1.9.4-160-ge33bb8fe Commit hash: e33bb8febeec70f11c630d9d4df3d73bd8c30330 loading WD14-tagger reqs from /home/moon/softwares/stable-diffusion-webui/extensions/stable-diffusion-webui-wd14-tagger/requirements.txt Checking WD14-tagger requirements. Launching Web UI with arguments: --medvram-sdxl --opt-sdp-attention 2024-06-11 11:33:24.694685: I external/local_tsl/tsl/cuda/cudart_stub.cc:32] Could not find cuda drivers on your machine, GPU will not be used. 2024-06-11 11:33:24.696844: I external/local_tsl/tsl/cuda/cudart_stub.cc:32] Could not find cuda drivers on your machine, GPU will not be used. 2024-06-11 11:33:24.719289: I tensorflow/core/platform/cpu_feature_guard.cc:210] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations. To enable the following instructions: AVX2 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags. 2024-06-11 11:33:25.285292: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT no module 'xformers'. Processing without... no module 'xformers'. Processing without... No module 'xformers'. Proceeding without it. Tag Autocomplete: Could not locate model-keyword extension, Lora trigger word completion will be limited to those added through the extra networks menu. [-] ADetailer initialized. version: 24.5.1, num models: 10 /home/moon/softwares/stable-diffusion-webui/venv/lib/python3.10/site-packages/diffusers/models/transformers/transformer_2d.py:34: FutureWarning: `Transformer2DModelOutput` is deprecated and will be removed in version 1.0.0. Importing `Transformer2DModelOutput` from `diffusers.models.transformer_2d` is deprecated and this will be removed in a future version. Please use `from diffusers.models.modeling_outputs import Transformer2DModelOutput`, instead. deprecate("Transformer2DModelOutput", "1.0.0", deprecation_message) dirname: /home/moon/softwares/stable-diffusion-webui/localizations localizations: {'ja_JP': '/home/moon/softwares/stable-diffusion-webui/extensions/stable-diffusion-webui-localization-ja_JP/localizations/ja_JP.json', 'ks_JP': '/home/moon/softwares/stable-diffusion-webui/extensions/stable-diffusion-webui-localization-ja_JP/localizations/ks_JP.json'} == WD14 tagger /gpu:0, uname_result(system='Linux', node='moon-desktop', release='6.8.11-1-liquorix-amd64', version='#1 ZEN SMP PREEMPT liquorix 6.8-17ubuntu1~jammy (2024-05-27)', machine='x86_64') == Loading weights [67ab2fd8ec] from /home/moon/softwares/stable-diffusion-webui/models/Stable-diffusion/ponyDiffusionV6XL_v6StartWithThisOne.safetensors [tag-editor] Settings has been read from config.json Creating model from config: /home/moon/softwares/stable-diffusion-webui/repositories/generative-models/configs/inference/sd_xl_base.yaml [tag-editor] Custom taggers loaded: ['wd aesthetic classifier', 'Improved Aesthetic Predictor', 'aesthetic shadow', 'cafeai aesthetic classifier'] /home/moon/softwares/stable-diffusion-webui/venv/lib/python3.10/site-packages/huggingface_hub/file_download.py:1132: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`. warnings.warn( Running on local URL: http://127.0.0.1:7860 To create a public link, set `share=True` in `launch()`. Startup time: 12.6s (prepare environment: 3.5s, import torch: 2.2s, import gradio: 0.4s, setup paths: 3.3s, other imports: 0.3s, load scripts: 1.6s, create ui: 0.9s, gradio launch: 0.1s). Applying attention optimization: sdp... done. Model loaded in 8.3s (load weights from disk: 0.5s, create model: 0.8s, apply weights to model: 2.8s, apply fp8: 3.6s, calculate empty prompt: 0.6s). 40%|████████████████████████████████████████████████████▍ | 12/30 [00:28<00:33, 1.87s/it]kf.service.services: KApplicationTrader: mimeType "x-scheme-handler/file" not found | 12/30 [00:20<00:32, 1.81s/it] kf.service.services: KApplicationTrader: mimeType "x-scheme-handler/file" not found 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 30/30 [01:01<00:00, 2.05s/it] [Tiled VAE]: the input size is tiny and unnecessary to tile.████████████████████████████████████████████████████████████████████████████| 30/30 [00:53<00:00, 1.83s/it] Total progress: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 30/30 [00:55<00:00, 1.85s/it] Total progress: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 30/30 [00:55<00:00, 1.83s/it] ```

Additional information

No response

w-e-w commented 4 weeks ago

I cannot reproduce the issue

my test using xyz to generate 10 images lora using prompt s/r: Lora A + Lora B, Lora B + Lora A, Lora A, Lora B, blank (no lora) FP8: disable, enable

xyz output

![20240611-221455-283223 3046668518 93e9](https://github.com/AUTOMATIC1111/stable-diffusion-webui/assets/40751091/29b57f88-8661-4f92-a46d-4bc0674d15ca)

Bocchi-Chan2023 commented 4 weeks ago

I cannot reproduce the issue

my test using xyz to generate 10 images lora using prompt s/r: Lora A + Lora B, Lora B + Lora A, Lora A, Lora B, blank (no lora) FP8: disable, enable

  • since the order of lora dosen't matter, so Lora A + Lora B, Lora B + Lora A should produce the same image
  • comparing blank with the two single lora example are diffrent so we can see the lora is working
  • we can see the behavior is consistent with or without FP8

Are you on Dev branch? anyway I'll upload images to explain how "no longer applicable"

w-e-w commented 4 weeks ago

Are you on Dev branch?

yes of course

the use of the term "no longer applicable" is very strange I think you're trying to say "no longer applied"


I eddited your post and reply to save space

I remember we did wrote in our instructions to "upload" this is sysinfo as opposed to post it in plain text

Bocchi-Chan2023 commented 4 weeks ago

yeah that's correct! sorry, my english is too bad ;(

Bocchi-Chan2023 commented 4 weeks ago

prompt: score 9, score 8 up, score 7 up, source anime BREAK 1girl, inarione(umamusume), handy_fan negative: monochrome, greyscale, 3d, realistic, source pony, source furry, source cartoon, base model: ponyxl v6 seed:2476755399 DPM++ 3M SDE Karras / 20steps CFG 7 used loras: https://we.tl/t-tMGd8AMWi3

My results are these. (Sorry for the simplicity. I will provide more information later) 338597800-29b57f88-8661-4f92-a46d-4bc0674d15ca

Bocchi-Chan2023 commented 4 weeks ago

The test above is with cache fp16 enabled. Even when disabled, the two LoRAs do not seem to be applied simultaneously. (I will post a comparison image later.)

Bocchi-Chan2023 commented 4 weeks ago

I'm sorry! I forgot an important piece of information! As shown below, FP8 appears to break several LoRAs. I have just looked into the details and found that a similar issue was published in January of this year. https://github.com/AUTOMATIC1111/stable-diffusion-webui/issues/14777

score 9, score 8 up, score 7 up, source anime BREAK 1girl, inari_one_(umamusume), handy_fan
<lora:Inari_one_pony_v3:1>
<lora:pony_handy_fan_r:1>
Negative prompt: monochrome, greyscale, 3d, realistic, source pony, source furry, source cartoon,
Steps: 20, Sampler: DPM++ 3M SDE, Schedule type: Karras, CFG scale: 7, Seed: 2476755399, Size: 1024x1024, Model hash: 67ab2fd8ec, Model: ponyDiffusionV6XL_v6StartWithThisOne, FP8 weight: Enable, Cache FP16 weight for LoRA: True, Clip skip: 2, Hypertile VAE: True, Lora hashes: "Inari_one_pony_v3: 7c1e0c59bfe8, pony_handy_fan_r: 124e98b4a464", Emphasis: No norm, Version: v1.9.4-160-ge33bb8fe

Networks with errors: Inari_one_pony_v3 (32), pony_handy_fan_r (32)
w-e-w commented 4 weeks ago

FP8 is going to change the results, that is to be expected

since your claim is "only the last lora is applyed" you have to show show that there is meaningful* difference between the results of lora A + lora B and lora B + lora A otherwise your demonstration is meaningless

make the full demo as like what I did above

meaningful*: I suspect due to precision / rounding / optimization, the results may not be pixel perfect when the apply order changed, but the results should be fairly similar if there is not a meaningful difference after the apply order is changed then the issue (if exists) is not "only the last lora is applyed"

in my demo xyz

whether or not that FP8 breaks certain lora it's not in consideration at the moment as the issue we are trying to settle here is "only the last lora is applyed"


if the issues of "only the last lora is applyed" exist, then you should see that

if FP8 breaks some lora (break as in no effect) then you should see that


the we transfer stuff don't work

Bocchi-Chan2023 commented 4 weeks ago

I understand. I will create a detailed demo when I have time. I just confirmed that the same image is output when only pony_handy_fan_r is applied and when both ( ) are applied at the same time

w-e-w commented 3 weeks ago

upload the 2 loras lora:Inari_one_pony_v3 lora:pony_handy_fan_r see if you can compress them in zip file and upload it hear if it's too large then use some other method if you got them from the website like civilai or huggingface then post the links

Bocchi-Chan2023 commented 3 weeks ago

ok, is this fine? https://www.mediafire.com/file/0e4knd012wv7xg0/Lora.zip/file

w-e-w commented 3 weeks ago

still seems to work fine........ I am still not getting

Networks with errors: Inari_one_pony_v3 (32), pony_handy_fan_r (32)

are you sure that the same issue exist across AMD ROCm and NVIDIA

fp8 lora xyz

![20240612-235844-478163 2476755399 b618](https://github.com/AUTOMATIC1111/stable-diffusion-webui/assets/40751091/3d987513-4d84-4386-adc6-374f68d9ae11)

I'm asking others to have a look

Bocchi-Chan2023 commented 3 weeks ago

Yes, I have confirmed that it is reproducible on nvidia as well. But yes, it is. I may have a problem with the model of GPU I have, I will buy a new nvidia GPU this month and try it. (Now tested on RX6600, RTX3060)

w-e-w commented 3 weeks ago

good / bad news I got a reply from KohakuBlueleaf (who implemented the whole FP8 stuff) and apparently this is a known issue

good news because it's a know issue bad news because theres not fix eta

bigmover commented 3 weeks ago

I cannot reproduce the issue

my test using xyz to generate 10 images lora using prompt s/r: Lora A + Lora B, Lora B + Lora A, Lora A, Lora B, blank (no lora) FP8: disable, enable

  • since the order of lora dosen't matter, so Lora A + Lora B, Lora B + Lora A should produce the same image
  • comparing blank with the two single lora example are diffrent so we can see the lora is working
  • we can see the behavior is consistent with or without FP8

xyz output

Fp8 is enabled? How can I use the feature?