AUTOMATIC1111 / stable-diffusion-webui

Stable Diffusion web UI
GNU Affero General Public License v3.0
139.45k stars 26.44k forks source link

[Bug]: InPaint API returns different results than WebUI (it's not the settings, seed is ignored) #13109

Closed meticulous22 closed 10 months ago

meticulous22 commented 1 year ago

Is there an existing issue for this?

What happened?

Maybe there is something in the way I set it up or in the settings that I'm missing, but before assuming it was the settings, please note how I verified it's not:

  1. Took the image generated by the API and put that into 'PNG Info' in WebUI.
  2. Hit 'Send to inpaint' (in my case I'm using inpaint upload).
  3. Add the exact same image and mask that the API used for inpainting.
  4. Hit 'Generate'.

Using the actual settings from the API produces different results in the WebUI, which, if it was the settings, would not. In fact, using the settings from the "incorrect" API image, produces the same "correct" image that I got without using the API in the first place. So in short, the settings are the same.

I also made sure that the correct model was set by the API. If I'm just doing something wrong, or there are some hidden settings that need to be set (that aren't shown in PNG Info metadata), or anyone has ideas, please let me know, I'd love to be proven wrong!

Initial face: sd11

"Incorrect" Face generated by via the API: sd2

"Correct" Face generated by the WebUI: sd3

UPDATE

It appears that the seed is not being respected:

  1. In API, I set the seed to -1
  2. Ran the generation 4 separate times

This produced 4 images all with different seeds (at least according to 'PNG Info'), however all 4 images are identical. So I'm guessing the seed is just being ignored?

END UPDATE

Steps to reproduce the problem

  1. Create a mask white circle on a black background.
  2. Use API to inpaint a face (in my case I was inpainting 3 faces, so I had 3 white circles).
  3. Use the same settings on WebUI, compare results.

What should have happened?

The results should have been the same.

Sysinfo

{ "Platform": "Windows-10-10.0.19045-SP0", "Python": "3.10.6", "Version": "v1.5.1", "Commit": "68f336bd994bed5442ad95bad6b6ad5564a5409a", "Commandline": [ "launch.py", "--xformers", "--api" ], "Torch env info": { "torch_version": "2.0.1+cu118", "is_debug_build": "False", "cuda_compiled_version": "11.8", "gcc_version": null, "clang_version": null, "cmake_version": "version 3.26.4", "os": "Microsoft Windows 10 Pro", "libc_version": "N/A", "python_version": "3.10.6 (tags/v3.10.6:9c7b4bd, Aug 1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)] (64-bit runtime)", "python_platform": "Windows-10-10.0.19045-SP0", "is_cuda_available": "True", "cuda_runtime_version": "11.8.89\r", "cuda_module_loading": "LAZY", "nvidia_driver_version": "536.67", "cudnn_version": null, "pip_version": "pip3", "pip_packages": [ "lion-pytorch==0.1.2", "numpy==1.23.5", "open-clip-torch==2.20.0", "pytorch-lightning==1.9.4", "torch==2.0.1+cu118", "torchdiffeq==0.2.3", "torchmetrics==1.0.2", "torchsde==0.2.5", "torchvision==0.15.2+cu118" ], "conda_packages": null, "hip_compiled_version": "N/A", "hip_runtime_version": "N/A", "miopen_runtime_version": "N/A", "caching_allocator_config": "", "is_xnnpack_available": "True", }, "Exceptions": [ { "exception": "A tensor with all NaNs was produced in VAE. This could be because there's not enough precision to represent the picture. Try adding --no-half-vae commandline argument to fix this. Use --disable-nan-check commandline argument to disable this check.", "traceback": [ [ "D:\Development\stable-diffusion-webui\modules\processing.py, line 549, decode_latent_batch", "devices.test_for_nans(sample, \"vae\")" ], [ "D:\Development\stable-diffusion-webui\modules\devices.py, line 155, test_for_nans", "raise NansException(message)" ] ] } ], "Extensions": [ { "name": "adetailer", "path": "D:\Development\stable-diffusion-webui\extensions\adetailer", "version": "451b0985", "branch": "main", "remote": "https://github.com/Bing-su/adetailer.git" }, { "name": "deforum", "path": "D:\Development\stable-diffusion-webui\extensions\deforum", "version": "eb16c856", "branch": "automatic1111-webui", "remote": "https://github.com/deforum-art/sd-webui-deforum" }, { "name": "sd-webui-controlnet", "path": "D:\Development\stable-diffusion-webui\extensions\sd-webui-controlnet", "version": "664ac74c", "branch": "main", "remote": "https://github.com/Mikubill/sd-webui-controlnet.git" }, { "name": "stable-diffusion-webui-depthmap-script", "path": "D:\Development\stable-diffusion-webui\extensions\stable-diffusion-webui-depthmap-script", "version": "00d878f4", "branch": "main", "remote": "https://github.com/thygate/stable-diffusion-webui-depthmap-script.git" } ], "Inactive extensions": [ { "name": "multidiffusion-upscaler-for-automatic1111", "path": "D:\Development\stable-diffusion-webui\extensions\multidiffusion-upscaler-for-automatic1111", "version": "f9f8073e", "branch": "main", "remote": "https://github.com/pkuliyi2015/multidiffusion-upscaler-for-automatic1111.git" }, { "name": "sd_dreambooth_extension", "path": "D:\Development\stable-diffusion-webui\extensions\sd_dreambooth_extension", "version": "cf086c53", "branch": "main", "remote": "https://github.com/d8ahazard/sd_dreambooth_extension.git" } ], "Environment": { "COMMANDLINE_ARGS": "--xformers --api", "GRADIO_ANALYTICS_ENABLED": "False" }, "Config": { "samples_save": true, "samples_format": "png", "samples_filename_pattern": "", "save_images_add_number": true, "grid_save": true, "grid_format": "png", "grid_extended_filename": false, "grid_only_if_multiple": true, "grid_prevent_empty_spots": false, "grid_zip_filename_pattern": "", "n_rows": -1, "font": "", "grid_text_active_color": "#000000", "grid_text_inactive_color": "#999999", "grid_background_color": "#ffffff", "enable_pnginfo": true, "save_txt": false, "save_images_before_face_restoration": false, "save_images_before_highres_fix": false, "save_images_before_color_correction": false, "save_mask": false, "save_mask_composite": false, "jpeg_quality": 80, "webp_lossless": false, "export_for_4chan": false, "img_downscale_threshold": 4.0, "target_side_length": 4000, "img_max_size_mp": 200, "use_original_name_batch": true, "use_upscaler_name_as_suffix": false, "save_selected_only": true, "save_init_img": false, "temp_dir": "", "clean_temp_dir_at_start": false, "outdir_samples": "", "outdir_txt2img_samples": "outputs/txt2img-images", "outdir_img2img_samples": "outputs/img2img-images", "outdir_extras_samples": "outputs/extras-images", "outdir_grids": "", "outdir_txt2img_grids": "outputs/txt2img-grids", "outdir_img2img_grids": "outputs/img2img-grids", "outdir_save": "log/images", "outdir_init_images": "outputs/init-images", "save_to_dirs": true, "grid_save_to_dirs": true, "use_save_to_dirs_for_ui": false, "directories_filename_pattern": "[date]", "directories_max_prompt_words": 8, "ESRGAN_tile": 192, "ESRGAN_tile_overlap": 8, "realesrgan_enabled_models": [ "R-ESRGAN 4x+", "R-ESRGAN 4x+ Anime6B" ], "upscaler_for_img2img": null, "face_restoration_model": "CodeFormer", "code_former_weight": 0.5, "face_restoration_unload": false, "show_warnings": false, "memmon_poll_rate": 8, "samples_log_stdout": false, "multiple_tqdm": true, "print_hypernet_extra": false, "list_hidden_files": true, "disable_mmap_load_safetensors": false, "unload_models_when_training": false, "pin_memory": false, "save_optimizer_state": false, "save_training_settings_to_txt": true, "dataset_filename_word_regex": "", "dataset_filename_join_string": " ", "training_image_repeats_per_epoch": 1, "training_write_csv_every": 500, "training_xattention_optimizations": false, "training_enable_tensorboard": false, "training_tensorboard_save_images": false, "training_tensorboard_flush_every": 120, "sd_model_checkpoint": "anime3dMix_1.safetensors [24aa136912]", "sd_checkpoint_cache": 2, "sd_vae_checkpoint_cache": 2, "sd_vae": "orangemix.vae.pt", "sd_vae_as_default": true, "sd_unet": "Automatic", "inpainting_mask_weight": 1.0, "initial_noise_multiplier": 1, "img2img_color_correction": false, "img2img_fix_steps": false, "img2img_background_color": "#ffffff", "enable_quantization": true, "enable_emphasis": true, "enable_batch_seeds": true, "comma_padding_backtrack": 20, "CLIP_stop_at_last_layers": 2, "upcast_attn": false, "auto_vae_precision": true, "randn_source": "GPU", "sdxl_crop_top": 0, "sdxl_crop_left": 0, "sdxl_refiner_low_aesthetic_score": 2.5, "sdxl_refiner_high_aesthetic_score": 6.0, "cross_attention_optimization": "Automatic", "s_min_uncond": 0.0, "token_merging_ratio": 0.0, "token_merging_ratio_img2img": 0.0, "token_merging_ratio_hr": 0.0, "pad_cond_uncond": false, "experimental_persistent_cond_cache": false, "use_old_emphasis_implementation": false, "use_old_karras_scheduler_sigmas": false, "no_dpmpp_sde_batch_determinism": false, "use_old_hires_fix_width_height": false, "dont_fix_second_order_samplers_schedule": false, "hires_fix_use_firstpass_conds": false, "interrogate_keep_models_in_memory": false, "interrogate_return_ranks": false, "interrogate_clip_num_beams": 1, "interrogate_clip_min_length": 24, "interrogate_clip_max_length": 48, "interrogate_clip_dict_limit": 1500, "interrogate_clip_skip_categories": [], "interrogate_deepbooru_score_threshold": 0.5, "deepbooru_sort_alpha": true, "deepbooru_use_spaces": true, "deepbooru_escape": true, "deepbooru_filter_tags": "", "extra_networks_show_hidden_directories": true, "extra_networks_hidden_models": "When searched", "extra_networks_default_multiplier": 1.0, "extra_networks_card_width": 0, "extra_networks_card_height": 0, "extra_networks_card_text_scale": 1.0, "extra_networks_card_show_desc": true, "extra_networks_add_text_separator": " ", "ui_extra_networks_tab_reorder": "", "textual_inversion_print_at_load": false, "textual_inversion_add_hashes_to_infotext": true, "sd_hypernetwork": "None", "localization": "None", "gradio_theme": "Default", "img2img_editor_height": 720, "return_grid": true, "return_mask": false, "return_mask_composite": false, "do_not_show_images": false, "send_seed": true, "send_size": true, "js_modal_lightbox": true, "js_modal_lightbox_initially_zoomed": true, "js_modal_lightbox_gamepad": false, "js_modal_lightbox_gamepad_repeat": 250, "show_progress_in_title": true, "samplers_in_dropdown": true, "dimensions_and_batch_together": true, "keyedit_precision_attention": 0.1, "keyedit_precision_extra": 0.05, "keyedit_delimiters": ".,\/!?%^*;:{}=`~()", "keyedit_move": true, "quicksettings_list": [ "sd_model_checkpoint", "sd_vae", "img2img_color_correction", "CLIP_stop_at_last_layers" ], "ui_tab_order": [], "hidden_tabs": [], "ui_reorder_list": [], "hires_fix_show_sampler": false, "hires_fix_show_prompts": false, "disable_token_counters": false, "add_model_hash_to_info": true, "add_model_name_to_info": true, "add_user_name_to_info": false, "add_version_to_infotext": true, "disable_weights_auto_swap": true, "infotext_styles": "Apply if any", "show_progressbar": true, "live_previews_enable": true, "live_previews_image_format": "png", "show_progress_grid": true, "show_progress_every_n_steps": 10, "show_progress_type": "Approx NN", "live_preview_content": "Prompt", "live_preview_refresh_period": 1000, "hide_samplers": [], "eta_ddim": 0.0, "eta_ancestral": 1.0, "ddim_discretize": "uniform", "s_churn": 0.0, "s_tmin": 0.0, "s_noise": 1.0, "k_sched_type": "Automatic", "sigma_min": 0.0, "sigma_max": 0.0, "rho": 0.0, "eta_noise_seed_delta": 0, "always_discard_next_to_last_sigma": false, "uni_pc_variant": "bh1", "uni_pc_skip_type": "time_uniform", "uni_pc_order": 3, "uni_pc_lower_order_final": true, "postprocessing_enable_in_main_ui": [], "postprocessing_operation_order": [], "upscaling_max_images_in_cache": 5, "disabled_extensions": [ "multidiffusion-upscaler-for-automatic1111", "sd_dreambooth_extension" ], "disable_all_extensions": "none", "restore_config_state_file": "", "sd_checkpoint_hash": "24aa136912019d44e3ea77a0e48726a52b3493806a50e63b74ea39dcdddd7516", "ldsr_steps": 100, "ldsr_cached": false, "SCUNET_tile": 256, "SCUNET_tile_overlap": 8, "SWIN_tile": 192, "SWIN_tile_overlap": 8, "lora_functional": false, "sd_lora": "None", "lora_preferred_name": "Alias from file", "lora_add_hashes_to_infotext": true, "lora_show_all": false, "lora_hide_unknown_for_versions": [], "extra_options": [], "extra_options_accordion": false, "canvas_hotkey_zoom": "Alt", "canvas_hotkey_adjust": "Ctrl", "canvas_hotkey_move": "F", "canvas_hotkey_fullscreen": "S", "canvas_hotkey_reset": "R", "canvas_hotkey_overlap": "O", "canvas_show_tooltip": true, "canvas_blur_prompt": false, "canvas_disabled_functions": [ "Overlap" ], "ad_max_models": 1, "ad_save_previews": false, "ad_save_images_before": false, "ad_only_seleted_scripts": true, "ad_script_names": "dynamic_prompting,dynamic_thresholding,wildcard_recursive,wildcards,lora_block_weight", "ad_bbox_sortby": "None", "deforum_keep_3d_models_in_vram": false, "deforum_enable_persistent_settings": false, "deforum_persistent_settings_path": "models/Deforum/deforum_persistent_settings.txt", "deforum_ffmpeg_location": "D:\Development\stable-diffusion-webui\venv\lib\site-packages\imageio_ffmpeg\binaries\ffmpeg-win64-v4.2.2.exe", "deforum_ffmpeg_crf": 17, "deforum_ffmpeg_preset": "slow", "deforum_debug_mode_enabled": false, "deforum_save_gen_info_as_srt": false, "deforum_embed_srt": false, "deforum_save_gen_info_as_srt_params": [ "Noise Schedule" ], "deforum_preview": "On, concurrent (don't pause generation)", "deforum_preview_interval_frames": 100, "control_net_model_config": "models\cldm_v15.yaml", "control_net_model_adapter_config": "models\t2iadapter_sketch_sd14v1.yaml", "control_net_detectedmap_dir": "detected_maps", "control_net_models_path": "", "control_net_modules_path": "", "control_net_max_models_num": 3, "control_net_model_cache_size": 1, "control_net_inpaint_blur_sigma": 7, "control_net_no_high_res_fix": false, "control_net_no_detectmap": false, "control_net_detectmap_autosaving": false, "control_net_allow_script_control": false, "control_net_sync_field_args": false, "controlnet_show_batch_images_in_ui": false, "controlnet_increment_seed_during_batch": false, "controlnet_disable_control_type": false, "controlnet_disable_openpose_edit": false, "controlnet_ignore_noninpaint_mask": false, "depthmap_script_keepmodels": false, "depthmap_script_boost_rmax": 1600.0, "depthmap_script_save_ply": false, "depthmap_script_show_3d": true, "depthmap_script_show_3d_inpaint": true, "depthmap_script_mesh_maxsize": 2048.0, "depthmap_script_gen_heatmap_from_ui": false, "depthmap_script_extra_stereomodes": false }, "Startup": { "total": 54.41706418991089, "records": { "start": 0.0, "launcher": 30.70277166366577, "import torch": 5.552563667297363, "import gradio": 1.9095630645751953, "setup paths": 3.6989996433258057, "import ldm": 0.0070002079010009766, "other imports": 3.368168592453003, "opts onchange": 0.002998828887939453, "setup SD model": 0.0010004043579101562, "setup codeformer": 0.14599990844726562, "setup gfpgan": 0.0010001659393310547, "list extensions": 0.0, "list SD models": 0.5589988231658936, "load scripts/custom_code.py": 0.0060002803802490234, "load scripts/img2imgalt.py": 0.0009996891021728516, "load scripts/loopback.py": 0.0, "load scripts/outpainting_mk_2.py": 0.0010006427764892578, "load scripts/poor_mans_outpainting.py": 0.00099945068359375, "load scripts/postprocessing_codeformer.py": 0.0, "load scripts/postprocessing_gfpgan.py": 0.0009996891021728516, "load scripts/postprocessing_upscale.py": 0.0, "load scripts/prompt_matrix.py": 0.0010001659393310547, "load scripts/prompts_from_file.py": 0.0, "load scripts/sd_upscale.py": 0.0009999275207519531, "load scripts/xyz_grid.py": 0.0019998550415039062, "load scripts/!adetailer.py": 3.0249998569488525, "load scripts/deforum.py": 0.09200119972229004, "load scripts/deforum_api.py": 0.0009989738464355469, "load scripts/deforum_api_models.py": 0.0029997825622558594, "load scripts/deforum_extend_paths.py": 0.0010008811950683594, "load scripts/adapter.py": 0.00099945068359375, "load scripts/api.py": 0.3209993839263916, "load scripts/batch_hijack.py": 0.0010006427764892578, "load scripts/cldm.py": 0.0009996891021728516, "load scripts/controlnet.py": 0.21000027656555176, "load scripts/controlnet_version.py": 0.0, "load scripts/external_code.py": 0.0009996891021728516, "load scripts/global_state.py": 0.0, "load scripts/hook.py": 0.0010008811950683594, "load scripts/infotext.py": 0.0, "load scripts/logging.py": 0.0009996891021728516, "load scripts/lvminthin.py": 0.0, "load scripts/movie2movie.py": 0.0010001659393310547, "load scripts/processor.py": 0.0009996891021728516, "load scripts/utils.py": 0.0, "load scripts/xyz_grid_support.py": 0.0010001659393310547, "load scripts/depthmap.py": 2.9419994354248047, "load scripts/depthmap_api.py": 0.029999494552612305, "load scripts/ldsr_model.py": 0.036000728607177734, "load scripts/lora_script.py": 0.15700006484985352, "load scripts/scunet_model.py": 0.03699898719787598, "load scripts/swinir_model.py": 0.03300142288208008, "load scripts/hotkey_config.py": 0.0010006427764892578, "load scripts/extra_options_section.py": 0.0, "load scripts": 6.912000894546509, "load upscalers": 0.003999233245849609, "refresh VAE": 0.002000093460083008, "refresh textual inversion templates": 0.0, "scripts list_optimizers": 0.0009999275207519531, "scripts list_unets": 0.0, "reload hypernetworks": 0.003999948501586914, "initialize extra networks": 0.01699972152709961, "scripts before_ui_callback": 0.0009999275207519531, "create ui": 1.0079991817474365, "gradio launch": 0.4310009479522705, "add APIs": 0.08499956130981445, "app_started_callback/api.py": 0.002001047134399414, "app_started_callback/depthmap_api.py": 0.0009987354278564453, "app_started_callback/lora_script.py": 0.0, "app_started_callback": 0.0029997825622558594 } }, "Packages": [ "-ransformers==4.25.1", "absl-py==1.4.0", "accelerate==0.18.0", "addict==2.4.0", "aenum==3.1.15", "aiofiles==23.1.0", "aiohttp==3.8.5", "aiosignal==1.3.1", "altair==5.0.1", "antlr4-python3-runtime==4.9.3", "anyio==3.7.1", "async-timeout==4.0.2", "attrs==23.1.0", "av==10.0.0", "basicsr==1.4.2", "beautifulsoup4==4.12.2", "bitsandbytes==0.35.4", "blendmodes==2022", "boltons==23.0.0", "cachetools==5.3.1", "certifi==2023.7.22", "cffi==1.15.1", "charset-normalizer==3.2.0", "clean-fid==0.1.35", "click==8.1.6", "clip==1.0", "colorama==0.4.6", "coloredlogs==15.0.1", "contourpy==1.1.0", "cssselect2==0.7.0", "cycler==0.11.0", "dadaptation==3.1", "decorator==4.4.2", "deprecation==2.1.0", "diffusers==0.19.3", "discord-webhook==1.1.0", "einops==0.4.1", "exceptiongroup==1.1.2", "facexlib==0.3.0", "fastapi==0.94.0", "ffmpy==0.3.1", "filelock==3.12.2", "filterpy==1.4.5", "flatbuffers==23.5.26", "fonttools==4.42.0", "freetype-py==2.4.0", "frozenlist==1.4.0", "fsspec==2023.6.0", "ftfy==6.1.1", "future==0.18.3", "fvcore==0.1.5.post20221221", "gdown==4.7.1", "gfpgan==1.3.8", "gitdb==4.0.10", "gitpython==3.1.30", "google-auth-oauthlib==1.0.0", "google-auth==2.22.0", "gradio-client==0.3.0", "gradio==3.32.0", "grpcio==1.56.2", "h11==0.12.0", "hsluv==5.0.3", "httpcore==0.15.0", "httpx==0.24.1", "huggingface-hub==0.16.4", "humanfriendly==10.0", "idna==3.4", "imageio-ffmpeg==0.4.8", "imageio==2.31.1", "importlib-metadata==6.8.0", "inflection==0.5.1", "iopath==0.1.9", "jinja2==3.1.2", "jsonmerge==1.8.0", "jsonschema-specifications==2023.7.1", "jsonschema==4.18.6", "kiwisolver==1.4.4", "kornia==0.6.7", "lark==1.1.2", "lazy-loader==0.3", "lightning-utilities==0.9.0", "linkify-it-py==2.0.2", "lion-pytorch==0.1.2", "llvmlite==0.40.1", "lmdb==1.4.1", "lpips==0.1.4", "lxml==4.9.3", "markdown-it-py==2.2.0", "markdown==3.4.4", "markupsafe==2.1.3", "matplotlib==3.7.2", "mdit-py-plugins==0.3.3", "mdurl==0.1.2", "mediapipe==0.10.3", "moviepy==1.0.2", "mpmath==1.3.0", "multidict==6.0.4", "networkx==3.1", "numba==0.57.1", "numexpr==2.8.5", "numpy==1.23.5", "oauthlib==3.2.2", "omegaconf==2.2.3", "onnxruntime==1.15.1", "open-clip-torch==2.20.0", "opencv-contrib-python==4.8.0.74", "opencv-python-headless==4.8.0.76", "opencv-python==4.8.0.74", "orjson==3.9.2", "packaging==23.1", "pandas==2.0.3", "piexif==1.1.3", "pillow==9.5.0", "pims==0.6.0", "pip==22.2.1", "platformdirs==3.10.0", "pooch==1.7.0", "portalocker==2.7.0", "proglog==0.1.10", "protobuf==3.20.0", "psutil==5.9.5", "py-cpuinfo==9.0.0", "pyasn1-modules==0.3.0", "pyasn1==0.5.0", "pycparser==2.21", "pydantic==1.10.12", "pydub==0.25.1", "pygments==2.15.1", "pymatting==1.1.8", "pyparsing==3.0.9", "pyqt5-qt5==5.15.2", "pyqt5-sip==12.12.2", "pyqt5==5.15.9", "pyreadline3==3.4.1", "pysocks==1.7.1", "python-dateutil==2.8.2", "python-multipart==0.0.6", "pytorch-lightning==1.9.4", "pytz==2023.3", "pywavelets==1.4.1", "pywin32==306", "pyyaml==6.0.1", "realesrgan==0.3.0", "referencing==0.30.1", "regex==2023.6.3", "rembg==2.0.50", "reportlab==4.0.4", "requests-oauthlib==1.3.1", "requests==2.31.0", "resize-right==0.0.2", "rich==13.5.2", "rpds-py==0.9.2", "rsa==4.9", "safetensors==0.3.1", "scikit-image==0.20.0", "scipy==1.11.1", "seaborn==0.12.2", "semantic-version==2.10.0", "sentencepiece==0.1.99", "setuptools==63.2.0", "six==1.16.0", "slicerator==1.1.0", "smmap==5.0.0", "sniffio==1.3.0", "sounddevice==0.4.6", "soupsieve==2.4.1", "starlette==0.26.1", "svglib==1.5.1", "sympy==1.12", "tabulate==0.9.0", "tb-nightly==2.14.0a20230804", "tensorboard-data-server==0.7.1", "tensorboard==2.13.0", "termcolor==2.3.0", "tifffile==2023.7.18", "timm==0.9.7", "tinycss2==1.2.1", "tokenizers==0.13.3", "tomesd==0.1.2", "tomli==2.0.1", "toolz==0.12.0", "torch==2.0.1+cu118", "torchdiffeq==0.2.3", "torchmetrics==1.0.2", "torchsde==0.2.5", "torchvision==0.15.2+cu118", "tqdm==4.65.0", "trampoline==0.1.2", "transformers==4.25.1", "transforms3d==0.4.1", "trimesh==3.23.3", "typing-extensions==4.7.1", "tzdata==2023.3", "uc-micro-py==1.0.2", "ultralytics==8.0.170", "urllib3==1.26.16", "uvicorn==0.23.2", "vispy==0.13.0", "wcwidth==0.2.6", "webencodings==0.5.1", "websockets==11.0.3", "werkzeug==2.3.6", "wheel==0.41.0", "xformers==0.0.20", "yacs==0.1.8", "yapf==0.40.1", "yarl==1.9.2", "zipp==3.16.2" ] }

What browsers do you use to access the UI ?

Mozilla Firefox

Console logs

Loading VAE weights specified in settings: cached orangemix.vae.pt
Applying attention optimization: xformers... done.
Weights loaded in 5.5s (load weights from disk: 0.3s, apply weights to model: 4.2s, load VAE: 0.3s, move model to device: 0.6s).
Loading weights [24aa136912] from D:\Development\stable-diffusion-webui\models\Stable-diffusion\anime3dMix_1.safetensors
Loading VAE weights specified in settings: cached orangemix.vae.pt
Applying attention optimization: xformers... done.
Weights loaded in 5.5s (load weights from disk: 0.3s, apply weights to model: 4.1s, load VAE: 0.3s, move model to device: 0.6s).
2023-09-06 08:53:42,790 - ControlNet - INFO - Loading model: control_v11p_sd15_lineart [43d4be0d]
2023-09-06 08:53:45,556 - ControlNet - INFO - Loaded state_dict from [D:\Development\stable-diffusion-webui\extensions\sd-webui-controlnet\models\control_v11p_sd15_lineart.pth]
2023-09-06 08:53:45,557 - ControlNet - INFO - Loading config: D:\Development\stable-diffusion-webui\extensions\sd-webui-controlnet\models\control_v11p_sd15_lineart.yaml
2023-09-06 08:53:48,199 - ControlNet - INFO - ControlNet model control_v11p_sd15_lineart [43d4be0d] loaded.
2023-09-06 08:53:48,303 - ControlNet - INFO - Loading preprocessor: lineart
2023-09-06 08:53:48,304 - ControlNet - INFO - preprocessor resolution = 960
100%|██████████████████████████████████████████████████████████████████████████████████| 19/19 [00:14<00:00,  1.34it/s]
Total progress: 106it [03:43,  2.11s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 19/19 [00:09<00:00,  1.95it/s]
Total progress: 100%|██████████████████████████████████████████████████████████████████| 19/19 [00:12<00:00,  1.58it/s]
100%|██████████████████████████████████████████████████████████████████████████████████| 19/19 [00:09<00:00,  1.96it/s]
100%|██████████████████████████████████████████████████████████████████████████████████| 19/19 [00:09<00:00,  1.94it/s]
Total progress: 38it [01:53,  2.99s/it]
2023-09-06 09:09:13,012 - ControlNet - INFO - Loading model from cache: control_v11p_sd15_lineart [43d4be0d]
2023-09-06 09:09:13,200 - ControlNet - INFO - Loading preprocessor: lineart
2023-09-06 09:09:13,201 - ControlNet - INFO - preprocessor resolution = 960
100%|██████████████████████████████████████████████████████████████████████████████████| 19/19 [00:13<00:00,  1.40it/s]
2023-09-06 09:10:32,646 - ControlNet - INFO - Loading model from cache: control_v11p_sd15_lineart [43d4be0d]  1.40it/s]
2023-09-06 09:10:32,650 - ControlNet - INFO - Loading preprocessor: lineart
2023-09-06 09:10:32,650 - ControlNet - INFO - preprocessor resolution = 960
100%|██████████████████████████████████████████████████████████████████████████████████| 19/19 [00:13<00:00,  1.40it/s]
Total progress: 38it [01:35,  2.51s/it]
Total progress: 38it [01:35,  1.33it/s]

Additional information

FYI I know my console shows I'm using a control net, but I verified it happens with or without it. So didn't include that in the desc.

antonioglass commented 1 year ago

I'm facing the same issue but with txt2img. Have you managed to solve it?

meticulous22 commented 11 months ago

I'm facing the same issue but with txt2img. Have you managed to solve it?

No I don't think so... I haven't come back to this in a while, but I did find that if you specify either of these:

"eta": 0, "s_noise": 0,

You get very bad results. Maybe 0 is not the default(?), not sure. And this may apply more to just img2img, but fwiw, removing those from my json improved my results dramatically.

CCJetWing commented 10 months ago

I also get the same problem, using Stable Diffusion 1.5.2

catboxanon commented 10 months ago

"eta": 0, "s_noise": 0,

Those are indeed not the defaults. The sysinfo results posted even lists the correct (and default) values. Both of those values should be 1. The eta value depends on the sampler chosen, but since the full API payload was not shared, there's no way to tell for sure.

Regardless, this is user error. Closing.