search

AUTOMATIC1111 / stable-diffusion-webui

Stable Diffusion web UI
GNU Affero General Public License v3.0
136.09k stars 25.96k forks source link

[Bug]: Multi lora/lyco => systematic overcook #13788

Open neskweek opened 8 months ago

neskweek commented 8 months ago

Is there an existing issue for this?

What happened?

Since v.16, prompts with multiple Lora's that use to work perfectly on v1.52 now systematically overcook on v1.6

I'm aware of the fact that I needed to rename <lyco: to <lora: for lycoris prompts but it doesn't correct the issue The example below show the same image with ALMOST (<lyco renamed to <lora) same parameters produced on the two versions: v1.6 00009-1160335570

v .152
00001-1160335570

Steps to reproduce the problem

parameters

An award-winning photograph of the (stunning:1.2) (petite:1.4) (slender slim:1.4) ( rola:1.4). (charming smile:1.3). , perfecteyes eyes. (in her 20:1.4). BREAK. , hourglass body shape , , (narrow hips:1.4), , round ass, (fake breast:1.3), (medium breast:1.4), (firm breast:1.4) , (thin legs:1.5), , , (toned:1.4), (athletic:1.4), (blushes:1.2). BREAK. wearing (((low_rise, low_waist, low) baggy loose khaki cargo pants, belt:1.3) (grey croptop:1.3). breasts. belly , cameltoe pussy:1.5) , (detailed intricate apparel:1.4), (braless:1.4), covered nipples, (belly:1.4), (midriff:1.2) , (jewelry:1.2), (rings:1.2), (bracelets:1.3), (necklace:1.3), (earrings:1.4). BREAK. [(feminine:1.4), (attracted:1.4), (charmed:1.4), (ravishing:1.4),(sensual:1.4), (nubile:1.4), erotic,gipsy,gorgeous,seductive:0.7] BREAK. in a in a Sauna. Gipsy themed. BREAK. , , , BREAK. RAW, analogue, (deep shadow:1.1), (natural lighting, light rays) (natural skin texture, hyperrealism, soft light, sharp), (best quality:1.5), (masterpiece:1.5), (realistic), skin pores, scattering, radiant light rays, high-res, detailed facial features, high detail, sharp focus, smooth, aesthetic, extremely detailed, (extremely detailed eyes, extremely detailed iris:1.4), extremely detailed hair, extremely detailed skin, extremely detailed clothes, octane render, Unreal Engine, post-processing, max detail, roughness, natural skin texture, (real life:1.4), 8k UHD, (ultra realistic 8k cg:1.0), (digital art:1.0), hdr, intricate, vivid colors, OverallDetail. Negative prompt: sfw, fcNeg, FastNegativeV2, drawing, illustration,amputation, (b&w:1.5), bad anatomy, (long torso:1.4),(bad art:1.4),bad-artist, bad feet, bad hands, bad mouth, bad nipples, bad proportions, bad teeth, bad-hands-5, bad-picture-chill-75v, (blurry:1.4), (pixelated:1.4), (jpeg artefact:1.4),(overcooked:1.4), (bodies out of frame:1.4), broken fingers, broken wrist, canvas frame, cloned face, close up, (chubby:1.4), (creepy:1.4), cropped head, cropped, cross-eye, deformed, deformed body, deformed face, deformed feet, deformed hands, deformed iris, deformed legs, deformed nipples, deformed pupils, different nipples, disconnected limbs, disconnected tongue, (disconnected penis:1.4), disfigured, distorted hands, double hands, doubled face, extra arms, extra breasts, extra calf, extra ears, extra eyes, extra feet, extra fingers, extra heads, extra knee, extra legs, extra limbs, extra shoes, extra thighs, extra toes, (fat:1.4), fewer digits, flat nipples, floating limbs, fused fingers, grainy, gross proportions, half body parts, head out of frame, irregular, (latex clothes:1.4), (leather clothes:1.4), (black clothes:1.4), (large hips:1.4), (big glutes:1.4), logo, long neck, lopsided, (low detail clothes:1.4), (lowres:1.4), (mask:1.4), malformed hands, malformed limbs, malformed, (messy drawing:1.4), misshapen, missing arms, missing fingers, missing hands, missing legs, missing limb, morbid, mutated hands,(muscular:1.2), mutated, mutation, mutilated, (obese:1.4), out of frame, oversaturated, (poorly drawn eyes:1.2),(poorly drawn face:1.2), poorly drawn feet, poorly drawn hands, poorly drawn tongue, (poorly drawn clothes:1.4),(poorly drawn apparel:1.4), (red lips:1.5), (purple lips:1.5), (dark lips:1.5), short arm, (strabismus:1.3), (thick:1.4), tiling, too many fingers, too many limbs, too many toes, twisted nipples, ugly nipples, ugly, unrealistic eyes, unrealistic nails, unrealistic nose, video game, (voluptuous:1.4), watermark, weird nipples, (worst quality:1.4), stanleylau style, blemishes, (heavy makeup:1.2), (banal:1.4), (mundane:1.4), (common:1.4), (repulsive:1.4), (hideous:1.4), (abominable:1.4), (dreadful:1.4),(loathsome:1.4), (disgusting:1.4), (child:1.4), (pregnant:1.1),(sad:1.3), (uncomfortable:1.4) Steps: 60, Sampler: DPM++ 2M Karras, CFG scale: 8, Seed: 1160335570, Face restoration: CodeFormer, Size: 512x768, Model hash: d319cb2188, Model: babes_20, Clip skip: 2, RNG: CPU, Lora hashes: "microwaistV05: 471cf6f4fb0f", TI hashes: "OverallDetail: 34dca6da7388", Version: 1.5.2, Hashes: {"embed:FastNegativeV2": "a7465e7cc2", "embed:bad-hands-5": "aa7651be15", "embed:bad-picture-chill-75v": "7d9cc5f549", "lora:rola_v1": "08b0455607", "lora:dhevv-ubh": "14ba175090", "lora:locon_perfecteyes_v1_from_v1_64_32": "068022d2cc", "lora:hourglassv01": "9ce0787654", "lora:roundassv1": "55eb1a0145", "lora:masusu_breast": "85b72e3598", "lora:Thinlegs": "569eb971e4", "lora:cameltoe_pussy.v1.0": "550aec486b", "lora:bralessv2": "ec2a876669", "lora:epi_noiseoffset2": "81680c064e", "lora:detail_slider_v4": "8184d4ba9d", "lora:emotion_happy_slider_v1": "7a6b61a3bd", "model": "d319cb2188"} Template: An award-winning photograph of the (stunning:1.2) (petite:1.4) (slender slim:1.4) ( rola:1.4). (charming smile:1.3). , perfecteyes eyes. (in her 20:1.4). BREAK. , hourglass body shape , , (narrow hips:1.4), , round ass, (fake breast:1.3), (medium breast:1.4), (firm breast:1.4) , (thin legs:1.5), , , (toned:1.4), (athletic:1.4), (blushes:1.2). BREAK. wearing (((low_rise, low_waist, low) baggy loose khaki cargo pants, belt:1.3) (grey croptop:1.3). breasts. belly , cameltoe pussy:1.5) , (detailed intricate apparel:1.4), (braless:1.4), covered nipples, (belly:1.4), (midriff:1.2) , (jewelry:1.2), (rings:1.2), (bracelets:1.3), (necklace:1.3), (earrings:1.4). BREAK. [(feminine:1.4), (attracted:1.4), (charmed:1.4), (ravishing:1.4),(sensual:1.4), (nubile:1.4), erotic,gipsy,gorgeous,seductive:0.7] BREAK. in a in a Sauna. Gipsy themed. BREAK. , , , BREAK. RAW, analogue, (deep shadow:1.1), (natural lighting, light rays) (natural skin texture, hyperrealism, soft light, sharp), (best quality:1.5), (masterpiece:1.5), (realistic), skin pores, scattering, radiant light rays, high-res, detailed facial features, high detail, sharp focus, smooth, aesthetic, extremely detailed, (extremely detailed eyes, extremely detailed iris:1.4), extremely detailed hair, extremely detailed skin, extremely detailed clothes, octane render, Unreal Engine, post-processing, max detail, roughness, natural skin texture, (real life:1.4), 8k UHD, (ultra realistic 8k cg:1.0), (digital art:1.0), hdr, intricate, vivid colors, OverallDetail. Negative Template: sfw, fcNeg, FastNegativeV2, drawing, illustration,amputation, (b&w:1.5), bad anatomy, (long torso:1.4),(bad art:1.4),bad-artist, bad feet, bad hands, bad mouth, bad nipples, bad proportions, bad teeth, bad-hands-5, bad-picture-chill-75v, (blurry:1.4), (pixelated:1.4), (jpeg artefact:1.4),(overcooked:1.4), (bodies out of frame:1.4), broken fingers, broken wrist, canvas frame, cloned face, close up, (chubby:1.4), (creepy:1.4), cropped head, cropped, cross-eye, deformed, deformed body, deformed face, deformed feet, deformed hands, deformed iris, deformed legs, deformed nipples, deformed pupils, different nipples, disconnected limbs, disconnected tongue, (disconnected penis:1.4), disfigured, distorted hands, double hands, doubled face, extra arms, extra breasts, extra calf, extra ears, extra eyes, extra feet, extra fingers, extra heads, extra knee, extra legs, extra limbs, extra shoes, extra thighs, extra toes, (fat:1.4), fewer digits, flat nipples, floating limbs, fused fingers, grainy, gross proportions, half body parts, head out of frame, irregular, (latex clothes:1.4), (leather clothes:1.4), (black clothes:1.4), (large hips:1.4), (big glutes:1.4), logo, long neck, lopsided, (low detail clothes:1.4), (lowres:1.4), (mask:1.4), malformed hands, malformed limbs, malformed, (messy drawing:1.4), misshapen, missing arms, missing fingers, missing hands, missing legs, missing limb, morbid, mutated hands,(muscular:1.2), mutated, mutation, mutilated, (obese:1.4), out of frame, oversaturated, (poorly drawn eyes:1.2),(poorly drawn face:1.2), poorly drawn feet, poorly drawn hands, poorly drawn tongue, (poorly drawn clothes:1.4),(poorly drawn apparel:1.4), (red lips:1.5), (purple lips:1.5), (dark lips:1.5), short arm, (strabismus:1.3), (thick:1.4), tiling, too many fingers, too many limbs, too many toes, twisted nipples, ugly nipples, ugly, unrealistic eyes, unrealistic nails, unrealistic nose, video game, (voluptuous:1.4), watermark, weird nipples, (worst quality:1.4), stanleylau style, blemishes, (heavy makeup:1.2), (banal:1.4), (mundane:1.4), (common:1.4), (repulsive:1.4), (hideous:1.4), (abominable:1.4), (dreadful:1.4),(loathsome:1.4), (disgusting:1.4), (child:1.4), (pregnant:1.1),(sad:1.3), (uncomfortable:1.4)

What should have happened?

Generate a similar picture to the one it generated in v1.52

Sysinfo

{ "Platform": "Windows-10-10.0.22621-SP0", "Python": "3.10.13", "Version": "v1.6.0", "Commit": "5ef669de080814067961f28357256e8fe27544f4", "Script path": "D:\Ai\images\stable-diffusion-webui", "Data path": "D:\Ai\images\stable-diffusion-webui", "Extensions dir": "D:\Ai\images\stable-diffusion-webui\extensions", "Checksum": "38683593b1e7882d159700468b8daff707570d9ea0b5b1d064f8a898343c2a81", "Commandline": [ "launch.py", "--xformers", "--port", "7859", "--dump-sysinfo" ], "Torch env info": { "torch_version": "2.0.1+cu118", "is_debug_build": "False", "cuda_compiled_version": "11.8", "gcc_version": null, "clang_version": null, "cmake_version": null, "os": "Microsoft Windows 11 Professionnel", "libc_version": "N/A", "python_version": "3.10.13 | packaged by Anaconda, Inc. | (main, Sep 11 2023, 13:24:38) [MSC v.1916 64 bit (AMD64)] (64-bit runtime)", "python_platform": "Windows-10-10.0.22621-SP0", "is_cuda_available": "True", "cuda_runtime_version": "11.3.58\r", "cuda_module_loading": "LAZY", "nvidia_driver_version": "545.84", "nvidia_gpu_models": "GPU 0: NVIDIA GeForce RTX 4090", "cudnn_version": null, "pip_version": "pip3", "pip_packages": [ "numpy==1.23.5", "open-clip-torch==2.20.0", "pytorch-lightning==1.9.4", "torch==2.0.1+cu118", "torchdiffeq==0.2.3", "torchmetrics==1.2.0", "torchsde==0.2.5", "torchvision==0.15.2+cu118" ], "conda_packages": [ "numpy 1.24.4 pypi_0 pypi", "torch 2.1.0+cu121 pypi_0 pypi", "torch-grammar 0.3.3 pypi_0 pypi", "torchaudio 2.1.0+cu121 pypi_0 pypi", "torchvision 0.16.0+cu121 pypi_0 pypi" ], "hip_compiled_version": "N/A", "hip_runtime_version": "N/A", "miopen_runtime_version": "N/A", "caching_allocator_config": "max_split_size_mb:512", "is_xnnpack_available": "True", "cpu_info": [ "Architecture=9", "CurrentClockSpeed=3792", "DeviceID=CPU0", "Family=198", "L2CacheSize=2048", "L2CacheSpeed=", "Manufacturer=GenuineIntel", "MaxClockSpeed=3792", "Name=Intel(R) Core(TM) i7-10700KF CPU @ 3.80GHz", "ProcessorType=3", "Revision=" ] }, "Exceptions": [], "CPU": { "model": "Intel64 Family 6 Model 165 Stepping 5, GenuineIntel", "count logical": 16, "count physical": 8 }, "RAM": { "total": "16GB", "used": "10GB", "free": "6GB" }, "Extensions": [], "Inactive extensions": [], "Environment": { "COMMANDLINE_ARGS": " --xformers --port 7859 --dump-sysinfo", "GRADIO_ANALYTICS_ENABLED": "False" }, "Config": "'NoneType' object has no attribute 'data'", "Startup": null, "Packages": [ "absl-py==2.0.0", "accelerate==0.21.0", "addict==2.4.0", "aenum==3.1.15", "aiofiles==23.2.1", "aiohttp==3.8.6", "aiosignal==1.3.1", "altair==5.1.2", "antlr4-python3-runtime==4.9.3", "anyio==3.7.1", "async-timeout==4.0.3", "attrs==23.1.0", "basicsr==1.4.2", "beautifulsoup4==4.12.2", "bidict==0.22.1", "blendmodes==2022", "boltons==23.0.0", "cachetools==5.3.2", "certifi==2023.7.22", "cffi==1.16.0", "charset-normalizer==3.3.1", "clean-fid==0.1.35", "click==8.1.7", "clip-interrogator==0.6.0", "clip==1.0", "colorama==0.4.6", "contourpy==1.1.1", "cssselect2==0.7.0", "cycler==0.12.1", "deprecation==2.1.0", "dynamicprompts==0.29.0", "einops==0.4.1", "exceptiongroup==1.1.3", "facexlib==0.3.0", "fastapi==0.94.0", "ffmpy==0.3.1", "filelock==3.13.0", "filterpy==1.4.5", "flatbuffers==23.5.26", "fonttools==4.43.1", "frozenlist==1.4.0", "fsspec==2023.10.0", "ftfy==6.1.1", "future==0.18.3", "fvcore==0.1.5.post20221221", "gdown==4.7.1", "gfpgan==1.3.8", "gitdb==4.0.11", "gitpython==3.1.32", "google-auth-oauthlib==1.1.0", "google-auth==2.23.3", "gradio-client==0.5.0", "gradio==3.41.2", "grpcio==1.59.0", "h11==0.12.0", "httpcore==0.15.0", "httpx==0.24.1", "huggingface-hub==0.18.0", "idna==3.4", "imageio==2.31.6", "importlib-metadata==6.8.0", "importlib-resources==6.1.0", "inflection==0.5.1", "iopath==0.1.9", "jinja2==3.1.2", "jsonmerge==1.8.0", "jsonschema-specifications==2023.7.1", "jsonschema==4.19.1", "kiwisolver==1.4.5", "kornia==0.6.7", "lark==1.1.2", "lazy-loader==0.3", "lightning-utilities==0.9.0", "llvmlite==0.41.1", "lmdb==1.4.1", "lpips==0.1.4", "lxml==4.9.3", "markdown==3.5", "markupsafe==2.1.3", "matplotlib==3.8.0", "mediapipe==0.10.7", "mpmath==1.3.0", "multidict==6.0.4", "networkx==3.2.1", "numba==0.58.1", "numpy==1.23.5", "oauthlib==3.2.2", "omegaconf==2.2.3", "open-clip-torch==2.20.0", "opencv-contrib-python==4.8.1.78", "opencv-python==4.8.1.78", "orjson==3.9.10", "packaging==23.2", "pandas==2.1.2", "piexif==1.1.3", "pillow==9.5.0", "pip==23.0.1", "platformdirs==3.11.0", "portalocker==2.8.2", "protobuf==3.20.0", "psutil==5.9.5", "pyasn1-modules==0.3.0", "pyasn1==0.5.0", "pycparser==2.21", "pydantic==1.10.13", "pydub==0.25.1", "pyparsing==3.1.1", "pysocks==1.7.1", "python-dateutil==2.8.2", "python-engineio==4.8.0", "python-multipart==0.0.6", "python-socketio==5.7.2", "pytorch-lightning==1.9.4", "pytz==2023.3.post1", "pywavelets==1.4.1", "pywin32==306", "pyyaml==6.0.1", "realesrgan==0.3.0", "referencing==0.30.2", "regex==2023.10.3", "reportlab==4.0.6", "requests-oauthlib==1.3.1", "requests==2.31.0", "resize-right==0.0.2", "rpds-py==0.10.6", "rsa==4.9", "safetensors==0.3.1", "scikit-image==0.21.0", "scipy==1.11.3", "semantic-version==2.10.0", "send2trash==1.8.2", "sentencepiece==0.1.99", "setuptools==65.5.0", "simple-websocket==1.0.0", "six==1.16.0", "smmap==5.0.1", "sniffio==1.3.0", "sounddevice==0.4.6", "soupsieve==2.5", "starlette==0.26.1", "svglib==1.5.1", "sympy==1.12", "tabulate==0.9.0", "tb-nightly==2.16.0a20231027", "tensorboard-data-server==0.7.2", "termcolor==2.3.0", "tifffile==2023.9.26", "timm==0.9.2", "tinycss2==1.2.1", "tokenizers==0.13.3", "tomesd==0.1.3", "tomli==2.0.1", "toolz==0.12.0", "torch==2.0.1+cu118", "torchdiffeq==0.2.3", "torchmetrics==1.2.0", "torchsde==0.2.5", "torchvision==0.15.2+cu118", "tqdm==4.66.1", "trampoline==0.1.2", "transformers==4.30.2", "typing-extensions==4.8.0", "tzdata==2023.3", "urllib3==2.0.7", "uvicorn==0.23.2", "wcwidth==0.2.8", "webencodings==0.5.1", "websocket-client==1.6.4", "websockets==11.0.3", "werkzeug==3.0.1", "wsproto==1.2.0", "xformers==0.0.20", "yacs==0.1.8", "yapf==0.40.2", "yarl==1.9.2", "zipp==3.17.0" ] }

What browsers do you use to access the UI ?

Mozilla Firefox

Console logs

venv "D:\Ai\images\stable-diffusion-webui\venv\Scripts\Python.exe"
Python 3.10.13 | packaged by Anaconda, Inc. | (main, Sep 11 2023, 13:24:38) [MSC v.1916 64 bit (AMD64)]
Version: v1.6.0
Commit hash: 5ef669de080814067961f28357256e8fe27544f4
#######################################################################################################
Initializing Civitai Link
If submitting an issue on github, please provide the below text for debugging purposes:

Python revision: 3.10.13 | packaged by Anaconda, Inc. | (main, Sep 11 2023, 13:24:38) [MSC v.1916 64 bit (AMD64)]
Civitai Link revision: 40cd2985083e8f78331fce3364d29999fc3e34a3
SD-WebUI revision: 5ef669de080814067961f28357256e8fe27544f4

Checking Civitai Link requirements...
[!] python-socketio[client] version 5.7.2 NOT installed.

#######################################################################################################
Launching Web UI with arguments: --xformers --port 7859
2023-10-29 08:41:34,509 - ControlNet - INFO - ControlNet v1.1.411
ControlNet preprocessor location: D:\Ai\images\stable-diffusion-webui\extensions\sd-webui-controlnet\annotator\downloads
2023-10-29 08:41:34,901 - ControlNet - INFO - ControlNet v1.1.411
Civitai: API loaded
Loading weights [d319cb2188] from D:\Ai\images\stable-diffusion-webui\models\Stable-diffusion\babes_20.safetensors
Creating model from config: D:\Ai\images\stable-diffusion-webui\configs\v1-inference.yaml
Running on local URL:  http://127.0.0.1:7859

To create a public link, set `share=True` in `launch()`.
Civitai: Check resources for missing info files
Civitai: Check resources for missing preview images
Startup time: 19.2s (prepare environment: 8.6s, import torch: 3.4s, import gradio: 1.2s, setup paths: 0.8s, initialize shared: 0.2s, other imports: 0.9s, setup codeformer: 0.2s, list SD models: 0.2s, load scripts: 2.3s, create ui: 0.9s, gradio launch: 0.4s).
Civitai: Found 20 resources missing preview images
Civitai: Found 31 resources missing info files
Loading VAE weights specified in settings: D:\Ai\images\stable-diffusion-webui\models\VAE\vae-ft-mse-840000-ema-pruned.safetensors
Civitai: No preview images found on Civitai
Applying attention optimization: xformers... done.
Civitai: No info found on Civitai
No Image data blocks found.
Model loaded in 4.9s (load weights from disk: 1.0s, create model: 0.4s, apply weights to model: 2.0s, load VAE: 0.2s, load textual inversion embeddings: 0.8s, calculate empty prompt: 0.3s).
No Image data blocks found.
No Image data blocks found.
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 60/60 [00:11<00:00,  5.33it/s]

Additional information

No response

freecoderwaifu commented 8 months ago

that prompt

1.6 changed something where that much prompt emphasis is not needed, anything above 1.3 might be too much now. Try lower emphasis, also:

lora:detail_slider_v4:5, lora:emotion_happy_slider_v1:5

That 5 is definitely overcooking. Basically before, all that meme prompt engineering, especially with emphasis, seemed to work by mere chance, now it seems to be working as intended. You can still check in Settings > Compatibility > Use old emphasis implementation and Use old prompt editing timelines, the second one might be currently dev branch only though.