search

vladmandic / automatic

SD.Next: Advanced Implementation of Stable Diffusion and other Diffusion-based generative image models
https://github.com/vladmandic/automatic
GNU Affero General Public License v3.0
5.68k stars 421 forks source link

[Issue]: PonyLoras don't work in XL models #3378

Closed AIstuff69 closed 2 months ago

AIstuff69 commented 2 months ago

Issue Description

There is a problem when loras, designed for ponyXL and XLmodels, don't have effect on final image, generated with ponyXL and XL models. I use diffusers backend to work with XLmodels. But when I use normal models, with original backend, I don't have such problem. In other SD interfaces like A1111 or ComfyUI there isn't this problem too.

bloodoranemix sdnext autismmix

Version Platform Description

Windows 10, Microsoft Edge, NVIDIA laptop GPU 3050 4GB VRAM, 16GB RAM, CPU IntelCore I5-11300H 3.10 Ghz

Relevant log output

2024-08-24 16:10:21,945 | sd | INFO | launch | Starting SD.Next
2024-08-24 16:10:21,961 | sd | INFO | installer | Logger: file="D:\NeuralNetworks\SD-NEXT\automatic-master\automatic-master\automatic\sdnext.log" level=DEBUG size=65 mode=create
2024-08-24 16:10:21,961 | sd | INFO | installer | Python version=3.10.0 platform=Windows bin="D:\NeuralNetworks\SD-NEXT\automatic-master\automatic-master\automatic\venv\Scripts\python.exe" venv="D:\NeuralNetworks\SD-NEXT\automatic-master\automatic-master\automatic\venv"
2024-08-24 16:10:22,436 | sd | INFO | installer | Version: app=sd.next updated=2024-07-24 hash=a874b27e branch=master url=https://github.com/vladmandic/automatic/tree/master ui=main
2024-08-24 16:10:23,328 | sd | INFO | launch | Platform: arch=AMD64 cpu=Intel64 Family 6 Model 140 Stepping 1, GenuineIntel system=Windows release=Windows-10-10.0.19045-SP0 python=3.10.0
2024-08-24 16:10:23,339 | sd | DEBUG | installer | Setting environment tuning
2024-08-24 16:10:23,340 | sd | INFO | installer | HF cache folder: C:\Users\Pakhom_Shepard\.cache\huggingface\hub
2024-08-24 16:10:23,341 | sd | DEBUG | installer | Torch allocator: "garbage_collection_threshold:0.80,max_split_size_mb:512"
2024-08-24 16:10:23,342 | sd | DEBUG | installer | Torch overrides: cuda=False rocm=False ipex=False diml=False openvino=False
2024-08-24 16:10:23,342 | sd | DEBUG | installer | Torch allowed: cuda=True rocm=True ipex=True diml=True openvino=True
2024-08-24 16:10:23,342 | sd | INFO | installer | nVidia CUDA toolkit detected: nvidia-smi present
2024-08-24 16:10:35,056 | sd | INFO | installer | Verifying requirements
2024-08-24 16:10:35,118 | sd | INFO | installer | Verifying packages
2024-08-24 16:10:35,165 | sd | DEBUG | installer | Repository update time: Thu Jul 25 01:16:33 2024
2024-08-24 16:10:35,181 | sd | INFO | launch | Startup: standard
2024-08-24 16:10:35,181 | sd | INFO | installer | Verifying submodules
2024-08-24 16:10:39,717 | sd | DEBUG | installer | Submodule: extensions-builtin/sd-extension-chainner / main
2024-08-24 16:10:39,873 | sd | DEBUG | installer | Submodule: extensions-builtin/sd-extension-system-info / main
2024-08-24 16:10:39,967 | sd | DEBUG | installer | Submodule: extensions-builtin/sd-webui-agent-scheduler / main
2024-08-24 16:10:40,186 | sd | DEBUG | installer | Git detached head detected: folder="extensions-builtin/sdnext-modernui" reattach=main
2024-08-24 16:10:40,186 | sd | DEBUG | installer | Submodule: extensions-builtin/sdnext-modernui / main
2024-08-24 16:10:40,342 | sd | DEBUG | installer | Submodule: extensions-builtin/stable-diffusion-webui-rembg / master
2024-08-24 16:10:40,428 | sd | DEBUG | installer | Submodule: modules/k-diffusion / master
2024-08-24 16:10:40,616 | sd | DEBUG | installer | Git detached head detected: folder="wiki" reattach=master
2024-08-24 16:10:40,631 | sd | DEBUG | installer | Submodule: wiki / master
2024-08-24 16:10:40,694 | sd | DEBUG | paths | Register paths
2024-08-24 16:10:40,741 | sd | DEBUG | installer | Installed packages: 180
2024-08-24 16:10:40,741 | sd | DEBUG | installer | Extensions all: ['Lora', 'sd-extension-chainner', 'sd-extension-system-info', 'sd-webui-agent-scheduler', 'sdnext-modernui', 'stable-diffusion-webui-rembg']
2024-08-24 16:10:40,881 | sd | DEBUG | installer | Running extension installer: D:\NeuralNetworks\SD-NEXT\automatic-master\automatic-master\automatic\extensions-builtin\sd-webui-agent-scheduler\install.py
2024-08-24 16:10:41,230 | sd | DEBUG | installer | Running extension installer: D:\NeuralNetworks\SD-NEXT\automatic-master\automatic-master\automatic\extensions-builtin\stable-diffusion-webui-rembg\install.py
2024-08-24 16:10:41,491 | sd | DEBUG | installer | Extensions all: ['stable-diffusion-webui-composable-lora', 'stable-diffusion-webui-two-shot']
2024-08-24 16:10:41,585 | sd | INFO | installer | Extensions enabled: ['Lora', 'sd-extension-chainner', 'sd-extension-system-info', 'sd-webui-agent-scheduler', 'sdnext-modernui', 'stable-diffusion-webui-rembg', 'stable-diffusion-webui-composable-lora', 'stable-diffusion-webui-two-shot']
2024-08-24 16:10:41,585 | sd | INFO | installer | Verifying requirements
2024-08-24 16:10:41,585 | sd | DEBUG | launch | Setup complete without errors: 1724497842
2024-08-24 16:10:41,632 | sd | DEBUG | installer | Extension preload: {'extensions-builtin': 0.0, 'extensions': 0.0}
2024-08-24 16:10:41,632 | sd | DEBUG | launch | Starting module: <module 'webui' from 'D:\\NeuralNetworks\\SD-NEXT\\automatic-master\\automatic-master\\automatic\\webui.py'>
2024-08-24 16:10:41,632 | sd | INFO | launch | Command line args: ['--autolaunch', '--debug'] autolaunch=True debug=True
2024-08-24 16:10:41,632 | sd | DEBUG | launch | Env flags: []
2024-08-24 16:10:55,863 | sd | INFO | loader | Load packages: {'torch': '2.4.0+cu121', 'diffusers': '0.29.1', 'gradio': '3.43.2'}
2024-08-24 16:10:58,608 | sd | INFO | shared | VRAM: Detected=4.0 GB Optimization=lowvram
2024-08-24 16:10:58,608 | sd | DEBUG | shared | Read: file="config.json" json=44 bytes=2145 time=0.000
2024-08-24 16:10:58,608 | sd | INFO | shared | Engine: backend=Backend.DIFFUSERS compute=cuda device=cuda attention="xFormers" mode=no_grad
2024-08-24 16:10:58,670 | sd | INFO | shared | Device: device=NVIDIA GeForce RTX 3050 Laptop GPU n=1 arch=sm_90 cap=(8, 6) cuda=12.1 cudnn=90100 driver=546.33
2024-08-24 16:10:58,702 | sd | DEBUG | shared | Read: file="html\reference.json" json=45 bytes=25986 time=0.031
2024-08-24 16:11:02,506 | sd | DEBUG | __init__ | ONNX: version=1.19.0 provider=CUDAExecutionProvider, available=['AzureExecutionProvider', 'CPUExecutionProvider']
2024-08-24 16:11:04,412 | sd | DEBUG | sd_hijack | Importing LDM
2024-08-24 16:11:04,473 | sd | DEBUG | webui | Entering start sequence
2024-08-24 16:11:04,473 | sd | DEBUG | webui | Initializing
2024-08-24 16:11:04,627 | sd | INFO | sd_vae | Available VAEs: path="D:\NeuralNetworks\stable-diffusion-portable-main (1)\stable-diffusion-portable-main\models\VAE" items=5
2024-08-24 16:11:04,627 | sd | DEBUG | sd_unet | Available UNets: path="models\UNET" items=0
2024-08-24 16:11:04,637 | sd | INFO | extensions | Disabled extensions: ['sdnext-modernui']
2024-08-24 16:11:04,677 | sd | DEBUG | shared | Read: file="cache.json" json=2 bytes=2087 time=0.040
2024-08-24 16:11:04,737 | sd | DEBUG | shared | Read: file="metadata.json" json=534 bytes=1186665 time=0.050
2024-08-24 16:11:04,747 | sd | DEBUG | modelloader | Scanning diffusers cache: folder=models\Diffusers items=0 time=0.00
2024-08-24 16:11:04,757 | sd | INFO | sd_models | Available models: path="D:\NeuralNetworks\stable-diffusion-portable-main (1)\stable-diffusion-portable-main\models\Stable-diffusion" items=116 time=0.12
2024-08-24 16:11:06,098 | sd | DEBUG | webui | Load extensions
2024-08-24 16:11:06,273 | sd | INFO | networks | LoRA networks: available=150 folders=4
2024-08-24 16:11:06,273 | sd | INFO | script_loading | Extension: script='extensions-builtin\Lora\scripts\lora_script.py' 16:11:06-273013 INFO     LoRA networks: available=150 folders=4
2024-08-24 16:11:07,675 | sd | INFO | script_loading | Extension: script='extensions-builtin\sd-webui-agent-scheduler\scripts\task_scheduler.py' Using sqlite file: extensions-builtin\sd-webui-agent-scheduler\task_scheduler.sqlite3
2024-08-24 16:11:07,988 | sd | DEBUG | webui | Extensions init time: 1.89 Lora=0.13 sd-extension-chainner=0.19 sd-webui-agent-scheduler=1.22 stable-diffusion-webui-composable-lora=0.25
2024-08-24 16:11:08,019 | sd | DEBUG | shared | Read: file="html/upscalers.json" json=4 bytes=2672 time=0.016
2024-08-24 16:11:08,034 | sd | DEBUG | shared | Read: file="extensions-builtin\sd-extension-chainner\models.json" json=24 bytes=2719 time=0.000
2024-08-24 16:11:08,050 | sd | DEBUG | chainner_model | chaiNNer models: path="models\chaiNNer" defined=24 discovered=0 downloaded=0
2024-08-24 16:11:08,050 | sd | DEBUG | modelloader | Load upscalers: total=53 downloaded=0 user=0 time=0.06 ['None', 'Lanczos', 'Nearest', 'ChaiNNer', 'AuraSR', 'ESRGAN', 'LDSR', 'RealESRGAN', 'SCUNet', 'SD', 'SwinIR']
2024-08-24 16:11:08,097 | sd | DEBUG | styles | Load styles: folder="models\styles" items=288 time=0.05
2024-08-24 16:11:08,113 | sd | DEBUG | webui | Creating UI
2024-08-24 16:11:08,113 | sd | DEBUG | theme | UI themes available: type=Standard themes=12
2024-08-24 16:11:08,113 | sd | INFO | theme | UI theme: type=Standard name="black-teal"
2024-08-24 16:11:08,128 | sd | DEBUG | ui_javascript | UI theme: css="D:\NeuralNetworks\SD-NEXT\automatic-master\automatic-master\automatic\javascript\black-teal.css" base="sdnext.css" user="user.css"
2024-08-24 16:11:08,128 | sd | DEBUG | ui_txt2img | UI initialize: txt2img
2024-08-24 16:11:08,738 | sd | DEBUG | ui_extra_networks | Networks: page='model' items=160 subfolders=2 tab=txt2img folders=['D:\\NeuralNetworks\\stable-diffusion-portable-main (1)\\stable-diffusion-portable-main\\models\\Stable-diffusion', 'models\\Diffusers', 'models\\Reference'] list=0.31 thumb=0.00 desc=0.02 info=1.02 workers=4 sort=Default
2024-08-24 16:11:08,753 | sd | DEBUG | ui_extra_networks | Networks: page='lora' items=150 subfolders=0 tab=txt2img folders=['D:\\NeuralNetworks\\stable-diffusion-portable-main (1)\\stable-diffusion-portable-main\\models\\Lora', 'models\\LyCORIS'] list=0.58 thumb=0.00 desc=0.03 info=1.55 workers=4 sort=Default
2024-08-24 16:11:08,785 | sd | DEBUG | ui_extra_networks | Networks: page='style' items=288 subfolders=1 tab=txt2img folders=['models\\styles', 'html'] list=0.17 thumb=0.00 desc=0.00 info=0.00 workers=4 sort=Default
2024-08-24 16:11:08,785 | sd | DEBUG | ui_extra_networks | Networks: page='embedding' items=0 subfolders=0 tab=txt2img folders=['models\\embeddings'] list=0.00 thumb=0.00 desc=0.00 info=0.00 workers=4 sort=Default
2024-08-24 16:11:08,785 | sd | DEBUG | ui_extra_networks | Networks: page='vae' items=5 subfolders=0 tab=txt2img folders=['D:\\NeuralNetworks\\stable-diffusion-portable-main (1)\\stable-diffusion-portable-main\\models\\VAE'] list=0.17 thumb=0.16 desc=0.02 info=0.00 workers=4 sort=Default
2024-08-24 16:11:08,800 | sd | DEBUG | ui_extra_networks | Networks: page='hypernetwork' items=0 subfolders=0 tab=txt2img folders=['models\\hypernetworks'] list=0.00 thumb=0.00 desc=0.00 info=0.00 workers=4 sort=Default
2024-08-24 16:11:08,894 | sd | DEBUG | ui_img2img | UI initialize: img2img
2024-08-24 16:11:09,003 | sd | DEBUG | ui_control_helpers | UI initialize: control models=models\control
2024-08-24 16:11:09,571 | sd | DEBUG | shared | Read: file="ui-config.json" json=0 bytes=2 time=0.000
2024-08-24 16:11:09,774 | sd | DEBUG | theme | UI themes available: type=Standard themes=12
2024-08-24 16:11:09,946 | sd | DEBUG | shared | Reading failed: D:\NeuralNetworks\SD-NEXT\automatic-master\automatic-master\automatic\html\extensions.json [Errno 2] No such file or directory: 'D:\\NeuralNetworks\\SD-NEXT\\automatic-master\\automatic-master\\automatic\\html\\extensions.json'
2024-08-24 16:11:09,946 | sd | INFO | ui_extensions | Extension list is empty: refresh required
2024-08-24 16:11:11,000 | sd | DEBUG | ui_extensions | Extension list: processed=8 installed=8 enabled=7 disabled=1 visible=8 hidden=0
2024-08-24 16:11:11,297 | sd | DEBUG | webui | Root paths: ['D:\\NeuralNetworks\\SD-NEXT\\automatic-master\\automatic-master\\automatic']
2024-08-24 16:11:11,673 | sd | INFO | webui | Local URL: http://127.0.0.1:7860/
2024-08-24 16:11:11,673 | sd | DEBUG | webui | Gradio functions: registered=1712
2024-08-24 16:11:11,735 | sd | DEBUG | middleware | FastAPI middleware: ['Middleware', 'Middleware']
2024-08-24 16:11:11,751 | sd | DEBUG | webui | Creating API
2024-08-24 16:11:11,907 | sd | INFO | task_runner | [AgentScheduler] Task queue is empty
2024-08-24 16:11:11,907 | sd | INFO | api | [AgentScheduler] Registering APIs
2024-08-24 16:11:12,001 | sd | DEBUG | webui | Scripts setup: ['IP Adapters:0.016', 'AnimateDiff:0.031', 'X/Y/Z Grid:0.016', 'Face:0.016', 'Loopback:0.016', 'Outpainting alternative:0.016']
2024-08-24 16:11:12,016 | sd | DEBUG | sd_models | Model metadata: file="metadata.json" no changes
2024-08-24 16:11:12,016 | sd | DEBUG | devices | Torch mode: deterministic=False
2024-08-24 16:11:12,048 | sd | DEBUG | devices | Desired Torch parameters: dtype=FP16 no-half=False no-half-vae=False upscast=False
2024-08-24 16:11:12,048 | sd | INFO | devices | Setting Torch parameters: device=cuda dtype=torch.float16 vae=torch.float16 unet=torch.float16 context=no_grad fp16=True bf16=None optimization=xFormers
2024-08-24 16:11:12,048 | sd | DEBUG | modeldata | Model requested: fn=<lambda>
2024-08-24 16:11:12,063 | sd | INFO | sd_models | Select: model="autismmixSDXL_autismmixConfetti [ac006fdd7e]"
2024-08-24 16:11:12,063 | sd | DEBUG | sd_models | Load model: existing=False target=D:\NeuralNetworks\stable-diffusion-portable-main (1)\stable-diffusion-portable-main\models\Stable-diffusion\autismmixSDXL_autismmixConfetti.safetensors info=None
2024-08-24 16:11:12,063 | sd | INFO | sd_vae | Loading VAE: model=D:\NeuralNetworks\stable-diffusion-portable-main (1)\stable-diffusion-portable-main\models\VAE\sdxl_vae.safetensors source=settings
2024-08-24 16:11:12,063 | sd | DEBUG | sd_vae | Diffusers VAE load config: {'low_cpu_mem_usage': False, 'torch_dtype': torch.float16, 'use_safetensors': True, 'variant': 'fp16'}
2024-08-24 16:11:12,063 | sd | INFO | sd_models | Autodetect: vae="Stable Diffusion XL" class=StableDiffusionXLPipeline file="D:\NeuralNetworks\stable-diffusion-portable-main (1)\stable-diffusion-portable-main\models\Stable-diffusion\autismmixSDXL_autismmixConfetti.safetensors" size=6617MB
2024-08-24 16:11:18,131 | sd | DEBUG | sd_models | Diffusers loading: path="D:\NeuralNetworks\stable-diffusion-portable-main (1)\stable-diffusion-portable-main\models\Stable-diffusion\autismmixSDXL_autismmixConfetti.safetensors"
2024-08-24 16:11:18,146 | sd | INFO | sd_models | Autodetect: model="Stable Diffusion XL" class=StableDiffusionXLPipeline file="D:\NeuralNetworks\stable-diffusion-portable-main (1)\stable-diffusion-portable-main\models\Stable-diffusion\autismmixSDXL_autismmixConfetti.safetensors" size=6617MB
2024-08-24 16:11:23,503 | sd | DEBUG | sd_models | Setting model: pipeline=StableDiffusionXLPipeline config={'low_cpu_mem_usage': True, 'torch_dtype': torch.float16, 'load_connected_pipeline': True, 'extract_ema': False, 'config': 'configs/sdxl', 'use_safetensors': True, 'cache_dir': 'C:\\Users\\Pakhom_Shepard\\.cache\\huggingface\\hub'}
2024-08-24 16:11:23,503 | sd | INFO | textual_inversion | Load embeddings: loaded=0 skipped=0 time=0.00
2024-08-24 16:11:23,519 | sd | DEBUG | sd_models | Setting model VAE: name=sdxl_vae.safetensors
2024-08-24 16:11:23,707 | sd | DEBUG | sd_models | Setting model: enable model CPU offload
2024-08-24 16:11:23,754 | sd | DEBUG | shared | Read: file="D:\NeuralNetworks\SD-NEXT\automatic-master\automatic-master\automatic\configs\sdxl\vae\config.json" json=15 bytes=674 time=0.000
2024-08-24 16:11:23,973 | sd | DEBUG | devices | GC: utilization={'gpu': 19, 'ram': 11, 'threshold': 80} gc={'collected': 127, 'saved': 0.0} before={'gpu': 0.77, 'ram': 1.72} after={'gpu': 0.77, 'ram': 1.72, 'retries': 0, 'oom': 0} device=cuda fn=load_diffuser time=0.2
2024-08-24 16:11:23,988 | sd | INFO | sd_models | Load model: time=11.71 load=11.44 options=0.19 move=0.06 native=512 {'ram': {'used': 1.72, 'total': 15.7}, 'gpu': {'used': 0.77, 'total': 4.0}, 'retries': 0, 'oom': 0}
2024-08-24 16:11:23,988 | sd | DEBUG | script_callbacks | Script callback init time: system-info.py:app_started=0.06 task_scheduler.py:app_started=0.11
2024-08-24 16:11:23,988 | sd | INFO | webui | Startup time: 42.34 torch=8.04 gradio=4.95 diffusers=1.23 libraries=8.54 ldm=0.07 samplers=0.15 extensions=1.89 models=0.12 face-restore=1.34 upscalers=0.06 networks=0.06 ui-en=0.80 ui-txt2img=0.06 ui-img2img=0.08 ui-control=0.09 ui-models=0.33 ui-settings=0.36 ui-extensions=1.12 launch=0.67 api=0.08 app-started=0.17 checkpoint=11.99
2024-08-24 16:11:23,988 | sd | DEBUG | shared | Save: file="config.json" json=44 bytes=2084 time=0.000
2024-08-24 16:11:24,004 | sd | INFO | webui | Launching browser
2024-08-24 16:11:26,317 | sd | INFO | server | MOTD: N/A
2024-08-24 16:11:28,416 | sd | DEBUG | theme | UI themes available: type=Standard themes=12
2024-08-24 16:11:28,633 | sd | INFO | api | Browser session: user=None client=127.0.0.1 agent=Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/128.0.0.0 Safari/537.36 Edg/128.0.0.0
2024-08-24 16:12:00,351 | sd | DEBUG | launch | Server: alive=True jobs=1 requests=25 uptime=63 memory=1.74/15.7 backend=Backend.DIFFUSERS state=idle
2024-08-24 16:14:00,117 | sd | DEBUG | launch | Server: alive=True jobs=1 requests=49 uptime=183 memory=1.74/15.7 backend=Backend.DIFFUSERS state=idle
2024-08-24 16:14:21,232 | sd | DEBUG | generation_parameters_copypaste | Paste prompt: type="params" prompt="<lora:AliceLoraV1:1.0>, young girl, school uniform , best quality 
Negative prompt: bad quality, worst quality
Steps: 30, Seed: 1958486417, Sampler: DPM++ 2M, CFG scale: 15, Size: 512x760, Parser: Full parser, Model: bloodorangemixNSFW_bloodorangemixHalf, Model hash: 539ff8f563, VAE: Grapefruit.vae, Backend: Original, App: SD.Next, Version: a874b27, Operations: txt2img, Sampler karras: False, Sampler quantization: False, Lora hashes: "AliceLoraV1: be23e126""
2024-08-24 16:15:04,546 | sd | INFO | extra_networks_lora | LoRA apply: ['AliceLora_PonyV1'] patch=0.00 load=7.70
2024-08-24 16:15:04,635 | sd | INFO | processing_diffusers | Base: class=StableDiffusionXLPipeline
2024-08-24 16:15:04,764 | sd | DEBUG | sd_samplers | Sampler: sampler="DPM++ 2M" config={'num_train_timesteps': 1000, 'beta_start': 0.00085, 'beta_end': 0.012, 'beta_schedule': 'scaled_linear', 'prediction_type': 'epsilon', 'thresholding': False, 'sample_max_value': 1.0, 'algorithm_type': 'sde-dpmsolver++', 'solver_type': 'midpoint', 'lower_order_final': True, 'use_karras_sigmas': False, 'final_sigmas_type': 'zero', 'timestep_spacing': 'linspace', 'solver_order': 2}
2024-08-24 16:15:20,354 | sd | DEBUG | processing_helpers | Torch generator: device=cuda seeds=[1958486417]
2024-08-24 16:15:20,358 | sd | DEBUG | processing_args | Diffuser pipeline: StableDiffusionXLPipeline task=DiffusersTaskType.TEXT_2_IMAGE batch=1/1x1 set={'prompt_embeds': torch.Size([1, 77, 2048]), 'pooled_prompt_embeds': torch.Size([1, 1280]), 'negative_prompt_embeds': torch.Size([1, 77, 2048]), 'negative_pooled_prompt_embeds': torch.Size([1, 1280]), 'guidance_scale': 15, 'num_inference_steps': 30, 'eta': 1.0, 'guidance_rescale': 0.7, 'denoising_end': None, 'output_type': 'latent', 'width': 512, 'height': 760, 'parser': 'Full parser'}
2024-08-24 16:15:59,630 | sd | DEBUG | launch | Server: alive=True jobs=1 requests=202 uptime=302 memory=10.58/15.7 backend=Backend.DIFFUSERS state=idle
2024-08-24 16:17:39,408 | sd | DEBUG | sd_vae_approx | VAE load: type=approximate model=models\VAE-approx\model.pt
2024-08-24 16:17:59,988 | sd | DEBUG | launch | Server: alive=True jobs=1 requests=364 uptime=422 memory=9.95/15.7 backend=Backend.DIFFUSERS state=idle
2024-08-24 16:19:59,766 | sd | DEBUG | launch | Server: alive=True jobs=1 requests=387 uptime=542 memory=7.26/15.7 backend=Backend.DIFFUSERS state=idle
2024-08-24 16:22:00,034 | sd | DEBUG | launch | Server: alive=True jobs=1 requests=487 uptime=662 memory=7.07/15.7 backend=Backend.DIFFUSERS state=idle
2024-08-24 16:22:25,739 | sd | INFO | images | Save: image="outputs\text\00109-autismmixSDXL_autismmixConfetti-AliceLora PonyV1 young girl school uniform best quality.jpg" type=JPEG resolution=512x760 size=81796
2024-08-24 16:22:25,754 | sd | INFO | processing | Processed: images=1 time=448.92 its=0.07 memory={'ram': {'used': 4.73, 'total': 15.7}, 'gpu': {'used': 1.35, 'total': 4.0}, 'retries': 0, 'oom': 0}
2024-08-24 16:24:00,218 | sd | DEBUG | launch | Server: alive=True jobs=1 requests=562 uptime=783 memory=4.73/15.7 backend=Backend.DIFFUSERS state=idle
2024-08-24 16:24:07,783 | sd | INFO | extra_networks_lora | LoRA apply: ['AliceLora_PonyV1'] patch=0.00 load=0.00
2024-08-24 16:24:07,791 | sd | INFO | processing_diffusers | Base: class=StableDiffusionXLPipeline
2024-08-24 16:24:08,480 | sd | DEBUG | sd_samplers | Sampler: sampler="DPM++ 2M" config={'num_train_timesteps': 1000, 'beta_start': 0.00085, 'beta_end': 0.012, 'beta_schedule': 'scaled_linear', 'prediction_type': 'epsilon', 'thresholding': False, 'sample_max_value': 1.0, 'algorithm_type': 'sde-dpmsolver++', 'solver_type': 'midpoint', 'lower_order_final': True, 'use_karras_sigmas': False, 'final_sigmas_type': 'zero', 'timestep_spacing': 'linspace', 'solver_order': 2}
2024-08-24 16:24:08,579 | sd | DEBUG | processing_helpers | Torch generator: device=cuda seeds=[1958486417]
2024-08-24 16:24:08,585 | sd | DEBUG | processing_args | Diffuser pipeline: StableDiffusionXLPipeline task=DiffusersTaskType.TEXT_2_IMAGE batch=1/1x1 set={'prompt_embeds': torch.Size([1, 77, 2048]), 'pooled_prompt_embeds': torch.Size([1, 1280]), 'negative_prompt_embeds': torch.Size([1, 77, 2048]), 'negative_pooled_prompt_embeds': torch.Size([1, 1280]), 'guidance_scale': 15, 'num_inference_steps': 30, 'eta': 1.0, 'guidance_rescale': 0.7, 'denoising_end': None, 'output_type': 'latent', 'width': 512, 'height': 760, 'parser': 'Full parser'}
2024-08-24 16:25:59,883 | sd | DEBUG | launch | Server: alive=True jobs=1 requests=651 uptime=902 memory=6.84/15.7 backend=Backend.DIFFUSERS state=idle
2024-08-24 16:27:59,702 | sd | DEBUG | launch | Server: alive=True jobs=1 requests=675 uptime=1022 memory=6.86/15.7 backend=Backend.DIFFUSERS state=idle
2024-08-24 16:29:59,591 | sd | DEBUG | launch | Server: alive=True jobs=1 requests=755 uptime=1142 memory=6.77/15.7 backend=Backend.DIFFUSERS state=idle
2024-08-24 16:31:14,433 | sd | DEBUG | devices | GC: utilization={'gpu': 94, 'ram': 35, 'threshold': 80} gc={'collected': 854, 'saved': 2.59} before={'gpu': 3.74, 'ram': 5.42} after={'gpu': 1.15, 'ram': 5.71, 'retries': 0, 'oom': 0} device=cuda fn=vae_decode time=2.63
2024-08-24 16:31:17,824 | sd | INFO | images | Save: image="outputs\text\00110-autismmixSDXL_autismmixConfetti-AliceLora PonyV1 young girl school uniform best quality.jpg" type=JPEG resolution=512x760 size=81796
2024-08-24 16:31:17,835 | sd | INFO | processing | Processed: images=1 time=430.14 its=0.07 memory={'ram': {'used': 5.72, 'total': 15.7}, 'gpu': {'used': 1.15, 'total': 4.0}, 'retries': 0, 'oom': 0}
2024-08-24 16:31:59,691 | sd | DEBUG | launch | Server: alive=True jobs=1 requests=803 uptime=1262 memory=5.43/15.7 backend=Backend.DIFFUSERS state=idle

Backend

Diffusers

UI

Standard

Branch

Master

Model

StableDiffusion XL

Acknowledgements

vladmandic commented 2 months ago

when making a statement like that, please provide a link to actual model and Lora so it can be reproduced without guesswork.

AIstuff69 commented 2 months ago

Sorry for lack of this data. This is my first issue post at github. Here is autismmixSDXL model https://civitai.com/models/288584/autismmix-sdxl Here is bloodorangemix model https://civitai.com/models/7926/bloodorangemix-nsfw-bloodorangemixhalf Here is AliceLora https://civitai.com/models/6494?modelVersionId=7621

brknsoul commented 2 months ago

PonyXL models require score prompts instead of quality prompts.

Positive prompt should start with: score_9, score_8_up, score_7_up, score_6_up Negative prompt should contain: score_1, score_2, score_3, score_4

Finally, your prompt is missing the LoRA's trigger phrase: AliceDV, short hair, short twintails, orange hair, orange eyes, hair ornament.

Please remember to read the description of LoRAs you download.

Example: Pos: score_9, score_8_up, score_7_up, score_6_up, <lora:AliceLora_PonyV1:0.7> AliceDV, short hair, short twintails, orange hair, orange eyes, hair ornament, White collared shirt, red neckerchief, blue skirt, belt, white socks, black shoes Neg: score_1, score_2, score_3, score_4

00002-20240825115230-1586993864-score 9 score 8 up score 7 up

AIstuff69 commented 2 months ago

Oh, my bad! It was really so simple... Thank you very much! I'm sorry for bothering you with such dumb issue. AutismSDXL AlicePonylora normal