[Bug]: SGM Uniform and Uniform produces visual artifacts

AndreyRGW commented 2 months ago

Checklist

[ ] The issue exists after disabling all extensions
[X] The issue exists on a clean installation of webui
[ ] The issue is caused by an extension, but I believe it is caused by a bug in the webui
[ ] The issue exists in the current version of the webui
[X] The issue has not been reported before recently
[ ] The issue has been reported before but has not been fixed yet

What happened?

Uniform artifacts Karras no artifacts

I'm using DreamShaperXL v21 Turbo, with cfg 2. Euler A for firts pass and dpm 2 for hires pass.

Steps to reproduce the problem

Write a prompt
Set SGM Uniform or Uniform as scheduler
Generate

What should have happened?

No artifacts?

What browsers do you use to access the UI ?

No response

Sysinfo

sysinfo-2024-03-27-20-41.json

Console logs

venv "C:\wbcnvme\stable-diffusion-webui\venv\Scripts\Python.exe"
Python 3.10.11 (tags/v3.10.11:7d4cc5a, Apr  5 2023, 00:38:17) [MSC v.1929 64 bit (AMD64)]
Version: v1.8.0-273-g8687163f
Commit hash: 8687163f7fe28fae23131726094d4bee32db51bb
CUDA 12.1
Launching Web UI with arguments: --xformers
ControlNet preprocessor location: C:\wbcnvme\stable-diffusion-webui\extensions\sd-webui-controlnet\annotator\downloads
2024-03-27 23:24:53,144 - ControlNet - INFO - ControlNet v1.1.442
2024-03-27 23:24:53,224 - ControlNet - INFO - ControlNet v1.1.442
[sd-webui-freeu] Controlnet support: *enabled*
23:24:53 - ReActor - STATUS - Running v0.7.0-b7 on Device: CUDA
[Vec. CC] Style Sheet Loaded...
Loading weights [4496b36d48] from C:\wbcnvme\stable-diffusion-webui\models\Stable-diffusion\dreamshaperXL_v21TurboDPMSDE.safetensors
2024-03-27 23:24:53,946 - ControlNet - INFO - ControlNet UI callback registered.
Creating model from config: C:\wbcnvme\stable-diffusion-webui\repositories\generative-models\configs\inference\sd_xl_base.yaml
Running on local URL:  http://127.0.0.1:7860

Thanks for being a Gradio user! If you have questions or feedback, please join our Discord server and chat with us: https://discord.gg/feTf9x3ZSB

To create a public link, set `share=True` in `launch()`.
Startup time: 13.4s (prepare environment: 4.1s, import torch: 3.7s, import gradio: 0.8s, setup paths: 0.8s, initialize shared: 0.2s, other imports: 0.4s, load scripts: 2.0s, create ui: 0.6s, gradio launch: 0.7s).
Applying attention optimization: xformers... done.
Model loaded in 11.8s (load weights from disk: 0.7s, create model: 0.8s, apply weights to model: 7.4s, apply fp8: 2.3s, calculate empty prompt: 0.3s).

100%|████████████████████████████████████████████████████████████████████████████████████| 8/8 [00:05<00:00,  1.38it/s]
100%|████████████████████████████████████████████████████████████████████████████████████| 4/4 [00:04<00:00,  1.23s/it]
Total progress: 100%|██████████████████████████████████████████████████████████████████| 12/12 [03:04<00:00, 15.41s/it]
100%|████████████████████████████████████████████████████████████████████████████████████| 8/8 [00:05<00:00,  1.58it/s]
100%|████████████████████████████████████████████████████████████████████████████████████| 4/4 [00:04<00:00,  1.21s/it]
Total progress: 100%|██████████████████████████████████████████████████████████████████| 12/12 [00:13<00:00,  1.08s/it]
100%|████████████████████████████████████████████████████████████████████████████████████| 8/8 [00:05<00:00,  1.57it/s]
100%|████████████████████████████████████████████████████████████████████████████████████| 4/4 [00:04<00:00,  1.20s/it]
Total progress: 100%|██████████████████████████████████████████████████████████████████| 12/12 [00:13<00:00,  1.12s/it]
100%|████████████████████████████████████████████████████████████████████████████████████| 8/8 [00:05<00:00,  1.59it/s]
100%|████████████████████████████████████████████████████████████████████████████████████| 4/4 [00:04<00:00,  1.25s/it]
Total progress: 100%|██████████████████████████████████████████████████████████████████| 12/12 [00:13<00:00,  1.15s/it]
100%|████████████████████████████████████████████████████████████████████████████████████| 8/8 [00:04<00:00,  1.63it/s]
100%|████████████████████████████████████████████████████████████████████████████████████| 4/4 [00:04<00:00,  1.20s/it]
Total progress: 100%|██████████████████████████████████████████████████████████████████| 12/12 [00:13<00:00,  1.13s/it]
100%|████████████████████████████████████████████████████████████████████████████████████| 8/8 [00:05<00:00,  1.58it/s]
100%|████████████████████████████████████████████████████████████████████████████████████| 4/4 [00:04<00:00,  1.21s/it]
Total progress: 100%|██████████████████████████████████████████████████████████████████| 12/12 [00:13<00:00,  1.14s/it]

Additional information

I'm using latest dev commit 8687163f7fe28fae23131726094d4bee32db51bb

Juqowel commented 2 months ago

What should have happened?

No artifacts?

Nope. It's normal behavior.

AndreyRGW commented 2 months ago

What should have happened?

No artifacts?

Nope. It's normal behavior.

You think so? I think there are TOO MANY artifacts here.

Juqowel commented 2 months ago

You think so? I think there are TOO MANY artifacts here.

That's how it works with this model.

LaptopDev commented 1 month ago

how do you change the scheduler? I am trying to get sdxl lightning up with the same configurations.

AUTOMATIC1111 / stable-diffusion-webui