[Issue]: Control fails with image batch size must be same as prompt batch size

[gohan2091]

Issue Description

I generated an image that is 512 x 768 using a 1.5 model in Text2Image. My goal is to generate new images using the same prompt but based on a depth mask.

Under ControlNet model, I select “Depth”. Under processor, I've selected both “Leres Depth” and "Zoe Depth". The input type is set to “control only”. The image dimensions are set to the size of the uploaded image (512 x 768). It’s on BEFORE option. When I click generate, I get an error. Video of this shown here: https://file.io/1bnAvWWbQUs7

I change the model and processor to Canny but the generation fails with the same error as above. Now I had this partially working a few days ago and I am not sure why now it’s not working but Control menu for me has always been hugely problematic. I also tried "Marigold Depth" paired with what I think should be the Depth model? The preview works when I click generate, I get an error.

Version Platform Description

Dev Branch 29/01/24 and then 30/01/24. Windows 11 23H2, Firefox and Chrome

Relevant log output

2024-01-30 15:14:11,029 | sd | INFO | launch | Starting SD.Next
2024-01-30 15:14:11,032 | sd | INFO | installer | Logger: file="C:\Users\USER\SD.Next\automatic\sdnext.log" level=INFO size=65 mode=append
2024-01-30 15:14:11,033 | sd | INFO | installer | Python 3.11.7 on Windows
2024-01-30 15:14:11,158 | sd | INFO | installer | Version: app=sd.next updated=2024-01-30 hash=20b5d952 url=https://github.com/vladmandic/automatic/tree/dev
2024-01-30 15:14:11,721 | sd | INFO | installer | Latest published version: 9bf08c5493925b6ddb3451f6a6e00460ca92aedd 2024-01-30T14:29:51Z
2024-01-30 15:14:11,727 | sd | INFO | launch | Platform: arch=AMD64 cpu=AMD64 Family 25 Model 33 Stepping 0, AuthenticAMD system=Windows release=Windows-10-10.0.22631-SP0 python=3.11.7
2024-01-30 15:14:11,729 | sd | DEBUG | installer | Setting environment tuning
2024-01-30 15:14:11,729 | sd | DEBUG | installer | HF cache folder: C:\Users\USER\.cache\huggingface\hub
2024-01-30 15:14:11,729 | sd | DEBUG | installer | Torch overrides: cuda=False rocm=False ipex=False diml=False openvino=False
2024-01-30 15:14:11,729 | sd | DEBUG | installer | Torch allowed: cuda=True rocm=True ipex=True diml=True openvino=True
2024-01-30 15:14:11,731 | sd | INFO | installer | nVidia CUDA toolkit detected: nvidia-smi present
2024-01-30 15:14:11,784 | sd | WARNING | installer | Modified files: ['scripts/detect_extension.py']
2024-01-30 15:14:11,821 | sd | DEBUG | installer | Repository update time: Tue Jan 30 13:02:45 2024
2024-01-30 15:14:11,821 | sd | INFO | launch | Startup: standard
2024-01-30 15:14:11,822 | sd | INFO | installer | Verifying requirements
2024-01-30 15:14:11,832 | sd | INFO | installer | Verifying packages
2024-01-30 15:14:11,834 | sd | INFO | installer | Verifying submodules
2024-01-30 15:14:14,010 | sd | DEBUG | installer | Submodule: extensions-builtin/sd-extension-chainner / main
2024-01-30 15:14:14,068 | sd | DEBUG | installer | Submodule: extensions-builtin/sd-extension-system-info / main
2024-01-30 15:14:14,125 | sd | DEBUG | installer | Submodule: extensions-builtin/sd-webui-agent-scheduler / main
2024-01-30 15:14:14,187 | sd | DEBUG | installer | Submodule: extensions-builtin/sd-webui-controlnet / main
2024-01-30 15:14:14,301 | sd | DEBUG | installer | Submodule: extensions-builtin/stable-diffusion-webui-images-browser / main
2024-01-30 15:14:14,357 | sd | DEBUG | installer | Submodule: extensions-builtin/stable-diffusion-webui-rembg / master
2024-01-30 15:14:14,417 | sd | DEBUG | installer | Submodule: modules/k-diffusion / master
2024-01-30 15:14:14,490 | sd | DEBUG | installer | Submodule: modules/lora / main
2024-01-30 15:14:14,581 | sd | DEBUG | installer | Submodule: wiki / master
2024-01-30 15:14:14,623 | sd | DEBUG | paths | Register paths
2024-01-30 15:14:14,743 | sd | DEBUG | installer | Installed packages: 239
2024-01-30 15:14:14,743 | sd | DEBUG | installer | Extensions all: ['clip-interrogator-ext', 'Lora', 'sd-extension-chainner', 'sd-extension-system-info', 'sd-webui-agent-scheduler', 'stable-diffusion-webui-images-browser', 'stable-diffusion-webui-rembg']
2024-01-30 15:14:14,744 | sd | DEBUG | installer | Running extension installer: C:\Users\USER\SD.Next\automatic\extensions-builtin\clip-interrogator-ext\install.py
2024-01-30 15:14:18,434 | sd | DEBUG | installer | Running extension installer: C:\Users\USER\SD.Next\automatic\extensions-builtin\sd-extension-system-info\install.py
2024-01-30 15:14:18,811 | sd | DEBUG | installer | Running extension installer: C:\Users\USER\SD.Next\automatic\extensions-builtin\sd-webui-agent-scheduler\install.py
2024-01-30 15:14:19,186 | sd | DEBUG | installer | Running extension installer: C:\Users\USER\SD.Next\automatic\extensions-builtin\stable-diffusion-webui-images-browser\install.py
2024-01-30 15:14:19,559 | sd | DEBUG | installer | Running extension installer: C:\Users\USER\SD.Next\automatic\extensions-builtin\stable-diffusion-webui-rembg\install.py
2024-01-30 15:14:19,933 | sd | DEBUG | installer | Extensions all: ['adetailer', 'canvas-zoom', 'OneButtonPrompt', 'openpose-editor', 'sd-dynamic-prompts', 'sd-webui-3d-open-pose-editor', 'sd-webui-aspect-ratio-helper', 'sd-webui-infinite-image-browsing', 'sd-webui-inpaint-anything', 'sd-webui-photopea-embed', 'sd-webui-reactor', 'sdwebui-close-confirmation-dialogue', 'stable-diffusion-webui-two-shot', 'ultimate-upscale-for-automatic1111']
2024-01-30 15:14:19,934 | sd | DEBUG | installer | Running extension installer: C:\Users\USER\SD.Next\automatic\extensions\adetailer\install.py
2024-01-30 15:14:20,321 | sd | DEBUG | installer | Running extension installer: C:\Users\USER\SD.Next\automatic\extensions\canvas-zoom\install.py
2024-01-30 15:14:22,943 | sd | DEBUG | installer | Running extension installer: C:\Users\USER\SD.Next\automatic\extensions\sd-dynamic-prompts\install.py
2024-01-30 15:14:23,342 | sd | DEBUG | installer | Running extension installer: C:\Users\USER\SD.Next\automatic\extensions\sd-webui-3d-open-pose-editor\install.py
2024-01-30 15:14:23,718 | sd | DEBUG | installer | Running extension installer: C:\Users\USER\SD.Next\automatic\extensions\sd-webui-infinite-image-browsing\install.py
2024-01-30 15:14:29,609 | sd | DEBUG | installer | Running extension installer: C:\Users\USER\SD.Next\automatic\extensions\sd-webui-inpaint-anything\install.py
2024-01-30 15:14:33,788 | sd | DEBUG | installer | Running extension installer: C:\Users\USER\SD.Next\automatic\extensions\sd-webui-reactor\install.py
2024-01-30 15:14:36,173 | sd | INFO | installer | Extensions enabled: ['clip-interrogator-ext', 'Lora', 'sd-extension-chainner', 'sd-extension-system-info', 'sd-webui-agent-scheduler', 'stable-diffusion-webui-images-browser', 'stable-diffusion-webui-rembg', 'adetailer', 'canvas-zoom', 'OneButtonPrompt', 'openpose-editor', 'sd-dynamic-prompts', 'sd-webui-3d-open-pose-editor', 'sd-webui-aspect-ratio-helper', 'sd-webui-infinite-image-browsing', 'sd-webui-inpaint-anything', 'sd-webui-photopea-embed', 'sd-webui-reactor', 'sdwebui-close-confirmation-dialogue', 'stable-diffusion-webui-two-shot', 'ultimate-upscale-for-automatic1111']
2024-01-30 15:14:36,174 | sd | INFO | installer | Verifying requirements
2024-01-30 15:14:36,185 | sd | DEBUG | launch | Setup complete without errors: 1706627676
2024-01-30 15:14:36,190 | sd | INFO | installer | Extension preload: {'extensions-builtin': 0.0, 'extensions': 0.0}
2024-01-30 15:14:36,191 | sd | DEBUG | launch | Starting module: <module 'webui' from 'C:\\Users\\USER\\SD.Next\\automatic\\webui.py'>
2024-01-30 15:14:36,191 | sd | INFO | launch | Command line args: [] 
2024-01-30 15:14:36,192 | sd | DEBUG | launch | Env flags: []
2024-01-30 15:14:40,187 | sd | INFO | loader | Load packages: torch=2.1.2+cu121 diffusers=0.25.1 gradio=3.43.2
2024-01-30 15:14:40,811 | sd | DEBUG | shared | Read: file="config.json" json=39 bytes=1691 time=0.000
2024-01-30 15:14:40,811 | sd | DEBUG | shared | Unknown settings: ['multiple_tqdm']
2024-01-30 15:14:40,812 | sd | INFO | shared | Engine: backend=Backend.DIFFUSERS compute=cuda device=cuda attention="Scaled-Dot-Product" mode=no_grad
2024-01-30 15:14:40,860 | sd | INFO | shared | Device: device=NVIDIA GeForce RTX 4090 n=1 arch=sm_90 cap=(8, 9) cuda=12.1 cudnn=8801 driver=551.23
2024-01-30 15:14:41,573 | sd | DEBUG | sd_hijack | Importing LDM
2024-01-30 15:14:41,590 | sd | DEBUG | webui | Entering start sequence
2024-01-30 15:14:41,591 | sd | DEBUG | webui | Initializing
2024-01-30 15:14:41,614 | sd | INFO | sd_vae | Available VAEs: path="models\VAE" items=3
2024-01-30 15:14:41,616 | sd | INFO | extensions | Disabled extensions: ['sd-webui-controlnet', 'multidiffusion-upscaler-for-automatic1111']
2024-01-30 15:14:41,619 | sd | DEBUG | modelloader | Scanning diffusers cache: models\Diffusers models\Diffusers items=4 time=0.00
2024-01-30 15:14:41,619 | sd | DEBUG | shared | Read: file="cache.json" json=2 bytes=11733 time=0.000
2024-01-30 15:14:41,624 | sd | DEBUG | shared | Read: file="metadata.json" json=268 bytes=1173517 time=0.004
2024-01-30 15:14:41,631 | sd | INFO | sd_models | Available models: path="models\Stable-diffusion" items=70 time=0.01
2024-01-30 15:14:41,820 | sd | DEBUG | webui | Load extensions
2024-01-30 15:14:41,850 | sd | ERROR | errors | Module load: C:\Users\USER\SD.Next\automatic\scripts\detect_extension.py: NameError
2024-01-30 15:14:42,020 | sd | INFO | networks | LoRA networks: available=92 folders=9
2024-01-30 15:14:42,023 | sd | INFO | script_loading | Extension: script='extensions-builtin\Lora\scripts\lora_script.py' 15:14:42-020707 INFO     LoRA networks: available=92 folders=9
2024-01-30 15:14:42,263 | sd | INFO | script_loading | Extension: script='extensions-builtin\sd-webui-agent-scheduler\scripts\task_scheduler.py' Using sqlite file: extensions-builtin\sd-webui-agent-scheduler\task_scheduler.sqlite3
2024-01-30 15:14:43,269 | sd | INFO | script_loading | Extension: script='extensions\adetailer\scripts\!adetailer.py' [-] ADetailer initialized. version: 24.1.2, num models: 9
2024-01-30 15:14:44,550 | sd | DEBUG | shared | Read: file="html/upscalers.json" json=4 bytes=2672 time=0.000
2024-01-30 15:14:44,550 | sd | DEBUG | shared | Read: file="extensions-builtin\sd-extension-chainner\models.json" json=24 bytes=2719 time=0.000
2024-01-30 15:14:44,551 | sd | DEBUG | chainner_model | chaiNNer models: path="models\chaiNNer" defined=24 discovered=0 downloaded=3
2024-01-30 15:14:44,553 | sd | DEBUG | modelloader | Load upscalers: total=52 downloaded=7 user=0 time=0.01 ['None', 'Lanczos', 'Nearest', 'ChaiNNer', 'ESRGAN', 'LDSR', 'RealESRGAN', 'SCUNet', 'SD', 'SwinIR']
2024-01-30 15:14:44,554 | sd | DEBUG | shared | Read: file="extensions-builtin\sd-extension-chainner\models.json" json=24 bytes=2719 time=0.000
2024-01-30 15:14:44,555 | sd | DEBUG | chainner_model | chaiNNer models: path="models\chaiNNer" defined=24 discovered=0 downloaded=3
2024-01-30 15:14:44,557 | sd | DEBUG | modelloader | Load upscalers: total=52 downloaded=7 user=0 time=0.00 ['None', 'Lanczos', 'Nearest', 'ChaiNNer', 'ESRGAN', 'LDSR', 'RealESRGAN', 'SCUNet', 'SD', 'SwinIR']
2024-01-30 15:14:44,559 | sd | DEBUG | shared | Read: file="extensions-builtin\sd-extension-chainner\models.json" json=24 bytes=2719 time=0.000
2024-01-30 15:14:44,560 | sd | DEBUG | chainner_model | chaiNNer models: path="models\chaiNNer" defined=24 discovered=0 downloaded=3
2024-01-30 15:14:44,562 | sd | DEBUG | modelloader | Load upscalers: total=52 downloaded=7 user=0 time=0.00 ['None', 'Lanczos', 'Nearest', 'ChaiNNer', 'ESRGAN', 'LDSR', 'RealESRGAN', 'SCUNet', 'SD', 'SwinIR']
2024-01-30 15:14:44,562 | sd | DEBUG | shared | Read: file="extensions-builtin\sd-extension-chainner\models.json" json=24 bytes=2719 time=0.000
2024-01-30 15:14:44,563 | sd | DEBUG | chainner_model | chaiNNer models: path="models\chaiNNer" defined=24 discovered=0 downloaded=3
2024-01-30 15:14:44,565 | sd | DEBUG | modelloader | Load upscalers: total=52 downloaded=7 user=0 time=0.00 ['None', 'Lanczos', 'Nearest', 'ChaiNNer', 'ESRGAN', 'LDSR', 'RealESRGAN', 'SCUNet', 'SD', 'SwinIR']
2024-01-30 15:14:44,887 | sd | INFO | script_loading | Extension: script='extensions\sd-webui-inpaint-anything\scripts\inpaint_anything.py' Creating custom formatter for non UTF-8 environments due to attribute 'encoding' of '_io._TextIOBase' objects is not writable
2024-01-30 15:14:45,042 | sd | INFO | webui | Extensions init time: 3.22 img2imgalt.py=0.08 sd-webui-agent-scheduler=0.21 stable-diffusion-webui-images-browser=0.17 adetailer=0.84 OneButtonPrompt=1.29 sd-webui-inpaint-anything=0.27 sd-webui-reactor=0.14
2024-01-30 15:14:45,044 | sd | DEBUG | shared | Read: file="extensions-builtin\sd-extension-chainner\models.json" json=24 bytes=2719 time=0.000
2024-01-30 15:14:45,045 | sd | DEBUG | chainner_model | chaiNNer models: path="models\chaiNNer" defined=24 discovered=0 downloaded=3
2024-01-30 15:14:45,047 | sd | DEBUG | modelloader | Load upscalers: total=52 downloaded=7 user=0 time=0.00 ['None', 'Lanczos', 'Nearest', 'ChaiNNer', 'ESRGAN', 'LDSR', 'RealESRGAN', 'SCUNet', 'SD', 'SwinIR']
2024-01-30 15:14:45,065 | sd | DEBUG | styles | Load styles: folder="models\styles" items=324 time=0.02
2024-01-30 15:14:45,068 | sd | DEBUG | webui | Creating UI
2024-01-30 15:14:45,068 | sd | INFO | theme | Load UI theme: name="huggingface/remilia/Ghostly" style=Auto base=base.css
2024-01-30 15:14:45,069 | sd | WARNING | theme | Using 3rd party theme which is not optimized for SD.Next
2024-01-30 15:14:45,329 | sd | DEBUG | ui_txt2img | UI initialize: txt2img
2024-01-30 15:14:45,408 | sd | DEBUG | shared | Read: file="html\reference.json" json=32 bytes=17153 time=0.002
2024-01-30 15:14:45,426 | sd | DEBUG | ui_extra_networks | Extra networks: page='model' items=102 subfolders=2 tab=txt2img folders=['models\\Stable-diffusion', 'models\\Diffusers', 'models\\Reference'] list=0.08 thumb=0.01 desc=0.05 info=0.07 workers=4
2024-01-30 15:14:45,440 | sd | DEBUG | ui_extra_networks | Extra networks: page='style' items=324 subfolders=1 tab=txt2img folders=['models\\styles', 'html'] list=0.09 thumb=0.00 desc=0.00 info=0.00 workers=4
2024-01-30 15:14:45,442 | sd | DEBUG | ui_extra_networks | Extra networks: page='embedding' items=16 subfolders=0 tab=txt2img folders=['models\\embeddings'] list=0.08 thumb=0.00 desc=0.01 info=0.05 workers=4
2024-01-30 15:14:45,443 | sd | DEBUG | ui_extra_networks | Extra networks: page='hypernetwork' items=0 subfolders=0 tab=txt2img folders=['models\\hypernetworks'] list=0.00 thumb=0.00 desc=0.00 info=0.00 workers=4
2024-01-30 15:14:45,443 | sd | DEBUG | ui_extra_networks | Extra networks: page='vae' items=3 subfolders=0 tab=txt2img folders=['models\\VAE'] list=0.01 thumb=0.01 desc=0.00 info=0.00 workers=4
2024-01-30 15:14:45,448 | sd | DEBUG | ui_extra_networks | Extra networks: page='lora' items=92 subfolders=0 tab=txt2img folders=['models\\Lora', 'models\\LyCORIS'] list=0.08 thumb=0.01 desc=0.05 info=0.05 workers=4
2024-01-30 15:14:45,540 | sd | DEBUG | ui_img2img | UI initialize: img2img
2024-01-30 15:14:45,867 | sd | DEBUG | ui_control | UI initialize: control models=models\control
2024-01-30 15:14:46,076 | sd | DEBUG | shared | Read: file="ui-config.json" json=92 bytes=11362 time=0.000
2024-01-30 15:14:46,185 | sd | DEBUG | theme | Themes: builtin=11 default=5 external=55
2024-01-30 15:14:48,400 | sd | DEBUG | ui_extensions | Extension list: processed=332 installed=23 enabled=21 disabled=2 visible=332 hidden=0
2024-01-30 15:14:48,612 | sd | INFO | webui | Local URL: http://127.0.0.1:7860/
2024-01-30 15:14:48,613 | sd | DEBUG | webui | Gradio functions: registered=2665
2024-01-30 15:14:48,613 | sd | INFO | middleware | Initializing middleware
2024-01-30 15:14:48,616 | sd | DEBUG | webui | Creating API
2024-01-30 15:14:48,797 | sd | INFO | task_runner | [AgentScheduler] Task queue is empty
2024-01-30 15:14:48,800 | sd | INFO | api | [AgentScheduler] Registering APIs
2024-01-30 15:14:49,170 | sd | DEBUG | webui | Scripts setup: ['X/Y/Z Grid:0.008', 'One Button Prompt:0.035', 'AnimateDiff:0.006', 'ADetailer:0.045', 'Dynamic Prompts v2.17.1:0.015', 'ReActor:0.017', 'Latent Couple extension:0.021', 'Loopback:0.164', 'Ultimate SD upscale:0.005']
2024-01-30 15:14:49,170 | sd | DEBUG | sd_models | Model metadata: file="metadata.json" no changes
2024-01-30 15:14:49,172 | sd | DEBUG | modeldata | Model requested: fn=<lambda>
2024-01-30 15:14:49,172 | sd | INFO | sd_models | Select: model="cyberrealistic_v40 [481d75ae9d]"
2024-01-30 15:14:49,173 | sd | DEBUG | sd_models | Load model: existing=False target=C:\Users\USER\SD.Next\automatic\models\Stable-diffusion\cyberrealistic_v40.safetensors info=None
2024-01-30 15:14:49,187 | sd | DEBUG | devices | Desired Torch parameters: dtype=FP16 no-half=False no-half-vae=False upscast=False
2024-01-30 15:14:49,187 | sd | INFO | devices | Setting Torch parameters: device=cuda dtype=torch.float16 vae=torch.float16 unet=torch.float16 context=inference_mode fp16=True bf16=None
2024-01-30 15:14:49,188 | sd | DEBUG | sd_models | Diffusers loading: path="C:\Users\USER\SD.Next\automatic\models\Stable-diffusion\cyberrealistic_v40.safetensors"
2024-01-30 15:14:49,189 | sd | INFO | sd_models | Autodetect: model="Stable Diffusion" class=StableDiffusionPipeline file="C:\Users\USER\SD.Next\automatic\models\Stable-diffusion\cyberrealistic_v40.safetensors" size=2034MB
2024-01-30 15:14:50,946 | sd | DEBUG | sd_models | Setting model: pipeline=StableDiffusionPipeline config={'low_cpu_mem_usage': True, 'torch_dtype': torch.float16, 'load_connected_pipeline': True, 'extract_ema': True, 'use_safetensors': True}
2024-01-30 15:14:50,946 | sd | DEBUG | sd_models | Setting model: enable VAE slicing
2024-01-30 15:14:50,946 | sd | DEBUG | sd_models | Setting model: enable VAE tiling
2024-01-30 15:14:51,403 | sd | INFO | textual_inversion | Load embeddings: loaded=14 skipped=2 time=0.05
2024-01-30 15:14:51,644 | sd | DEBUG | devices | GC: collected=5199 device=cuda {'ram': {'used': 5.32, 'total': 63.91}, 'gpu': {'used': 3.72, 'total': 23.99}, 'retries': 0, 'oom': 0} time=0.24
2024-01-30 15:14:51,647 | sd | INFO | sd_models | Load model: time=2.23 load=2.23 native=512 {'ram': {'used': 5.32, 'total': 63.91}, 'gpu': {'used': 3.72, 'total': 23.99}, 'retries': 0, 'oom': 0}
2024-01-30 15:14:51,649 | sd | DEBUG | shared | Save: file="config.json" json=39 bytes=1637 time=0.001
2024-01-30 15:14:51,649 | sd | DEBUG | shared | Unused settings: ['multiple_tqdm']
2024-01-30 15:14:51,649 | sd | DEBUG | script_callbacks | Script callback init time: image_browser.py:ui_tabs=0.55 system-info.py:app_started=0.06 task_scheduler.py:app_started=0.42
2024-01-30 15:14:51,649 | sd | INFO | webui | Startup time: 15.46 torch=2.95 gradio=1.01 libraries=1.39 extensions=3.22 face-restore=0.19 ui-en=0.56 ui-txt2img=0.08 ui-img2img=0.24 ui-settings=0.20 ui-extensions=2.16 ui-defaults=0.07 launch=0.12 api=0.06 app-started=0.49 checkpoint=2.48
2024-01-30 15:14:54,838 | sd | INFO | server | MOTD: N/A
2024-01-30 15:14:59,500 | sd | DEBUG | theme | Themes: builtin=11 default=5 external=55
2024-01-30 15:14:59,722 | sd | INFO | api | Browser session: user=None client=127.0.0.1 agent=Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/121.0.0.0 Safari/537.36
2024-01-30 15:15:59,693 | sd | DEBUG | launch | Server: alive=True jobs=1 requests=68 uptime=79 memory=4.46/63.91 backend=Backend.DIFFUSERS state=idle
2024-01-30 15:16:36,330 | sd | INFO | server | MOTD: N/A
2024-01-30 15:16:41,296 | sd | DEBUG | theme | Themes: builtin=11 default=5 external=55
2024-01-30 15:16:41,551 | sd | INFO | api | Browser session: user=None client=127.0.0.1 agent=Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/121.0.0.0 Safari/537.36
2024-01-30 15:16:54,771 | sd | DEBUG | generation_parameters_copypaste | Paste prompt: type="current" prompt="Young vampire Man, seductive and sinister, dark Gothic aesthetic, alluring presence, blood-red eyes, suit, ancient castle backdrop, mystical atmosphere, forbidden power, sinister incantations, crimson blood magic, swirling dark energies, supernatural abilities, naturalistic realism, 32k uhd, rubén maya, imitated material, cinematic photo, film, bokeh, professional, 4k, highly detailed
Negative prompt: (cartoon, comic, painting, drawing, sketch, illustration, anime, cgi, airbrushed, manga:1.4), (blur, blurry, grainy, noisy:1.2)
Steps: 30, Seed: 3571075079, Sampler: DPM SDE, CFG scale: 6, Size: 512x768, Batch: 1x2, Index: 1x2, Parser: Full parser, Model: cyberrealistic_v40, Model hash: 481d75ae9d, Styles: Photographic, Backend: Diffusers, App: SD.Next, Version: 6c75539, Operations: txt2img, Hypertile UNet: 256, ADetailer model: face_yolov8s.pt, ADetailer confidence: 0.3, ADetailer mask only top k largest: 1, ADetailer dilate erode: 4, ADetailer mask blur: 4, ADetailer denoising strength: 0.4, ADetailer inpaint only masked: True, ADetailer inpaint padding: 32, ADetailer version: 24.1.2, Sampler options: karras, Pipeline: StableDiffusionInpaintPipeline"
2024-01-30 15:16:54,771 | sd | DEBUG | generation_parameters_copypaste | Settings overrides: []
2024-01-30 15:16:56,476 | sd | DEBUG | ui_control | Control input: type=PIL.Image input=[<PIL.Image.Image image mode=RGB size=512x768 at 0x22DF52C0910>]
2024-01-30 15:17:52,899 | sd | DEBUG | controlnet | Control ControlNet model loading: id="Depth" path="lllyasviel/control_v11f1p_sd15_depth"
2024-01-30 15:17:53,958 | sd | DEBUG | controlnet | Control ControlNet model loaded: id="Depth" path="lllyasviel/control_v11f1p_sd15_depth" time=1.06
2024-01-30 15:17:56,646 | sd | DEBUG | processors | Control Processor loading: id="Zoe Depth" class=ZoeDetector
2024-01-30 15:17:59,761 | sd | DEBUG | launch | Server: alive=True jobs=1 requests=146 uptime=199 memory=3.33/63.95 backend=Backend.DIFFUSERS state=idle
2024-01-30 15:17:59,830 | sd | DEBUG | processors | Control Processor loaded: id="Zoe Depth" class=ZoeDetector time=3.18
2024-01-30 15:18:15,745 | sd | DEBUG | processors | Control Processor: id="Zoe Depth" mode=RGB args={'gamma_corrected': False} time=2.01
2024-01-30 15:18:20,290 | sd | DEBUG | ui_control | Control input: type=PIL.Image input=[<PIL.Image.Image image mode=RGB size=512x768 at 0x22E30E26D50>]
2024-01-30 15:18:20,637 | sd | DEBUG | run | Control ControlNet unit: i=1 process=Zoe Depth model=Depth strength=1.0 guess=False start=0 end=1
2024-01-30 15:18:20,638 | sd | DEBUG | run | Control process unit: i=2 process=None
2024-01-30 15:18:20,638 | sd | DEBUG | run | Control process unit: i=3 process=None
2024-01-30 15:18:20,648 | sd | DEBUG | controlnet | Control ControlNet pipeline: class=StableDiffusionControlNetPipeline time=0.01
2024-01-30 15:18:20,668 | sd | DEBUG | sd_models | Setting model: enable VAE slicing
2024-01-30 15:18:20,669 | sd | DEBUG | sd_models | Setting model: enable VAE tiling
2024-01-30 15:18:20,677 | sd | DEBUG | images | Image resize: input=<PIL.Image.Image image mode=RGB size=512x768 at 0x22E30E26D50> mode=1 target=512x768 upscaler=ESRGAN 4x Ultrasharp function=control_run
2024-01-30 15:18:20,825 | sd | DEBUG | processors | Control Processor: id="Zoe Depth" mode=RGB args={'gamma_corrected': False} time=0.15
2024-01-30 15:18:20,924 | sd | INFO | sd_hijack_hypertile | Applying hypertile: unet=256
2024-01-30 15:18:20,937 | sd | DEBUG | sd_samplers | Sampler: sampler="DPM++ 2M" config={'num_train_timesteps': 1000, 'beta_start': 0.00085, 'beta_end': 0.012, 'beta_schedule': 'scaled_linear', 'prediction_type': 'epsilon', 'thresholding': False, 'sample_max_value': 1.0, 'algorithm_type': 'sde-dpmsolver++', 'solver_type': 'midpoint', 'lower_order_final': True, 'use_karras_sigmas': True}
2024-01-30 15:18:21,112 | sd | DEBUG | processing_diffusers | Diffuser pipeline: StableDiffusionControlNetPipeline task=DiffusersTaskType.TEXT_2_IMAGE set={'prompt_embeds': torch.Size([1, 154, 768]), 'negative_prompt_embeds': torch.Size([1, 154, 768]), 'guidance_scale': 6, 'generator': device(type='cuda'), 'output_type': 'latent', 'num_inference_steps': 40, 'eta': 1.0, 'width': 512, 'height': 768, 'controlnet_conditioning_scale': [1.0, 1.0, 1.0], 'control_guidance_start': 0.0, 'control_guidance_end': 1.0, 'guess_mode': False, 'image': <class 'list'>, 'parser': 'Full parser'}
2024-01-30 15:18:21,149 | sd | DEBUG | sd_samplers | Sampler: sampler="DPM++ 2M" config={'num_train_timesteps': 1000, 'beta_start': 0.00085, 'beta_end': 0.012, 'beta_schedule': 'scaled_linear', 'prediction_type': 'epsilon', 'thresholding': False, 'sample_max_value': 1.0, 'algorithm_type': 'sde-dpmsolver++', 'solver_type': 'midpoint', 'lower_order_final': True, 'use_karras_sigmas': True}
2024-01-30 15:18:21,153 | sd | ERROR | processing_diffusers | Processing: args={'prompt_embeds': tensor([[[-0.3833,  0.0226, -0.0608,  ..., -0.4883, -0.3057,  0.0662],
         [-0.1167,  0.3330, -0.6230,  ..., -0.4697, -0.6357, -0.1396],
         [-1.0312, -0.4351,  1.8770,  ...,  0.1260,  0.8789, -0.2720],
         ...,
         [ 1.8408, -0.4521,  0.9429,  ..., -0.3193, -0.4336, -0.4011],
         [ 1.8359, -0.4478,  0.9438,  ..., -0.3096, -0.4219, -0.4058],
         [ 1.8350, -0.3916,  0.9536,  ..., -0.3408, -0.3730, -0.4539]]], device='cuda:0', dtype=torch.float16), 'negative_prompt_embeds': tensor([[[-0.3833,  0.0226, -0.0608,  ..., -0.4883, -0.3057,  0.0662],
         [-1.3145,  1.1826,  0.9609,  ...,  0.2168,  0.3271,  1.4756],
         [-1.0010,  1.0352,  1.8340,  ..., -1.2139,  0.3772,  2.0000],
         ...,
         [ 0.1096, -0.4312, -0.1605,  ...,  0.8086, -1.8945, -0.2212],
         [ 0.1036, -0.4246, -0.1527,  ...,  0.8154, -1.9082, -0.2133],
         [ 0.1287, -0.3699, -0.1333,  ...,  0.7969, -1.8389, -0.2683]]], device='cuda:0', dtype=torch.float16), 'guidance_scale': 6, 'generator': [<torch._C.Generator object at 0x0000022E30B1ABB0>], 'output_type': 'latent', 'callback_on_step_end': <function process_diffusers.<locals>.diffusers_callback at 0x0000022E30B163E0>, 'callback_on_step_end_tensor_inputs': ['latents', 'prompt_embeds', 'negative_prompt_embeds'], 'num_inference_steps': 40, 'eta': 1.0, 'width': 512, 'height': 768, 'controlnet_conditioning_scale': [1.0, 1.0, 1.0], 'control_guidance_start': 0.0, 'control_guidance_end': 1.0, 'guess_mode': False, 'image': [<PIL.Image.Image image mode=RGB size=512x768 at 0x22E307371D0>, <PIL.Image.Image image mode=RGB size=512x768 at 0x22DFFE95E50>, <PIL.Image.Image image mode=RGB size=512x768 at 0x22DFFE95E50>]} If image batch size is not 1, image batch size must be same as prompt batch size. image batch size: 3, prompt batch size: 1
2024-01-30 15:18:21,160 | sd | INFO | processing | Processed: images=0 time=0.22 its=0.00 memory={'ram': {'used': 3.65, 'total': 63.91}, 'gpu': {'used': 6.63, 'total': 23.99}, 'retries': 0, 'oom': 0}
2024-01-30 15:18:21,169 | sd | INFO | run | Control: pipeline units=1 process=3 time=0.53 init=0.01 proc=0.26 ctrl=0.26 outputs=0
2024-01-30 15:18:33,223 | sd | DEBUG | processors | Control Processor loading: id="Leres Depth" class=LeresDetector
2024-01-30 15:18:35,422 | sd | DEBUG | processors | Control Processor loaded: id="Leres Depth" class=LeresDetector time=2.20
2024-01-30 15:18:37,407 | sd | DEBUG | processors | Control Processor: id="Leres Depth" mode=RGB args={'boost': False, 'thr_a': 0, 'thr_b': 0} time=0.41
2024-01-30 15:18:39,569 | sd | DEBUG | ui_control | Control input: type=PIL.Image input=[<PIL.Image.Image image mode=RGB size=512x768 at 0x22E3072BBD0>]
2024-01-30 15:18:39,920 | sd | DEBUG | run | Control ControlNet unit: i=1 process=Leres Depth model=Depth strength=1.0 guess=False start=0 end=1
2024-01-30 15:18:39,920 | sd | DEBUG | run | Control process unit: i=2 process=None
2024-01-30 15:18:39,921 | sd | DEBUG | run | Control process unit: i=3 process=None
2024-01-30 15:18:39,930 | sd | DEBUG | controlnet | Control ControlNet pipeline: class=StableDiffusionControlNetPipeline time=0.01
2024-01-30 15:18:39,950 | sd | DEBUG | sd_models | Setting model: enable VAE slicing
2024-01-30 15:18:39,950 | sd | DEBUG | sd_models | Setting model: enable VAE tiling
2024-01-30 15:18:39,957 | sd | DEBUG | images | Image resize: input=<PIL.Image.Image image mode=RGB size=512x768 at 0x22E3072BBD0> mode=1 target=512x768 upscaler=ESRGAN 4x Ultrasharp function=control_run
2024-01-30 15:18:40,030 | sd | DEBUG | processors | Control Processor: id="Leres Depth" mode=RGB args={'boost': False, 'thr_a': 0, 'thr_b': 0} time=0.07
2024-01-30 15:18:40,105 | sd | INFO | sd_hijack_hypertile | Applying hypertile: unet=256
2024-01-30 15:18:40,110 | sd | DEBUG | sd_samplers | Sampler: sampler="DPM++ 2M" config={'num_train_timesteps': 1000, 'beta_start': 0.00085, 'beta_end': 0.012, 'beta_schedule': 'scaled_linear', 'prediction_type': 'epsilon', 'thresholding': False, 'sample_max_value': 1.0, 'algorithm_type': 'sde-dpmsolver++', 'solver_type': 'midpoint', 'lower_order_final': True, 'use_karras_sigmas': True}
2024-01-30 15:18:40,227 | sd | DEBUG | processing_diffusers | Diffuser pipeline: StableDiffusionControlNetPipeline task=DiffusersTaskType.TEXT_2_IMAGE set={'prompt_embeds': torch.Size([1, 154, 768]), 'negative_prompt_embeds': torch.Size([1, 154, 768]), 'guidance_scale': 6, 'generator': device(type='cuda'), 'output_type': 'latent', 'num_inference_steps': 40, 'eta': 1.0, 'width': 512, 'height': 768, 'controlnet_conditioning_scale': [1.0, 1.0, 1.0], 'control_guidance_start': 0.0, 'control_guidance_end': 1.0, 'guess_mode': False, 'image': <class 'list'>, 'parser': 'Full parser'}
2024-01-30 15:18:40,232 | sd | DEBUG | sd_samplers | Sampler: sampler="DPM++ 2M" config={'num_train_timesteps': 1000, 'beta_start': 0.00085, 'beta_end': 0.012, 'beta_schedule': 'scaled_linear', 'prediction_type': 'epsilon', 'thresholding': False, 'sample_max_value': 1.0, 'algorithm_type': 'sde-dpmsolver++', 'solver_type': 'midpoint', 'lower_order_final': True, 'use_karras_sigmas': True}
2024-01-30 15:18:40,238 | sd | ERROR | processing_diffusers | Processing: args={'prompt_embeds': tensor([[[-0.3833,  0.0226, -0.0608,  ..., -0.4883, -0.3057,  0.0662],
         [-0.1167,  0.3330, -0.6230,  ..., -0.4697, -0.6357, -0.1396],
         [-1.0312, -0.4351,  1.8770,  ...,  0.1260,  0.8789, -0.2720],
         ...,
         [ 1.8408, -0.4521,  0.9429,  ..., -0.3193, -0.4336, -0.4011],
         [ 1.8359, -0.4478,  0.9438,  ..., -0.3096, -0.4219, -0.4058],
         [ 1.8350, -0.3916,  0.9536,  ..., -0.3408, -0.3730, -0.4539]]], device='cuda:0', dtype=torch.float16), 'negative_prompt_embeds': tensor([[[-0.3833,  0.0226, -0.0608,  ..., -0.4883, -0.3057,  0.0662],
         [-1.3145,  1.1826,  0.9609,  ...,  0.2168,  0.3271,  1.4756],
         [-1.0010,  1.0352,  1.8340,  ..., -1.2139,  0.3772,  2.0000],
         ...,
         [ 0.1096, -0.4312, -0.1605,  ...,  0.8086, -1.8945, -0.2212],
         [ 0.1036, -0.4246, -0.1527,  ...,  0.8154, -1.9082, -0.2133],
         [ 0.1287, -0.3699, -0.1333,  ...,  0.7969, -1.8389, -0.2683]]], device='cuda:0', dtype=torch.float16), 'guidance_scale': 6, 'generator': [<torch._C.Generator object at 0x0000022E307BB170>], 'output_type': 'latent', 'callback_on_step_end': <function process_diffusers.<locals>.diffusers_callback at 0x0000022E3070B880>, 'callback_on_step_end_tensor_inputs': ['latents', 'prompt_embeds', 'negative_prompt_embeds'], 'num_inference_steps': 40, 'eta': 1.0, 'width': 512, 'height': 768, 'controlnet_conditioning_scale': [1.0, 1.0, 1.0], 'control_guidance_start': 0.0, 'control_guidance_end': 1.0, 'guess_mode': False, 'image': [<PIL.Image.Image image mode=RGB size=512x768 at 0x22E3124F1D0>, <PIL.Image.Image image mode=RGB size=512x768 at 0x22E434C3C90>, <PIL.Image.Image image mode=RGB size=512x768 at 0x22E434C3C90>]} If image batch size is not 1, image batch size must be same as prompt batch size. image batch size: 3, prompt batch size: 1
2024-01-30 15:18:40,243 | sd | INFO | processing | Processed: images=0 time=0.13 its=0.00 memory={'ram': {'used': 2.29, 'total': 63.91}, 'gpu': {'used': 6.64, 'total': 23.99}, 'retries': 0, 'oom': 0}
2024-01-30 15:18:40,253 | sd | INFO | run | Control: pipeline units=1 process=3 time=0.33 init=0.01 proc=0.17 ctrl=0.15 outputs=0
2024-01-30 15:19:06,300 | sd | DEBUG | processors | Control Processor loading: id="Depth Anything" class=DepthAnythingDetector
2024-01-30 15:19:08,028 | sd | DEBUG | controlnet | Control ControlNet model loading: id="Depth Anything" path="vladmandic/depth-anything"
2024-01-30 15:19:09,880 | sd | DEBUG | controlnet | Control ControlNet model loaded: id="Depth Anything" path="vladmandic/depth-anything" time=1.85
2024-01-30 15:19:12,125 | sd | DEBUG | processors | Control Processor loaded: id="Depth Anything" class=DepthAnythingDetector time=5.83
2024-01-30 15:19:13,968 | sd | DEBUG | processors | Control Processor: id="Depth Anything" mode=RGB args={'color_map': 'inferno'} time=0.38
2024-01-30 15:19:16,643 | sd | DEBUG | ui_control | Control input: type=PIL.Image input=[<PIL.Image.Image image mode=RGB size=512x768 at 0x22DF92E9E90>]
2024-01-30 15:19:17,029 | sd | DEBUG | run | Control ControlNet unit: i=1 process=Depth Anything model=Depth Anything strength=1.0 guess=False start=0 end=1
2024-01-30 15:19:17,029 | sd | DEBUG | run | Control process unit: i=2 process=None
2024-01-30 15:19:17,029 | sd | DEBUG | run | Control process unit: i=3 process=None
2024-01-30 15:19:17,039 | sd | DEBUG | controlnet | Control ControlNet pipeline: class=StableDiffusionControlNetPipeline time=0.01
2024-01-30 15:19:17,058 | sd | DEBUG | sd_models | Setting model: enable VAE slicing
2024-01-30 15:19:17,058 | sd | DEBUG | sd_models | Setting model: enable VAE tiling
2024-01-30 15:19:17,066 | sd | DEBUG | images | Image resize: input=<PIL.Image.Image image mode=RGB size=512x768 at 0x22DF92E9E90> mode=1 target=512x768 upscaler=ESRGAN 4x Ultrasharp function=control_run
2024-01-30 15:19:17,128 | sd | DEBUG | processors | Control Processor: id="Depth Anything" mode=RGB args={'color_map': 'inferno'} time=0.06
2024-01-30 15:19:17,267 | sd | INFO | sd_hijack_hypertile | Applying hypertile: unet=256
2024-01-30 15:19:17,326 | sd | DEBUG | sd_samplers | Sampler: sampler="DPM++ 2M" config={'num_train_timesteps': 1000, 'beta_start': 0.00085, 'beta_end': 0.012, 'beta_schedule': 'scaled_linear', 'prediction_type': 'epsilon', 'thresholding': False, 'sample_max_value': 1.0, 'algorithm_type': 'sde-dpmsolver++', 'solver_type': 'midpoint', 'lower_order_final': True, 'use_karras_sigmas': True}
2024-01-30 15:19:17,436 | sd | DEBUG | processing_diffusers | Diffuser pipeline: StableDiffusionControlNetPipeline task=DiffusersTaskType.TEXT_2_IMAGE set={'prompt_embeds': torch.Size([1, 154, 768]), 'negative_prompt_embeds': torch.Size([1, 154, 768]), 'guidance_scale': 6, 'generator': device(type='cuda'), 'output_type': 'latent', 'num_inference_steps': 40, 'eta': 1.0, 'width': 512, 'height': 768, 'controlnet_conditioning_scale': [1.0, 1.0, 1.0], 'control_guidance_start': 0.0, 'control_guidance_end': 1.0, 'guess_mode': False, 'image': <class 'list'>, 'parser': 'Full parser'}
2024-01-30 15:19:17,440 | sd | DEBUG | sd_samplers | Sampler: sampler="DPM++ 2M" config={'num_train_timesteps': 1000, 'beta_start': 0.00085, 'beta_end': 0.012, 'beta_schedule': 'scaled_linear', 'prediction_type': 'epsilon', 'thresholding': False, 'sample_max_value': 1.0, 'algorithm_type': 'sde-dpmsolver++', 'solver_type': 'midpoint', 'lower_order_final': True, 'use_karras_sigmas': True}
2024-01-30 15:19:17,444 | sd | ERROR | processing_diffusers | Processing: args={'prompt_embeds': tensor([[[-0.3833,  0.0226, -0.0608,  ..., -0.4883, -0.3057,  0.0662],
         [-0.1167,  0.3330, -0.6230,  ..., -0.4697, -0.6357, -0.1396],
         [-1.0312, -0.4351,  1.8770,  ...,  0.1260,  0.8789, -0.2720],
         ...,
         [ 1.8408, -0.4521,  0.9429,  ..., -0.3193, -0.4336, -0.4011],
         [ 1.8359, -0.4478,  0.9438,  ..., -0.3096, -0.4219, -0.4058],
         [ 1.8350, -0.3916,  0.9536,  ..., -0.3408, -0.3730, -0.4539]]], device='cuda:0', dtype=torch.float16), 'negative_prompt_embeds': tensor([[[-0.3833,  0.0226, -0.0608,  ..., -0.4883, -0.3057,  0.0662],
         [-1.3145,  1.1826,  0.9609,  ...,  0.2168,  0.3271,  1.4756],
         [-1.0010,  1.0352,  1.8340,  ..., -1.2139,  0.3772,  2.0000],
         ...,
         [ 0.1096, -0.4312, -0.1605,  ...,  0.8086, -1.8945, -0.2212],
         [ 0.1036, -0.4246, -0.1527,  ...,  0.8154, -1.9082, -0.2133],
         [ 0.1287, -0.3699, -0.1333,  ...,  0.7969, -1.8389, -0.2683]]], device='cuda:0', dtype=torch.float16), 'guidance_scale': 6, 'generator': [<torch._C.Generator object at 0x0000022DF92B7170>], 'output_type': 'latent', 'callback_on_step_end': <function process_diffusers.<locals>.diffusers_callback at 0x0000022E307096C0>, 'callback_on_step_end_tensor_inputs': ['latents', 'prompt_embeds', 'negative_prompt_embeds'], 'num_inference_steps': 40, 'eta': 1.0, 'width': 512, 'height': 768, 'controlnet_conditioning_scale': [1.0, 1.0, 1.0], 'control_guidance_start': 0.0, 'control_guidance_end': 1.0, 'guess_mode': False, 'image': [<PIL.Image.Image image mode=RGB size=512x768 at 0x22E30BAD7D0>, <PIL.Image.Image image mode=RGB size=512x768 at 0x22D814A3550>, <PIL.Image.Image image mode=RGB size=512x768 at 0x22D814A3550>]} If image batch size is not 1, image batch size must be same as prompt batch size. image batch size: 3, prompt batch size: 1
2024-01-30 15:19:17,450 | sd | INFO | processing | Processed: images=0 time=0.12 its=0.00 memory={'ram': {'used': 2.29, 'total': 63.91}, 'gpu': {'used': 8.32, 'total': 23.99}, 'retries': 0, 'oom': 0}
2024-01-30 15:19:17,459 | sd | INFO | run | Control: pipeline units=1 process=3 time=0.43 init=0.01 proc=0.23 ctrl=0.19 outputs=0

Backend

Diffusers

Branch

Dev

Model

SD 1.5

Acknowledgements

• [X] I have read the above and searched for existing issues
• [X] I confirm that this is classified correctly and its not an extension issue

[vladmandic]

this specific issue is fixed in dev now.