[Bug]: ControlNet Batch + XYZ plot (Automatic1111)

[TinkerTroll]

Is there an existing issue for this?

• [X] I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

What happened?

When using XYZ plot with batch input in ControlNet only 1 image for each input image is generated, the settings of the XYZ plot script are somewhat ignored. The generated grid image only shows "black" images. Type of attribute driven by xyz-plot script does not matter, even "simple" setting like cfg&seed won't work

"Allow other script to control this extension" is enabled under Settings -> Uncategorized -> ControlNet

Single image in ControlNet with XYZ-plotting : working Batch input for ControlNet without XYZ-plotting : working

Steps to reproduce the problem

1. enable ControlNet and select control type
2. choose batch folder (with a few input pictures)
3. choose X/Y/Z plot under "scripts"
4. choose type for x & y (eg seed & cfg) with 2 comma separated values each
5. generate

What should have happened?

For each image in the input folder a full set (xyz) of images according to XYZ-plot settings should be generated

Commit where the problem happens

webui: https://github.com/AUTOMATIC1111/stable-diffusion-webui/commit/cf2772fab0af5573da775e7437e6acdca424f26e controlnet: https://github.com/Mikubill/sd-webui-controlnet/commit/82e40692870218b8b1f3842ec11d0b5d7acfdb6e

What browsers do you use to access the UI ?

Google Chrome

Command Line Arguments

No

List of enabled extensions

Console logs

2x2 grid with 2 images in batch folder should generate 8 images
only 2 images are generated

X/Y/Z plot will create 4 images on 1 2x2 grid. (Total steps to process: 80)            | 40/80 [00:22<00:08,  4.65it/s]
                                  controlnet batch mode
2024-01-05 17:50:18,803 - ControlNet - INFO - unit_separate = False, style_align = False
2024-01-05 17:50:18,803 - ControlNet - INFO - Loading model from cache: control_v11e_sd15_shuffle [526bfdae]
2024-01-05 17:50:18,829 - ControlNet - INFO - Loading preprocessor: shuffle
2024-01-05 17:50:18,829 - ControlNet - INFO - preprocessor resolution = 512
2024-01-05 17:50:18,876 - ControlNet - INFO - ControlNet Hooked - Time = 0.07706975936889648
100%|██████████████████████████████████████████████████████████████████████████████████| 20/20 [00:04<00:00,  4.37it/s]
2024-01-05 17:50:23,976 - ControlNet - INFO - unit_separate = False, style_align = False 20/80 [00:04<00:12,  4.67it/s]
2024-01-05 17:50:23,977 - ControlNet - INFO - Loading model from cache: control_v11e_sd15_shuffle [526bfdae]
2024-01-05 17:50:24,093 - ControlNet - INFO - Loading preprocessor: shuffle
2024-01-05 17:50:24,094 - ControlNet - INFO - preprocessor resolution = 512
2024-01-05 17:50:24,134 - ControlNet - INFO - ControlNet Hooked - Time = 0.16014504432678223
100%|██████████████████████████████████████████████████████████████████████████████████| 20/20 [00:04<00:00,  4.65it/s]
Total progress:  50%|█████████████████████████████████                                 | 40/80 [00:10<00:10,  3.95it/s]
Total progress:  50%|█████████████████████████████████                                 | 40/80 [00:10<00:08,  4.66it/s]

Additional information

No response

[MarianoMolina]

Having the same issue. Ideal behavior is that you get a matrix with each element in the controlnet batch.

[trsh3r]

same here

[vruserbae]

same here... driving controlnet batch with x/y/z like multiple checkpoints does not work