[bug] Mystery of Scribble ControlNet for SDXL

[Pirog17000]

Scribble somehow works with SDXL, at the same time the installation menu shows it's uninstalled. I mean, it works! And it works very well. I have no idea what magic it is, but will be great to have it detected or marked as supported with SDXL.

[Acly]

Maybe this is more of a miscommunication: all ControlNet options which don't have (SDXL) are for SD1.5.

SDXL doesn't have a CN trained on scribbles, but the one for Line Art works okay also for most scribble content (if it's not too rough), so it's used for both.

[Pirog17000]

for LineArt yes, works pretty well.

but I'm able to use Scribble option, while using SDXL checkpoint. and it works! However, it shows that the scribble controlnet, which I'm already using, is not installed. super-confusing

[Acly]

Nooo it shows that scribble controlnet for SD1.5 is not installed, which it isn't. And it shows lineart for SDXL is installed, and it just eats your scribbles too. Only slightly confusing.

[Pirog17000]

Aren't line-art and Scribble different controlnets? why it is under different categories then?

[Danamir]

Since there is no dedicated lineart or scribble ControlNet for SDXL, we use the "sketch" CN but with different preprocessors for a pseudo-lineart and pseudo-scribble .

Cf. resources.py :

    ControlMode.scribble: {
        SDVersion.sd15: ["control_v11p_sd15_scribble", "control_lora_rank128_v11p_sd15_scribble"],
        SDVersion.sdxl: ["control-lora-sketch-rank", "sai_xl_sketch_"],
    },
    ControlMode.line_art: {
        SDVersion.sd15: ["control_v11p_sd15_lineart", "control_lora_rank128_v11p_sd15_lineart"],
        SDVersion.sdxl: ["control-lora-sketch-rank", "sai_xl_sketch_"],
    },

[Pirog17000]

Thanks for explanation @Danamir