search

xinsir6 / ControlNetPlus

ControlNet++: All-in-one ControlNet for image generations and editing!
Apache License 2.0
1.77k stars 43 forks source link

Inpaint pipeline cannot union with other controlnet models? #33

Open KeyaoZhao opened 4 months ago

KeyaoZhao commented 4 months ago

How can I try multi models like Canny + Inpaint? I found the inpaint codes uses 'StableDiffusionXLControlNetUnionInpaintPipeline' while others uses 'StableDiffusionXLControlNetUnionPipeline'. Can this two be combined?

xinsir6 commented 4 months ago

You can just combine the conditions, the input for inpating is also a conditions list, you can input as many condition as you like. inpainting can't use StableDiffusionXLControlNetUnionPipeline otherwise the images may be inconformity in the boundry you inpaint, StableDiffusionXLControlNetUnionInpaintPipeline use a DDIM reverse process for the original img to ensure consistency with the original img in unpaint areas.