xinsir6 / ControlNetPlus

ControlNet++: All-in-one ControlNet for image generations and editing!
Apache License 2.0
1.62k stars 32 forks source link

Inpainting does not work. Outputs a solid black image #34

Open danganbenpa opened 1 month ago

danganbenpa commented 1 month ago

ezgif-5-fa6a4232cd

You send an image that looks like the image on the left in your example, with the black area being the part that should be inpainted, and you end up with a pure black output.

xinsir6 commented 1 month ago

I have update the scripts, please try it again. Any question just ask me.

danganbenpa commented 1 month ago

Okay so I deleted the folder and then did a new git clone and I'm still having the same issue. image Input on the left. Output on the right.

danganbenpa commented 1 month ago

Okay well I used the inpaint workflow here: https://www.reddit.com/r/StableDiffusion/comments/1e6hg0v/controlnet_union_sdxl_10_promaxs_inpaint_is/

It worked well! If anybody is struggling to get this working I would recommend these workflows.

I was hoping it would work with PonyXL cause other inpainting methods like BrushNet don't... But this also failed. Most other CN++ functions do work well with Pony however. :)

xinsir6 commented 1 month ago

ybody

The huggingface controlnet_union_sdxl_1.0 folder have 2 models, one is base, the ohter is promax, you should set a new folder and put the promax the model into it and rename it. Then you can run the scripts in promax folder to check if it valid. I just provide some scripts that can generate mask randomly.