search

xinsir6 / ControlNetPlus

ControlNet++: All-in-one ControlNet for image generations and editing!
Apache License 2.0
1.57k stars 33 forks source link

In the process of using [Image Outpainting], a problem occurred #19

Open shumoLR opened 1 month ago

shumoLR commented 1 month ago

Thank you very much for your selflessness. Now I have a problem. In the process of using [Image Outpainting], I found that the model used is ProMax, but [Image Inpainting] is perfectly usable, is it me who set the problem? Thank you for your reply. image

Beamhi commented 1 month ago

what preprocessor are you using for inpainting? I doesn't seem to work for me?

shumoLR commented 1 month ago

I use the inaint processor, what processor should I use?

Beamhi commented 1 month ago

I tried using that and didn't have good result, just black result.

bonlime commented 1 month ago

I think the problem is that in his example under the mask there are non-zero values, and if it was trained the same (not masking the input image, and only masking the control-img), then the model would fail during inference. But if you infill with 127 instead of 0, it starts to at least somehow work. Changing strength == 1 and using "combine-img" instead of "combine-noise" (aka mixing the clean img predictions, not the noised versions of them) results in almost perfect outputs

image image

xinsir6 commented 1 month ago

I have updated the inference scripts to fix the bug, please try it again, sorry to bring you inconvience.

xinsir6 commented 1 month ago

In the original scripts, the promax just can't load normally.