search

Acly / comfyui-inpaint-nodes

Nodes for better inpainting with ComfyUI: Fooocus inpaint model for SDXL, LaMa, MAT, and various other tools for pre-filling inpaint & outpaint areas.
GNU General Public License v3.0
610 stars 42 forks source link

Artifacts in pony-based models #70

Closed Georgvadis closed 1 month ago

Georgvadis commented 1 month ago

When using any inpaint patch, artifacts appear in models based on pony diffusion and the image deteriorates.

Artifacts

Снимок экрана 2024-07-24 162322

Node

The problem arises in this node because there is no way not to use the inpaint patch

Снимок экрана 2024-07-24 162328

Workflow

Снимок экрана 2024-07-24 162336

Solution

There is a node in this repository that allows you to set the inpaint engine to "none", which solves the problem with Pony-based models. https://github.com/Seedsa/Fooocus_Nodes

Снимок экрана 2024-07-24 155720

Acly commented 1 month ago

If you don't want the inpaint patch there is no reason to use the node at all. Applying "inpaint engine" is all it does.

I don't think there is an inpaint model for pony checkpoints yet, so no real solution is possible.

Georgvadis commented 1 month ago

It's strange in fooocus 2.5, if you turn on inpaint, and set the value to none in the inpaint engine, everything works without artifacts with pony models. Perhaps I do not fully understand the principle of operation of the node in ComfyUI, in any case, thank you for taking your time and responding to my request.

Acly commented 1 month ago

The purpose of this node is to apply the inpaint model/patch.

By setting inpaint engine to "none" you instruct fooocus to NOT apply any inpaint model/patch. Equivalent to not using the node.

Not having dedicated inpaint model doesn't mean you can't use a mask and only change part of the image. But you don't need the node for that.