comfyanonymous / ComfyUI

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
https://www.comfy.org/
GNU General Public License v3.0
55.43k stars 5.86k forks source link

how can i use fooocus_inpaint model in my inpaint workflow #2383

Open oceanusXXD opened 10 months ago

oceanusXXD commented 10 months ago

image

The inpainting functionality of fooocus seems better than comfyui's inpainting, both in using VAE encoding for inpainting and in setting latent noise masks

starinskycc commented 10 months ago

我也需要呢

starinskycc commented 10 months ago

https://github.com/comfyanonymous/ComfyUI/issues/2374

Laidawang commented 9 months ago

inpaint foocus patch is just a lora, Modify the correct lora loading method, just copy the way fooocus loaded. for inpainting head im not sure.

starinskycc commented 9 months ago

inpaint foocus patch is just a lora, Modify the correct lora loading method, just copy the way fooocus loaded. for inpainting head im not sure.

Have you tested it yet? Can it be used?

Laidawang commented 9 months ago

not yet,I read the codes of both and they are basically the same, but I don't have a good way to modify the code. Fooocus redefines a lot of the underlying code.

Acly commented 9 months ago

It's a somewhat custom Lora format, so the loader is modified, but also ComfyUI's ModelPatcher needs to apply the weights differently than other Lora. Makes it a bit ugly to implement, but here is a first version: https://github.com/Acly/comfyui-inpaint-nodes

Works well so far, but still experimenting.

starinskycc commented 9 months ago

nice