search

comfyanonymous / ComfyUI

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
https://www.comfy.org/
GNU General Public License v3.0
52.1k stars 5.48k forks source link

Possible to implement LooseControl? (New and improved ControlNet Depth) #2219

Open MythicalChu opened 9 months ago

MythicalChu commented 9 months ago

https://github.com/shariqfarooq123/LooseControl

https://www.reddit.com/r/StableDiffusion/comments/18clq4c/loosecontrol_lifting_controlnet_for_generalized/

Seems to work like controlnet already does, but with some custom parameters. But can also freeze style and edit content of generation.

ifsheldon commented 9 months ago

I believe it's a Lora of controlnet-depth, except their effort on edit consistency. We need a way to apply Lora to controlnet. Do you think it's possible? @comfyanonymous

ifsheldon commented 9 months ago

FYI, we've published the full weights here. You can use it like normal ControlNet.