search

Kosinkadink / ComfyUI-Advanced-ControlNet

ControlNet scheduling and masking nodes with sliding context support
GNU General Public License v3.0
619 stars 61 forks source link

How to connect the node like A111 "my prompt is more important" #24

Closed xueqing0622 closed 6 months ago

xueqing0622 commented 1 year ago

I'm going to make a single image use controlnet like A111, is this the right way to connect the node like this? image

image image

Kosinkadink commented 1 year ago

Yep, that would be one way to hook it up. To clarify, the Scaled Soft ControlNet Weights node and the Soft ControlNet Weights node, with the default values, are the same: image

The only difference is, Scaled Soft ControlNet Weights will automatically scale the values as you wish, while Soft ControlNet Weights lets you manually change any layer of the controlnet, which is more involved. So you can just use the Scaled Soft ControlNet Weights node instead - and changing the base_multiplier on it can let you give the controlnet more freedom (AKA, make prompt even more important) if decreasing the value, or give controlnet less freedom (AKA, make prompt 'less' important) if increasing the value closer to 1. The default value, 0.825, is the value used by "my prompt is more important" in Auto1111 as explained in that screenshot you have, so that's why it's that value by default.

If you are not using any other features of the Timestep Keyframe node, you can also skip it by connecting the TIMESTEP_KEYFRAME output of the ControlNet Weights nodes to Load ControlNet Model (Advanced). Internally, it creates a placeholder Timestep Keyframe with default values so that you don't have to have a middleman Timestep Keyframe to just use the weights if not using anything else on the Timestep Keyframe: image

xueqing0622 commented 1 year ago

Thx, Kosinkadink, This helps me a lot to understand this node. Have a nice day!

curlysasha commented 10 months ago

What value for "controlnet is more important"?

alenknight commented 9 months ago

my prompt is more important

i too am curious about this. i figured out how to get it "balanced" and "my prompt is more important"... but controlnet is more important seems to be confusing me. i can KINDA get there by "flip weights" option.... and reducing it very low... but it's not 1:1... not even close.

Kosinkadink commented 9 months ago

"ControlNet is more important" is not implemented yet. I'll look into it at end of February/start of March

rohitpaul23 commented 8 months ago

@Kosinkadink any improvement ?

yano commented 7 months ago

https://github.com/comfyanonymous/ComfyUI/discussions/605 This connection is similar to 'My prompt is more important' and may be helpful.

Kosinkadink commented 7 months ago

"My prompt is more important" is already implemented via Scaled Soft Weights. It's "controlNet is more important" that is not implemented yet. I'll be circling back to Advanced-ControlNet dev work soon, where that will be one of the things I'll look into implementing in some way.

Kosinkadink commented 6 months ago

"ControlNet is more important" is now also supported as of the latest Advanced-ControlNet update, explained here and on the README: https://github.com/Kosinkadink/ComfyUI-Advanced-ControlNet/issues/87#issuecomment-2116370541