search

Acly / krita-ai-diffusion

Streamlined interface for generating images with AI in Krita. Inpaint and outpaint with optional text prompt, no tweaking required.
https://www.interstice.cloud
GNU General Public License v3.0
6.47k stars 312 forks source link

What are the excatly meaning for each Control Layer now? #847

Open pendave opened 3 months ago

pendave commented 3 months ago

As the types of the Control Layer are increasing in the updating versions of krita-ai-diffusion, I'm a little confused when I use them.

Could you summarize it into a table? Purpose Group | Name | Description | Effect image | Example .kra file |

Such as Lines Control | Canny | ........................ Lines Control | Line Art | ........................ ........... Depth Control | Depth | ........................ ........... Refer Control | .................................

Now I'm very confused about: Referrence, Style, Composition, does Referrence equal to a visible image layer in the Layers stack? image

I hope in each release there's a table notion for these: image

And Could you please add a Sorting button to a better order for those messed up Control Layers accorting to their Purpose Group? image

Acly commented 3 months ago

Reference/Style/Composition all use IP-Adapter. They act as a description like a text prompt, only using an image. You select for them a single layer with an image. Doesn't have to be visible, or the same size as your canvas. Preferrably it's square.

The rest are using ControlNet.

Yes documentation would be nice, but takes time, nobody has written any yet (since #315). Search for IP-Adapter or ControlNet you will find a lot of information and examples on the internet.

Regarding sorting: I don't typically recommend to use more than 2 or 3 of these, they cost performance and have diminishing returns.