search

invoke-ai / InvokeAI

Invoke is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry leading WebUI, and serves as the foundation for multiple commercial products.
https://invoke-ai.github.io/InvokeAI/
Apache License 2.0
23.8k stars 2.45k forks source link

[enhancement]: Masked IP adapters, Controlnet, and T2I support. #6098

Open StellarBeing25 opened 8 months ago

StellarBeing25 commented 8 months ago

Is there an existing issue for this?

Contact Details

No response

What should this feature add?

The Forge UI has support for masked IP adapters, Controlnet, and T2I. It would be nice to have this feature in InvokeAI. This would be easily possible in Canvas itself if it supported multiple separate masks at the same time within the bounding box, each taking input from the corresponding IP adapters and controlnet during generation, similar to the regional prompting. The masks could be differentiated by using different colors. IPA CN

Alternatives

No response

Additional Content

No response

psychedelicious commented 1 month ago

I think the core use-case mostly addressed by Canvas v2:

That said, we're exploring "proper" layer masks for raster and control layers.