invoke-ai / InvokeAI

Invoke is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry leading WebUI, and serves as the foundation for multiple commercial products.
https://invoke-ai.github.io/InvokeAI/
Apache License 2.0
23.77k stars 2.44k forks source link

[bug]: Regional Guidance Layers should (probably) scale when changing resolution #6313

Open grunblatt-git opened 6 months ago

grunblatt-git commented 6 months ago

Is there an existing issue for this problem?

Operating system

macOS

GPU vendor

Apple Silicon (MPS)

GPU model

No response

GPU VRAM

No response

Version number

4.2.0b1

Browser

Chrome

Python dependencies

No response

What happened

When you change the resolution of the generation, existing regional guidance layers keep their previous resolution and are squashed into the top left corner of the new image.

What you expected to happen

I run into this quite frequently with the current version when i try to "upscale" an image by doing an img2img pass with a higher resolution: When using regional guidance layers for any generation (especially when painting on the initial image in an img2img workflow), the expectation after changing the resolution would be that those layers are stretched to the new resolution.

Right now I can't imagine any workflow in which the previously configured layers are still usable on a different resolution. So if scaling the layers is difficult, they probably should be at least removed?

How to reproduce the problem

No response

Additional context

No response

Discord username

No response

psychedelicious commented 6 months ago

Resizable layers is on the roadmap for control layers.