search

invoke-ai / InvokeAI

Invoke is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry leading WebUI, and serves as the foundation for multiple commercial products.
https://invoke-ai.github.io/InvokeAI/
Apache License 2.0
23.34k stars 2.4k forks source link

[bug]: Outpainting performes problematically on vertical direction #5230

Closed Jasongenius closed 1 week ago

Jasongenius commented 10 months ago

Is there an existing issue for this?

OS

Windows

GPU

cuda

VRAM

12G

What version did you experience this issue on?

3.4.0 post2

What happened?

when I do image extension to all directions (in canvas, outpainting), I found that the horizontal extension of the image is done well, but the seam effect in the vertical extension is very poor. I tried different infill method, only patchmatch works, the rest of them generated complete irrelevant content. And I set the denoising strength value to 85, things getting better but still have the vertical extension issue, as shown in the image (it's already the best image I can get after trying dozens of setting parameters combination). I tried to extend the image in both sides, vertically the seam is still obvious, while horizontally it's perfect. After discussing with 'hipsterusername' in discord, he thought it might be a bug in patchmatch.
Moreover, the problem occur when I try to do the seamless tiling. I found that horizontally the seamless effect is perfect, while vertically it could not connect well (seamless doesn't take effect), probably due to the same reason?

issue report original image issue report after image

Screenshots

that's the setting I use to generate the image

issue report setting screenshot 01 issue report setting screenshot 02

Additional context

I'd like to share the scenario when I use this feature: In the field of textile printing scenario, I need to extend and enlarge a pattern diagram in order to replace the continuous effect of seamless tiling to some extent. At this point, I extend this image from all directions, so I use the canvas and extend the bounding box in both length and height directions on the basis of fully covering the original image, hoping to achieve a fully fitting extension effect with the original image

Contact Details

wangzixin@aigctour.com

psychedelicious commented 1 week ago

Invoke v5 features a full rewrite of the canvas. Please create a new GH issue if the problem still exists in the new canvas UI.