search

hako-mikan / sd-webui-regional-prompter

set prompt to divided region
GNU Affero General Public License v3.0
1.58k stars 133 forks source link

it not work when using region prompter with SDXL in webui。Is it not supported？ #295

Open hitlmt opened 10 months ago

Manchovies commented 9 months ago

Also wondering. I can't get it to work with this extension or the Tiled VAE extension.

hako-mikan commented 9 months ago

It works with SDXL as well. If it doesn't work, please report the situation in more detail.

MNeMoNiCuZ commented 9 months ago

@hako-mikan Thanks for an excellent extension!

I'm playing around with Forge, and I ran into an SDXL problem. It does work, but not with all setups.

Your example setup works great in SDXL.

(blue sky:1.2) ADDCOL
green hair twintail ADDCOL
(aquarium:1.3) ADDROW
(messy desk:1.2) ADDCOL
orange dress and sofa

With the example ratios: 1,2,1,1;2,4,6

However, in SDXL, if I try for something simple, like:

tree ADDCOL
cat

with the ratios: 1,3

This doesn't work in SDXL for me. But if I switch to SD1.5, it works immediately.

arcusmaximus commented 9 months ago

More specifically, this seems like a Forge problem at certain resolutions. Maybe one of the builtin optimizations breaks things? (For reference: I don't turn on HyperTile, I disabled the NeverOOM and MultiDiffusion extensions because I don't need them, and I don't get a message about Tiled VAE in the console. But I'm sure there's a lot more going on in the Forge internals.)

Testing with text-to-image mountain ADDCOL catgirl (no negative prompt) at 1820x1024 with the Regional Prompter settings at their defaults (so Divide Ratio = 1,1):

A1111 / SD1.5 (revAnimated_v122): Works A1111 / SDXL (dreamshaperXL_v21TurboDPMSDE): Works

Forge / SD1.5: Works Forge / SDXL: Doesn't work - only shows a mountain. If I change the prompt to catgirl ADDCOL mountain, it only shows a catgirl. If I change the resolution to 1024x1024, it shows both (in the correct positions). If I change it to 2048x2048, it again only shows a catgirl.