adieyal / sd-dynamic-prompts

A custom script for AUTOMATIC1111/stable-diffusion-webui to implement a tiny template language for random prompt generation
MIT License
2.01k stars 259 forks source link

Values stored in PNG say DP is working, but images created don't match. #406

Open MarkEmery opened 1 year ago

MarkEmery commented 1 year ago

I'm opening this on behalf of a friend. She's running sd-webui-regional-prompter too. She's got this in her prompt:

photograph of a lady, ultra realistic, standing on floor, elegant, highly detailed, intricate, sharp focus, depth of field, f/1. 8, 85mm, (centered image composition), (professionally color graded), ((bright soft diffused light)), trending on instagram, trending on tumblr, hdr 4k, 8k, (((one girl))), gym
ADDBASE
gym equipment ADDROW 
gym equipment ADDCOL a {@blonde|redhead|brunette|silver-haired} lady, {@Carly|Natalie|Samantha|Laura}, ADDCOL gym equipment ADDROW 
gym equipment ADDCOL lace up {@yellow|pink|sky blue|red} bandeau strapless bra ADDCOL gym equipment ADDROW 
gym equipment ADDCOL holding phone ADDCOL {@yellow|pink|sky blue|red}  hotpants ADDCOL gym equipment ADDROW 
gym equipment ADDCOL  {@yellow|pink|sky blue|red} hotpants ADDCOL gym equipment ADDROW 
bare legs ADDROW 
white trainers

Drag-n-drop a resulting image into the prompt field, and it'll show the correct names and colour pairing, but all the images have the same pink clothes. She says no errors are sent to the console. She ran a test with a very simple prompt, no regional settings, and it gave the right results.

00001-3900136189 00003-3900136191 00002-3900136190

MarkEmery commented 1 year ago

Sorry, I feel like they should have been scaled down, but I didn't want to do anything to impact the tags inside.

MarkEmery commented 1 year ago

Update: She did yet another extensions update, ControlNet went from 1.1.102 to 1.1.107, and although the first 2 images from a batch of 4 both have pink, the 3rd one, in progress (CPU no GPU) is blue, matching the prompt. She hopes number 4 is red.

There's clearly some complex interaction going on between all the elements!

AIDungeonTester2 commented 1 year ago

I tried running an artist comparison with both Dynamic Prompts wildcards, as well as Regional Prompter, akin to this:

girl, blonde hair, smile ADDCOMM
by __artistwildcard__ ADDCOL
by __artistwildcard__ ADDCOL
by __artistwildcard__

When I made a few images, I noticed that the regions did not really vary in style, despite the prompt below the image window in A1111's WebUI showing that it did pick out artists from the wildcard file. When I copied one of these prompts and tried regenerating them with the same seed, THEN did it give me varying styles for each region.

I obviously don't know what's happening under the hood so to speak, but could this be because the random choice for what is picked out of the wildcard files is happening AFTER Regional Prompter has already picked what prompts to use?

This way, despite it stating that it has used different artists, in reality it used the literal prompt I wrote above, without the wildcards having any effect.