invoke-ai / InvokeAI

Invoke is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry leading WebUI, and serves as the foundation for multiple commercial products.
https://invoke-ai.github.io/InvokeAI/
Apache License 2.0
23.44k stars 2.41k forks source link

HOWTO: Craft beautiful outputs from prompt combination #359

Closed bmaltais closed 2 years ago

bmaltais commented 2 years ago

Sorry to use the Issues to document this. This is not a bug or an issue but rather a demonstration on another possible way to use the variation feature recently introduced in v1.13. Please delete if not appropriate


I have been experimenting with the new variation feature of the v1.13 release and it is AWESOME. I want to explain a different way to use the feature vs what is part of the provided readme file. I think you will find it interesting.

I created a few images using the following prompt and selected the best two:

"portrait female commander shepard (amber heard), cyberpunk futuristic neon, hyper detailed, digital art, trending in artstation, cinematic lighting, studio quality, smooth render, unreal engine 5 rendered, octane render, Illustrated, Perfect face, fine details, realistic shaded, fine-face, pretty face" -H704 -n4

000181 3282369810 000181 1152589909

I did the same with this prompt:

"ultra realistic style illustration of a cute red haired (amber heard), sci - fi, fantasy, intricate, elegant, highly detailed, digital painting, artstation, concept art, smooth, sharp focus, illustration, 8 k frostbite 3 engine, ultra detailed" -H704 -n4

000182 3674209958 000182 2192299756

I then combined the two prompt and the 4 images using the following weighted prompt with variations:

"portrait female commander shepard (amber heard), cyberpunk futuristic neon, hyper detailed, digital art, trending in artstation, cinematic lighting, studio quality, smooth render, unreal engine 5 rendered, octane render, Illustrated, Perfect face, fine details, realistic shaded, fine-face, pretty face":1 "ultra realistic style illustration of a cute red haired (amber heard), sci - fi, fantasy, intricate, elegant, highly detailed, digital painting, artstation, concept art, smooth, sharp focus, illustration, 8 k frostbite 3 engine, ultra detailed":1 -V1152589909:0.25,3282369810:0.25,2192299756:0.25,3674209958:0.25 -S1 -v0.2 -n4 -t -s50 -W512 -H704

I divided 1 by the number of seed images (4) and doing this ensured that only "noise" from those 4 seed images would be used as a base for the combined prompt output. I allowed for 20% random noise to be added (-v0.2) to create some variation of the output.

Here are the two best resulting output. You see how the overall portrait remained the same but the style of the output is a blend between the two original prompt output. Really nice feature:

000186 4241617159 000186 3095990265

NOTE: I have nothing for or against Amber Heard, I just used her as I could easily see if the resulting images were trending toward a known value.

P.S.: You can use more that 2 prompts for the mix. I did 2 just to keep things simple...

bmaltais commented 2 years ago

Here is another example using another easy to recognize person. The resulting styles are really surprising:

Images from 1st prompt:

000187 2181214389 000187 1442210046

Images from 2nd prompt:

000188 3471593866 000188 2643536830

Resulting combination using the same technique as above:

000190 1768550911 000190 1474409802

i3oc9i commented 2 years ago

Very interesting thank you soo much for this sharing

lstein commented 2 years ago

This is very nice! Can I add this to the WIKI as the inaugural posting for a new "Tips and Tricks" section?

lstein commented 2 years ago

Sorry to use the Issues to document this. This is not a bug or an issue but rather a demonstration on another possible way to use the variation feature recently introduced in v1.13. Please delete if not appropriate

It's probably more appropriate to post to the Discussion tab, but people don't check there as often and I'm fine with the post being in Issues.

bmaltais commented 2 years ago

This is very nice! Can I add this to the WIKI as the inaugural posting for a new "Tips and Tricks" section?

For sure. I am happy to help others move the SD prompting forward by using all the nice features added to the fork.

LipcaCZ commented 2 years ago

Just add by Greg Rutkowski and BAM!, instant masterpiece from almost any prompt :D