lowfuel / progrock-stable

Stable Diffusion with some Proggy Enhancements
Other
167 stars 19 forks source link

prompt weight usage #45

Closed rockerBOO closed 2 years ago

rockerBOO commented 2 years ago

I have been playing with the new prompt weights a little bit but trying to figure out how I should be using it.

Thank you.

KnoBuddy commented 2 years ago

I don't believe there is a difference between

Ghost, ghost:1, and ghost:100

At least by itself.

I found using weight from -5 to 15 to give enough room for me to work with without using decimals.

Yes you can use multiple words for each weight.

Ex

A beautiful picture of:10 
A castle:15 
In the Scottish Highlands:7 
Trending on ArtStation:10 
By Beeple and Bob Ross:6 
Blur, depth of field, film grain, out of focus:-2 
rockerBOO commented 2 years ago

Thank you @KnoBuddy . I am now more confused :).

The weights in the last part, they apply the weight to the whole prefix?

For instance, I have this as a prompt.

cute:10 ghost ghostly boo cyberpunk:4 'blade runner':4 '_artist_':10 _environment_ _lighting_ _colors_ _adjective_

Is this not accurate? I basically wanted to weight each word separately, but maybe that's not right. Are you using new lines in a prompt there?

rockerBOO commented 2 years ago

Ok I read up a little on the pull request you made, and the origin source code and it has this

# grabs all text up to the first occurrence of ':' as sub-prompt
# takes the value following ':' as weight
# if ':' has no value defined, defaults to 1.0
# repeats until no text remaining
cute:10 ghost ghostly boo:1 cyberpunk blade runner:4 _artist_:10 _environment_  _lighting_ _colors_ _adjective_

So I think this would be an accurate representation of what I want.

KnoBuddy commented 2 years ago

If you want

Cute to be weight 10

And ghost ghostly boo to be weight 1

artists to be weight 10

Etc ...

then yes. That is correct.

Also the last section with no weight will be automatically weighted 1 as well.

rockerBOO commented 2 years ago

yes, this works. Thank you @KnoBuddy ! Maybe we can infer this into the README for others.

KnoBuddy commented 2 years ago

If you're still confused about how the weights work you can check out the GUI I made specifically for the weights being added to PRS over in https://GitHub.com/KnoBuddy/visualdiffusion

MakeGUDPics is the weighted version for PRS. Lmk if you have any further questions.

JPPhoto commented 2 years ago

Has anyone had success with PRS and negative prompt weights? I'm getting some strange results even when the sum of all weights > 0.