Stability-AI / rest-api-support

Stability REST API examples, issues, and discussions | https://api.stability.ai
108 stars 21 forks source link

Negative Prompting Misbehaving #7

Open todd-elvers opened 1 year ago

todd-elvers commented 1 year ago

Users have noticed some strange behavior with negative prompting causing the results to wander significantly from the positive prompt.

The following is a text-to-image request with clip guidance disabled, cfg_scale of 7, steps of 50, and a fixed seed.

{
  "height": 512,
  "width": 512,
  "seed": 12345678,
  "text_prompts": [
    {
      "text": "cat",
      "weight": 1
    },
    {
      "text": "kitsch, ugly, boring, bad anatomy, oversaturated, grain, low-res, deformed, blurry",
      "weight": -1
    }
  ]
}

yields: -1

If we alter the weight of the negative prompt and choose anything between -0.06 and -1 we'll get the same image as above.

However if use a negative weight of -0.05 we get a slightly different image:

-0 05

Using -0.01 causes more changes in the image: -0 01

And finally, using something like -0.001 results in a dramatically different image: -0 001

We will update this issue when we have more information as to why this is occurring or how users can mitigate it.

dubtor commented 1 year ago

confirming that negative prompts behave "broken", up to a point where i have to use only positive prompts at this point. hope this will be fixed soon.

davidgut commented 1 year ago

Any news regarding this? The issue seems to be unsolved still.