hnmr293 / sd-webui-cutoff

Cutoff - Cutting Off Prompt Effect
Other
1.2k stars 85 forks source link

Doesnt work #7

Open specblades opened 1 year ago

specblades commented 1 year ago

Tried to disable another axtentions, change clip skip, different weight but it still doesnt work.

prompt: a cute girl, white shirt with green tie, red shoes, blue hair, yellow eyes, pink skirt target tokens: white, green, red, blue, yellow, pink

image

schumar commented 1 year ago

Try adding another comma at the end of the target tokens, i.e. white, green, red, blue, yellow, pink,

specblades commented 1 year ago

Try adding another comma at the end of the target tokens, i.e. white, green, red, blue, yellow, pink,

anyway(

thot-experiment commented 1 year ago

same issue (model used is 1.5emapruned)

i'm using a trailing comma, extension seems to have no effect without cutoff hard, and with it enabled it does something but unclear what

no cutoff baseline

image

a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
Steps: 20, Sampler: DDIM, CFG scale: 7, Seed: 512, Size: 512x768, Model hash: 6ce0161689, Eta DDIM: 0.2

normal cutoff settings image

a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
Steps: 20, Sampler: DDIM, CFG scale: 7, Seed: 512, Size: 512x768, Model hash: 6ce0161689, Cutoff enabled: True, Cutoff targets: "['red', 'green', 'blue']", Cutoff padding: _</w>, Cutoff weight: 0.5, Cutoff disable_for_neg: True, Cutoff strong: False, Cutoff interpolation: lerp, Eta DDIM: 0.2
[Cutoff] replace: red, green, blue
[Cutoff] to: _</w> (318)
[Cutoff] original: a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
[Cutoff]       #0: a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
[Cutoff]       #1: a full body portrait of a woman with  _  hair wearing a  _  shirt and  _  jeans greg rutkowski
000 <|startoftext|>  a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
001 a</w>            a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
002 full</w>         a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
003 body</w>         a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
004 portrait</w>     a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
005 of</w>           a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
006 a</w>            a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
007 woman</w>        a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
008 with</w>         a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
009 red</w>          a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
010 hair</w>         a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
011 wearing</w>      a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
012 a</w>            a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
013 green</w>        a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
014 shirt</w>        a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
015 and</w>          a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
016 blue</w>         a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
017 jeans</w>        a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
018 greg</w>         a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
019 rut              a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
020 kowski</w>       a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
021 <|endoftext|>    a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
022 <|endoftext|>    a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
.... (there were many lines of this, up to 76, i'm presuming this is a token padding thing of some sort?)

image

a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
Steps: 20, Sampler: DDIM, CFG scale: 7, Seed: 512, Size: 512x768, Model hash: 6ce0161689, Cutoff enabled: True, Cutoff targets: "['red', 'green', 'blue']", Cutoff padding: _</w>, Cutoff weight: 0.5, Cutoff disable_for_neg: True, Cutoff strong: True, Cutoff interpolation: lerp, Eta DDIM: 0.2
[Cutoff] replace: red, green, blue
[Cutoff] to: _</w> (318)
[Cutoff] original: a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
[Cutoff]       #0: a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
[Cutoff]       #1: a full body portrait of a woman with  _  hair wearing a  _  shirt and  _  jeans greg rutkowski
000 <|startoftext|>  a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
001 a</w>            a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
002 full</w>         a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
003 body</w>         a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
004 portrait</w>     a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
005 of</w>           a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
006 a</w>            a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
007 woman</w>        a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
008 with</w>         a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
009 red</w>          a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
010 hair</w>         a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
011 wearing</w>      a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
012 a</w>            a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
013 green</w>        a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
014 shirt</w>        a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
015 and</w>          a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
016 blue</w>         a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
017 jeans</w>        a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
018 greg</w>         a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
019 rut              a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
020 kowski</w>       a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
021 <|endoftext|>    a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
022 <|endoftext|>    a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
hnmr293 commented 1 year ago

Thanks for your feedback. Cutoff limits the tokens' influence scope to a comma-separated range. So if you don't use comma-separated prompt, Cutoff will do nothing.

thot-experiment commented 1 year ago

Thank you! I actually had figured this out but I forgot to mention it here. I'm setting a reminder to do a pull tomorrow to clarify the readme so that this is obvious to new users, hopefully i get around to it.

DoDoExt commented 1 year ago

This extension does work, however it only works with Anime/Illustration models like 'Anything', or 'Rev', or "AOM3'. I'm not totally sure why, but even with something like 'Chillmix' I get mixed results. I've tried a handful of 'Realistic' models and they all failed spectacularly. So if you're into illustrated pictures. or anything to do with animation, you should be very happy with this.

My question is: Why? Shouldn't Cutoff guide the model's noise diffusion regardless of which model it is?

Woisek commented 1 year ago

This is a interesting question and needs an answer ...

darnell8 commented 1 year ago

Can the method of finding the linear mean really be applied to vector values? Isn't the value between the specific color and the mean of the sliding line unpredictable?

If I have any mistakes, please correct me.