Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Doesnt work #7

Open
specblades opened this issue Mar 17, 2023 · 8 comments
Open

Doesnt work #7

specblades opened this issue Mar 17, 2023 · 8 comments

Comments

@specblades
Copy link

specblades commented Mar 17, 2023

Tried to disable another axtentions, change clip skip, different weight but it still doesnt work.

prompt: a cute girl, white shirt with green tie, red shoes, blue hair, yellow eyes, pink skirt
target tokens: white, green, red, blue, yellow, pink

image

@schumar
Copy link

schumar commented Mar 22, 2023

Try adding another comma at the end of the target tokens, i.e.
white, green, red, blue, yellow, pink,

@specblades
Copy link
Author

Try adding another comma at the end of the target tokens, i.e. white, green, red, blue, yellow, pink,

anyway(

@thot-experiment
Copy link

same issue (model used is 1.5emapruned)

i'm using a trailing comma, extension seems to have no effect without cutoff hard, and with it enabled it does something but unclear what

no cutoff baseline

image

a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
Steps: 20, Sampler: DDIM, CFG scale: 7, Seed: 512, Size: 512x768, Model hash: 6ce0161689, Eta DDIM: 0.2

normal cutoff settings
image

a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
Steps: 20, Sampler: DDIM, CFG scale: 7, Seed: 512, Size: 512x768, Model hash: 6ce0161689, Cutoff enabled: True, Cutoff targets: "['red', 'green', 'blue']", Cutoff padding: _</w>, Cutoff weight: 0.5, Cutoff disable_for_neg: True, Cutoff strong: False, Cutoff interpolation: lerp, Eta DDIM: 0.2
[Cutoff] replace: red, green, blue
[Cutoff] to: _</w> (318)
[Cutoff] original: a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
[Cutoff]       #0: a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
[Cutoff]       #1: a full body portrait of a woman with  _  hair wearing a  _  shirt and  _  jeans greg rutkowski
000 <|startoftext|>  a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
001 a</w>            a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
002 full</w>         a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
003 body</w>         a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
004 portrait</w>     a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
005 of</w>           a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
006 a</w>            a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
007 woman</w>        a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
008 with</w>         a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
009 red</w>          a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
010 hair</w>         a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
011 wearing</w>      a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
012 a</w>            a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
013 green</w>        a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
014 shirt</w>        a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
015 and</w>          a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
016 blue</w>         a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
017 jeans</w>        a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
018 greg</w>         a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
019 rut              a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
020 kowski</w>       a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
021 <|endoftext|>    a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
022 <|endoftext|>    a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
.... (there were many lines of this, up to 76, i'm presuming this is a token padding thing of some sort?)

image

a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
Steps: 20, Sampler: DDIM, CFG scale: 7, Seed: 512, Size: 512x768, Model hash: 6ce0161689, Cutoff enabled: True, Cutoff targets: "['red', 'green', 'blue']", Cutoff padding: _</w>, Cutoff weight: 0.5, Cutoff disable_for_neg: True, Cutoff strong: True, Cutoff interpolation: lerp, Eta DDIM: 0.2
[Cutoff] replace: red, green, blue
[Cutoff] to: _</w> (318)
[Cutoff] original: a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
[Cutoff]       #0: a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
[Cutoff]       #1: a full body portrait of a woman with  _  hair wearing a  _  shirt and  _  jeans greg rutkowski
000 <|startoftext|>  a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
001 a</w>            a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
002 full</w>         a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
003 body</w>         a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
004 portrait</w>     a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
005 of</w>           a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
006 a</w>            a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
007 woman</w>        a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
008 with</w>         a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
009 red</w>          a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
010 hair</w>         a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
011 wearing</w>      a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
012 a</w>            a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
013 green</w>        a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
014 shirt</w>        a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
015 and</w>          a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
016 blue</w>         a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
017 jeans</w>        a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
018 greg</w>         a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
019 rut              a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
020 kowski</w>       a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
021 <|endoftext|>    a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski
022 <|endoftext|>    a full body portrait of a woman with red hair wearing a green shirt and blue jeans greg rutkowski

@hnmr293
Copy link
Owner

hnmr293 commented Apr 1, 2023

Thanks for your feedback.
Cutoff limits the tokens' influence scope to a comma-separated range.
So if you don't use comma-separated prompt, Cutoff will do nothing.

@thot-experiment
Copy link

Thank you! I actually had figured this out but I forgot to mention it here. I'm setting a reminder to do a pull tomorrow to clarify the readme so that this is obvious to new users, hopefully i get around to it.

@DoDoExt
Copy link

DoDoExt commented Apr 5, 2023

This extension does work, however it only works with Anime/Illustration models like 'Anything', or 'Rev', or "AOM3'. I'm not totally sure why, but even with something like 'Chillmix' I get mixed results. I've tried a handful of 'Realistic' models and they all failed spectacularly. So if you're into illustrated pictures. or anything to do with animation, you should be very happy with this.

My question is: Why? Shouldn't Cutoff guide the model's noise diffusion regardless of which model it is?

@Woisek
Copy link

Woisek commented Apr 24, 2023

This is a interesting question and needs an answer ...

@darnell8
Copy link

darnell8 commented May 2, 2023

Can the method of finding the linear mean really be applied to vector values? Isn't the value between the specific color and the mean of the sliding line unpredictable?

If I have any mistakes, please correct me.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

7 participants