Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Questions about control_scale_list! #16

Closed
toyxyz opened this issue Aug 28, 2023 · 3 comments
Closed

Questions about control_scale_list! #16

toyxyz opened this issue Aug 28, 2023 · 3 comments

Comments

@toyxyz
Copy link

toyxyz commented Aug 28, 2023

What I understand is as follows. "control_scale_list" is a parameter that adjusts the effect of the input controlnet image frame on each adjacent frame. If the list is [0.5, 0.4], the controlnet image inserted in frame 5 has a scale of 0.5 in frames 4 and 6, and a scale of 0.4 in frames 3 and 7.

And the two parameters are calculated as follows.

control_scale_list * controlnet_conditioning_scale = Result scale

Therefore, if the scale is 0, all scale lists are also 0. Is my understanding correct?

image

And I wonder if the control scale list also affects between the first frame 0 and the last frame. I used controlnet tiles, placed 2 images on frame 0 and 15, then created 16 frames of video at "control_scale_list":[1.0]. In frames 0 and 1, the image entered in 0 was almost duplicated, but in the case of frame 15, the first frame, 0, was clearly influenced, so the front and back views were mixed.

image

Next I changed the controlnet 0 image to 2. Controlnet image 2 affects frames 1, 2, and 3, and controlnet image 15 affects frames 0, 14, and 15. is this intended? If so, I think it would be nice if an option was added to disable the scale list from looping. thanks!

image

@s9roll7
Copy link
Owner

s9roll7 commented Aug 28, 2023

What I understand is as follows. "control_scale_list" is a parameter that adjusts the effect of the input controlnet image frame on each adjacent frame. If the list is [0.5, 0.4], the controlnet image inserted in frame 5 has a scale of 0.5 in frames 4 and 6, and a scale of 0.4 in frames 3 and 7.

And the two parameters are calculated as follows.

control_scale_list * controlnet_conditioning_scale = Result scale

Therefore, if the scale is 0, all scale lists are also 0. Is my understanding correct?

If it's not buggy, it should be.

The frames are ring-shaped.
The first frame and the last frame are adjacent to each other.
If you don't do anything special, you should get a looping video (unless context and length are equally short)

If so, I think it would be nice if an option was added to disable the scale list from looping. thanks!

Yes, it would be better to have it.

@s9roll7
Copy link
Owner

s9roll7 commented Aug 30, 2023

469e761

  "controlnet_map": {       # config for controlnet(for generation)

    "is_loop": true,                # Whether controlnet effects consider loop

@toyxyz
Copy link
Author

toyxyz commented Aug 30, 2023

469e761

  "controlnet_map": {       # config for controlnet(for generation)

    "is_loop": true,                # Whether controlnet effects consider loop

It works perfectly! thank you!
00_42178172268000_masterpiece_best-quality_change-the-time-to-evening_1girl_solo_blonde-hair
image

image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants