Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Why not add clip embedding to denoising-unet in high-resolution block? #152

Open
Naive-Bayes opened this issue Aug 9, 2024 · 0 comments

Comments

@Naive-Bayes
Copy link

Why only add clip embedding to denoising-unet in low-resolution block?

In AnimateAnyone, as the Figure 2 shows, they add clip embedding in all blocks. And in Champ Fig 2, it seems only add clip embedding in low-resolution blocks.

Do you make ablation about this design? And any conclusion?

By the way, I have not found the command to remove the clip embedding in high-resolution blocks. Maybe it's a figure mistake? Sorry if I was wrong.

######################################################

论文的Fig 2中,clip的embedding貌似只在降噪UNet中间的block上加,但Animate Anyone在所有的block中都注入了clip embedding,这样设计的原因是什么,有什么结论表明这样做的好处吗?

还有就是在code中,我好像没有找到不注入clip embedding的开关,能告诉在哪里移除clip embedding吗?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant