Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

attribute "is_searched" not found because Attention not converted to SparseAttention #12

Open
xjaweiofj opened this issue Jun 8, 2023 · 1 comment

Comments

@xjaweiofj
Copy link

As shown in the figure, there are errors reported about the attribute "is_searched" not found. After tracing back this error, I found the problem is because in the class ModuleInjection, it always go to the if condition and return the model without converting the attention layer into SparseAttention. "is_searched" is an attribute only exists in SparseAttention. (For now to solve this problem, I commented out the if branch, but this will bring up new errors.) Is there any solution for this error? Thanks!

image
image
image

@DuZzzs
Copy link

DuZzzs commented Aug 10, 2023

@xjaweiofj hi, same error. Do you know how to fix it?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants