Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Mamba2 has different generations from input_ids and input_embeds #32555

Closed
molbap opened this issue Aug 9, 2024 · 0 comments · Fixed by #32694
Closed

Mamba2 has different generations from input_ids and input_embeds #32555

molbap opened this issue Aug 9, 2024 · 0 comments · Fixed by #32694
Labels
bug Generation

Comments

@molbap
Copy link
Contributor

molbap commented Aug 9, 2024

A newly added test from #32493 shows that some models fail their generate() call comparison when inputs are input_ids or inputs_embeds. Mamba-2 which was added in #32080 seems to fail this test.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Generation
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix: Mamba2 generation mismatch between input_ids and inputs_embeds vasqu/transformers
1 participant
@molbap