New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enable MLA by default #1447

Merged

zhyncs merged 1 commit into sgl-project:main from ispobock:open_mla

Sep 17, 2024

Collaborator

ispobock commented Sep 17, 2024

Motivation

Enable MLA by default. Add server arg --disable-mla to switch it.


          enable mla by default

3614a3f

zhyncs approved these changes

View reviewed changes

zhyncs enabled auto-merge (squash)

September 17, 2024 11:25

zhyncs merged commit c6b6d2e into sgl-project:main

5 of 11 checks passed

ispobock mentioned this pull request

Fix attention backend #1448

Merged

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet