Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support int8 KVCache Quant in Vllm #1507
Support int8 KVCache Quant in Vllm #1507
Changes from 1 commit
ce271bc
f8b0b05
b1560db
5c672ec
f8d6b99
f8427e3
df286fe
b2d9b8c
c5a1a73
fbed95c
f396ed3
ad8f950
2543722
4226683
df15d44
872d156
8c29013
8b5278d
d8a9d4a
0b06f96
734dcc6
31c4083
16bccc4
dd527fc
104fb9b
580566c
88ba3c0
e2ff5a6
3065a32
a896eb3
4072871
c0d3895
f670d3c
666549d
16bb483
ca1fcb3
33f9d53
594ec3f
c37770b
815eda7
14ec0ca
2ff0e20
5744c38
cf7d939
d79a96e
9a2c2c6
b1d4ce3
74013b7
128cbae
e24d431
2f38a1c
74d706e
a999930
98ef941
95f8cc7
02c949a
f9fed66
File filter
Filter by extension
Conversations
Jump to
There are no files selected for viewing