Integrate PowerInfer2 #8184
BinaryQuantumSoul
started this conversation in
Ideas
Integrate PowerInfer2
#8184
Replies: 1 comment 1 reply
-
|
@BinaryQuantumSoul are you aware of an implementation? |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
I am not |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
This is the new paper for fast llm inference on smartphones
https://arxiv.org/abs/2406.06282
Beta Was this translation helpful? Give feedback.
All reactions