int4量化模型在CPU上部署 #619
-
请问有没有int4量化的模型权重可以下载,我想在CPU上推理运行。我显卡是3050的,满足不了量化模型的最低显存要求。 |
Beta Was this translation helpful? Give feedback.
Answered by
zRzRzRzRzRzRzR
Dec 19, 2023
Replies: 1 comment
-
官方暂未提供int4模型 |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
zRzRzRzRzRzRzR
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
官方暂未提供int4模型