Replies: 1 comment
-
|
yes, you can use gguf in fp16 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
For example a full phi-2 or tinylamam which is small enough. Thanks.
Beta Was this translation helpful? Give feedback.
All reactions