Skip to content

How to use ggml_mul_mat? #1000

Answered by slaren
Ucag asked this question in Q&A
Oct 30, 2024 · 1 comments · 1 reply
Discussion options

You must be logged in to vote

ggml expects the second operand to be tranposed, and the returned matrix is also transposed. Check the last part of https://github.com/ggerganov/llama.cpp/blob/master/CONTRIBUTING.md

Replies: 1 comment 1 reply

Comment options

You must be logged in to vote
1 reply
@Ucag
Comment options

Answer selected by Ucag
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants