Benifit from AI hardware #5363
-
|
Will user with AI hardware (e.g. NPU) somehow benifit using Stockfish NNUE? |
Beta Was this translation helpful? Give feedback.
Replies: 4 comments
-
|
I'm not an expert on this, but this kind of hardware probably would bring better gains to leela or a much larger net than what stockfish currently uses. |
Beta Was this translation helpful? Give feedback.
-
|
Doesn't look promising with the way manufacturers are hiding the internals and only exposing very high level API. We need instruction-level access to do anything worthwhile. There is also a question whether these NPUs can accelerate vector x matrix operations, or whether they just target matrix x matrix, like for example AMX, which we measured to be worse than AVX2. |
Beta Was this translation helpful? Give feedback.
-
|
@Sopel97 What code was used for the AMX measurement? I always thought AffineTransformSparseInput::propagate() could benefit from AMX. |
Beta Was this translation helpful? Give feedback.
-
|
@mstembera https://github.com/Sopel97/Stockfish/commits/amx_v1/, https://github.com/Sopel97/Stockfish/commits/amx_v2/ benchmarks from vondele, I assume it's okay to post this after more than a year |
Beta Was this translation helpful? Give feedback.
Doesn't look promising with the way manufacturers are hiding the internals and only exposing very high level API. We need instruction-level access to do anything worthwhile. There is also a question whether these NPUs can accelerate vector x matrix operations, or whether they just target matrix x matrix, like for example AMX, which we measured to be worse than AVX2.