-
Notifications
You must be signed in to change notification settings - Fork 49
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
OpenBLAS test suite failures on ARM neoverse_v1 #314
Comments
@casparvl Can you include the high-level summary that shows how many tests fail, and maybe also dig up more details on the failing tests (should probably go in a gist), which we can use when reporting this upstream (or getting some input on this from @bartoldeman)? |
More detailed (though not complete) test log from
|
Just for my future self: that file is also available from the host on
No need to go into the container first... |
Gist with the full log is here |
Created upstream issue OpenMathLib/OpenBLAS#4187 |
Docs about how to interpret LAPACK test results: https://netlib.org/lapack/faq.html#_how_do_i_interpret_lapack_testing_failures |
For Reference, on
showed:
Detailed logs (
|
How much performance benefit does
|
@casparvl , I have created a PR (easybuilders/easybuild-easyconfigs#19280) to address most of the numerical errors by disabling tree-vectorize. This is also disabled in OpenBLAS main branch and OpenBLAS release 0.3.23. See For users who have a concern of potential performance degradation, I have validated that all these are small numerical differences. Details can be found at OpenMathLib/OpenBLAS#4335. |
Indeed, for OpenBLAS 0.3.23 and newer we don't see an increased number of numerical test failures anymore on from
from
|
{2023.06}[system] EasyBuild v4.9.1
We're seeing somewhat higher number of OpenBLAS test suite failures on ARM neoverse_v1 in:
For now, we've increased the number of accepted failures, but we'll need to investigate this issue in more detail. Are these test just out of numerical bounds? Or way off?
See also:
It did not seem to be a problem however in:
which build OpenBLAS 0.3.15 on ARM neoverse_v1 (see here)
The text was updated successfully, but these errors were encountered: