{lib}[GCC/10.3.0] FlexiBLAS v3.0.4 on top of OpenBLAS 0.3.15 #12476

boegel · 2021-03-25T16:06:15Z

(created using eb --new-pr)
requires:

~~add custom easyblock for FlexiBLAS easybuild-easyblocks#2369~~
~~{lang}[GCCcore/10.3.0] Python v3.9.5 #12755~~ (Python build dep)

…3.12 (WIP)

easybuild/easyconfigs/f/FlexiBLAS/FlexiBLAS-3.0.4-GCC-10.2.0.eb

…oolchain

boegel · 2021-05-05T11:57:15Z

Test report by @boegel
Using easyblocks from PR(s) easybuilders/easybuild-easyblocks#2369
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
generoso-x-2 - Linux centos linux 8.2.2004, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz (haswell), Python 3.6.8
See https://gist.github.com/8ed19790c180e0c69d9fc2bcc5f37f79 for a full test report.

boegel · 2021-05-05T12:30:56Z

Test report by @boegel
Using easyblocks from PR(s) easybuilders/easybuild-easyblocks#2369
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
select-pika-c6gd-2xlarge-0001 - Linux centos linux 8.3.2011, AArch64, ARM UNKNOWN (graviton2), Python 3.6.8
See https://gist.github.com/6615155d80d681997a09733318d8a859 for a full test report.

boegel · 2021-05-10T12:45:27Z

@boegelbot please test @ generoso
EB_ARGS="--include-easyblocks-from-pr 2369"

boegelbot · 2021-05-10T12:50:09Z

@boegel: Request for testing this PR well received on generoso

PR test command 'EB_PR=12476 EB_ARGS="--include-easyblocks-from-pr 2369" /apps/slurm/default/bin/sbatch --job-name test_PR_12476 --ntasks=4 ~/boegelbot/eb_from_pr_upload_generoso.sh' executed!

exit code: 0
output:

Submitted batch job 17071

Test results coming soon (I hope)...

- notification for comment with ID 836655549 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

boegelbot · 2021-05-10T12:56:53Z

Test report by @boegelbot
Using easyblocks from PR(s) easybuilders/easybuild-easyblocks#2369
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
generoso-c1-s-2 - Linux centos linux 8.2.2004, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz (haswell), Python 3.6.8
See https://gist.github.com/7f9661b74cef93b86f5861f0d3dfefc5 for a full test report.

boegel · 2021-05-10T13:02:12Z

Test report by @boegel
Using easyblocks from PR(s) easybuilders/easybuild-easyblocks#2369
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
select-pika-c6gd-2xlarge-0002 - Linux centos linux 8.3.2011, AArch64, ARM UNKNOWN (graviton2), Python 3.6.8
See https://gist.github.com/65c2967f127c296053a7dee30570d458 for a full test report.

boegel · 2021-05-10T13:05:26Z

make test fails on POWER9, due to the tests not finding libflexiblas.so.3:

1/114 Testing: BLAS-xblat1s
1/114 Test: BLAS-xblat1s
Command: "/home/centos/EasyBuild/software/CMake/3.18.4-GCCcore-10.2.0/bin/cmake" "-DTEST=/tmp/centos/FlexiBLAS/3.0.4/GCC-10.2.0/easybuild_obj/test/blas/xblat1s" "-DINTDIR=." "-P" "/tmp/centos/FlexiBLAS/3.0.4/GCC-10.2.0/flexiblas-3.0.4/test/blas/runtest.cmake"
Directory: /tmp/centos/FlexiBLAS/3.0.4/GCC-10.2.0/easybuild_obj/test/blas
"BLAS-xblat1s" start time: May 10 13:02 UTC
Output:
----------------------------------------------------------
-- "/tmp/centos/FlexiBLAS/3.0.4/GCC-10.2.0/easybuild_obj/lib" -- PATH
Running: /tmp/centos/FlexiBLAS/3.0.4/GCC-10.2.0/easybuild_obj/test/blas/xblat1s
ARGS=
/tmp/centos/FlexiBLAS/3.0.4/GCC-10.2.0/easybuild_obj/test/blas/xblat1s: error while loading shared libraries: libflexiblas.so.3: cannot open shared object file: No such file or directory
CMake Error at /tmp/centos/FlexiBLAS/3.0.4/GCC-10.2.0/flexiblas-3.0.4/test/blas/runtest.cmake:49 (message):
  Test /tmp/centos/FlexiBLAS/3.0.4/GCC-10.2.0/easybuild_obj/test/blas/xblat1s
  returned 127


<end of output>
Test time =   0.02 sec
----------------------------------------------------------
Test Failed.
"BLAS-xblat1s" end time: May 10 13:02 UTC
"BLAS-xblat1s" time elapsed: 00:00:00
----------------------------------------------------------

It's strange to me that this only happens on POWER9, not on x86_64 systems or on aarch64 (like Arm Graviton2)...

@branfosj @Flamefire Does this sort of problem happen to ring a bell for either of you?

boegel · 2021-05-10T13:08:57Z

Test report by @boegel
Using easyblocks from PR(s) easybuilders/easybuild-easyblocks#2369
FAILED
Build succeeded for 0 out of 1 (1 easyconfigs in total)
easybuild2.novalocal - Linux centos linux 8.3.2011, POWER, IBM pSeries (emulated by qemu) (power9le), Python 3.6.8
See https://gist.github.com/ec83011bf5b5b158c74613c19f96901a for a full test report.

boegel · 2021-05-10T13:20:03Z

Test report by @boegel
Using easyblocks from PR(s) easybuilders/easybuild-easyblocks#2369
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
node3513.doduo.os - Linux RHEL 8.2, x86_64, AMD EPYC 7552 48-Core Processor (zen2), Python 3.6.8
See https://gist.github.com/7a5fce2ac1a4317c455bf095cc8c9067 for a full test report.

Flamefire · 2021-05-10T14:44:29Z

Does this sort of problem happen to ring a bell for either of you?

This is usually an LD_LIBRARY_PATH/rpath problem. Maybe your x86 nodes are picking something up from the system which you don't have on POWER? In any case can you check that manually an if that happens check ldd? Otherwise it is all just guessing.

boegel · 2021-05-11T07:13:18Z

Ah, right, I have RPATH linking enabled on that system (and not on the others), so the problem must indeed be RPATH related, thanks for the hint!

ocaisa · 2021-05-11T14:09:34Z

Test report by @ocaisa
Using easyblocks from PR(s) easybuilders/easybuild-easyblocks#2369
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
generoso - Linux centos linux 8.2.2004, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz, Python 3.6.8
See https://gist.github.com/b431b9eda9aeaef825352009bb8d04e0 for a full test report.

ocaisa · 2021-05-11T14:19:53Z

Test report by @ocaisa
Using easyblocks from PR(s) easybuilders/easybuild-easyblocks#2369
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
generoso - Linux centos linux 8.2.2004, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz, Python 3.6.8
See https://gist.github.com/57090a74ba7802013b36421102a7fb20 for a full test report.

boegel · 2021-05-11T17:00:06Z

Test report by @boegel
Using easyblocks from PR(s) easybuilders/easybuild-easyblocks#2369
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
select-pika-c6gd-2xlarge-0001 - Linux centos linux 8.3.2011, AArch64, ARM UNKNOWN (graviton2), Python 3.6.8
See https://gist.github.com/34a0dfd886625a366de7e895ed789b92 for a full test report.

boegel · 2021-05-11T17:02:18Z

Test report by @boegel
Using easyblocks from PR(s) easybuilders/easybuild-easyblocks#2369
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
node2601.swalot.os - Linux centos linux 7.9.2009, x86_64, Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz (haswell), Python 3.6.8
See https://gist.github.com/f29839871937d263b70a8cc160a07dbd for a full test report.

boegel · 2021-05-11T17:07:33Z

Test report by @boegel
Using easyblocks from PR(s) easybuilders/easybuild-easyblocks#2369
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
node3503.doduo.os - Linux RHEL 8.2, x86_64, AMD EPYC 7552 48-Core Processor (zen2), Python 3.6.8
See https://gist.github.com/117b6623148e5270445dd68b9711ec5b for a full test report.

boegel · 2021-05-11T17:16:19Z

Test report by @boegel
Using easyblocks from PR(s) easybuilders/easybuild-easyblocks#2369
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
node3503.doduo.os - Linux RHEL 8.2, x86_64, AMD EPYC 7552 48-Core Processor (zen2), Python 3.6.8
See https://gist.github.com/eecf84417c8c56a451d2a7847dd8998c for a full test report.

boegel · 2021-05-11T17:26:20Z

@boegelbot please test @ generoso
EB_ARGS="--include-easyblocks-from-pr 2369"

boegelbot · 2021-05-11T17:30:08Z

@boegel: Request for testing this PR well received on generoso

PR test command 'EB_PR=12476 EB_ARGS="--include-easyblocks-from-pr 2369" /apps/slurm/default/bin/sbatch --job-name test_PR_12476 --ntasks=4 ~/boegelbot/eb_from_pr_upload_generoso.sh' executed!

exit code: 0
output:

Submitted batch job 17077

Test results coming soon (I hope)...

- notification for comment with ID 838869930 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

boegelbot · 2021-05-11T17:37:00Z

Test report by @boegelbot
Using easyblocks from PR(s) easybuilders/easybuild-easyblocks#2369
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
generoso-c1-s-1 - Linux centos linux 8.2.2004, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz (haswell), Python 3.6.8
See https://gist.github.com/76cf6237df3ff7bdb881bfb6b7129ce7 for a full test report.

boegel · 2021-05-14T07:35:51Z

@grisuthedragon Only injecting those flags for the tests would require patching test/*/CMakeLists.txt, right?
Or is there another easy way to ensure those flags are only used when running make test?

Right now, I'm passing the flags via -DCMAKE_*_FLAGS when configuring the FlexiBLAS build with cmake, which is easy to do...

Since you'll start using those flags (only for the tests?) in future FlexiBLAS versions, a patch for test/*/CMakeLlists.txt is perhaps better, just to avoid duplicating those flags for future FlexiBLAS versions (which shouldn't break anything, but it's not clean :) ).

boegel · 2021-05-14T14:16:42Z

Test report by @boegel
Using easyblocks from PR(s) easybuilders/easybuild-easyblocks#2426
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
node2669.swalot.os - Linux centos linux 7.9.2009, x86_64, Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz (haswell), Python 3.6.8
See https://gist.github.com/08d2fec2fa07cf19ded5b01600299db9 for a full test report.

boegel · 2021-05-14T14:17:50Z

Test report by @boegel
Using easyblocks from PR(s) easybuilders/easybuild-easyblocks#2426
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
select-pika-c6gd-2xlarge-0001 - Linux centos linux 8.3.2011, AArch64, ARM UNKNOWN (graviton2), Python 3.6.8
See https://gist.github.com/d5547cd2fe55241abf1c3d7e19487feb for a full test report.

boegel · 2021-05-14T14:20:54Z

Test report by @boegel
Using easyblocks from PR(s) easybuilders/easybuild-easyblocks#2426
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
easybuild2.novalocal - Linux centos linux 8.3.2011, POWER, IBM pSeries (emulated by qemu) (power9le), Python 3.6.8
See https://gist.github.com/65278f7a4e1e00fa605fb6d69588bf53 for a full test report.

boegel · 2021-05-14T19:29:54Z

Note: this should not be merged until #12755 is merged, since Python is a build dependency for FlexiBLAS (required for running the tests).

boegel · 2021-05-22T17:35:25Z

Test report by @boegel
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
select-pika-c6gd-2xlarge-0001 - Linux centos linux 8.3.2011, AArch64, ARM UNKNOWN (graviton2), Python 3.6.8
See https://gist.github.com/5acb176e7706070c7747ad4c0a1a2fa9 for a full test report.

boegel · 2021-05-22T17:35:35Z

Test report by @boegel
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
node2618.swalot.os - Linux centos linux 7.9.2009, x86_64, Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz (haswell), Python 3.6.8
See https://gist.github.com/6dd340f88073c3f2fd52726a70c7e717 for a full test report.

boegel · 2021-05-22T17:36:33Z

Test report by @boegel
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
node3129.skitty.os - Linux centos linux 7.9.2009, x86_64, Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz, Python 3.6.8
See https://gist.github.com/d165ab62a15e783f792e78e6c2f2b7ba for a full test report.

boegel · 2021-05-22T17:40:03Z

Test report by @boegel
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
node3515.doduo.os - Linux RHEL 8.2, x86_64, AMD EPYC 7552 48-Core Processor (zen2), Python 3.6.8
See https://gist.github.com/e5f8ba8387b0f21b065957c5c4ee3d91 for a full test report.

boegel · 2021-05-22T17:48:00Z

Test report by @boegel
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
easybuild2.novalocal - Linux centos linux 8.3.2011, POWER, IBM pSeries (emulated by qemu) (power9le), Python 3.6.8
See https://gist.github.com/a35adac92e0a3091004cb9d55afbb74e for a full test report.

requested changes dealt with

branfosj

lgtm

branfosj · 2021-05-23T10:36:03Z

Test report by @branfosj
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
bear-pg0211u03a.bear.cluster - Linux RHEL 8.3, x86_64, Intel(R) Xeon(R) Gold 6248 CPU @ 2.50GHz (cascadelake), Python 3.6.8
See https://gist.github.com/e494ba6bb1197aae20ef897872087dd4 for a full test report.

branfosj · 2021-05-23T10:36:11Z

Test report by @branfosj
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
bear-pg0211u08b.bear.cluster - Linux Ubuntu 20.04, x86_64, Intel(R) Xeon(R) Gold 6248 CPU @ 2.50GHz (cascadelake), Python 3.8.5
See https://gist.github.com/2a056431291d87f3da32aff36bf318d2 for a full test report.

smoors · 2021-05-23T10:56:13Z

easybuild/easyconfigs/f/FlexiBLAS/FlexiBLAS-3.0.4-GCC-10.3.0.eb

+]
+
+# note: first listed library will be used as default by FlexiBLAS,
+# unless otherwise specified via -DFLEXIBLAS_DEFAULT in configopts


Suggested change

# unless otherwise specified via -DFLEXIBLAS_DEFAULT in configopts

# unless otherwise specified via easyconfig parameter flexiblas_default

done in 5daaacb

smoors

lgtm

smoors · 2021-05-23T11:22:06Z

@boegelbot: please test @ generoso

boegelbot · 2021-05-23T11:25:07Z

@smoors: Request for testing this PR well received on generoso

PR test command 'EB_PR=12476 EB_ARGS= /apps/slurm/default/bin/sbatch --job-name test_PR_12476 --ntasks=4 ~/boegelbot/eb_from_pr_upload_generoso.sh' executed!

exit code: 0
output:

Submitted batch job 17286

Test results coming soon (I hope)...

- notification for comment with ID 846546674 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

boegelbot · 2021-05-23T11:30:48Z

Test report by @boegelbot
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
generoso-c1-s-1 - Linux centos linux 8.2.2004, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz (haswell), Python 3.6.8
See https://gist.github.com/3304cdd1a74830efee3ea2f700eff49c for a full test report.

smoors · 2021-05-23T11:32:01Z

Going in, thanks @boegel!

{lib}[GCC/10.2.0] FlexiBLAS v3.0.4 on top of BLIS 0.8.0 + OpenBLAS 0.…

7fec61c

…3.12 (WIP)

boegel added the new label Mar 25, 2021

boegel added this to the next release (4.3.5?) milestone Apr 27, 2021

smoors previously requested changes Apr 29, 2021

View reviewed changes

easybuild/easyconfigs/f/FlexiBLAS/FlexiBLAS-3.0.4-GCC-10.2.0.eb Outdated Show resolved Hide resolved

easybuild/easyconfigs/f/FlexiBLAS/FlexiBLAS-3.0.4-GCC-10.2.0.eb Outdated Show resolved Hide resolved

only use OpenBLAS as dependency for FlexiBLAS 3.0.4 with GCC/10.2.0 t…

a5dc98e

…oolchain

boegel changed the title ~~{lib}[GCC/10.2.0] FlexiBLAS v3.0.4 on top of BLIS 0.8.0 + OpenBLAS 0.3.12 (WIP)~~ {lib}[GCC/10.2.0] FlexiBLAS v3.0.4 on top of OpenBLAS 0.3.12 May 5, 2021

easybuilders deleted a comment from boegelbot May 5, 2021

add Python build dependency for FlexiBLAS, required by tests

c272e00

boegel force-pushed the 20210325170607_new_pr_FlexiBLAS304 branch from 2bfcf39 to c272e00 Compare May 11, 2021 16:52

easybuilders deleted a comment from boegelbot May 11, 2021

boegel mentioned this pull request May 15, 2021

{toolchain} foss/2021.04 #12867

Merged

4 tasks

boegel marked this pull request as draft May 16, 2021 09:22

This was referenced May 21, 2021

fix test step for libxc 4.3.4 and 5.1.x when using RPATH linking #12912

Merged

libxc regression test fails when using RPATH #11900

Closed

add Python build dependency for FlexiBLAS

277c332

boegel marked this pull request as ready for review May 22, 2021 18:03

branfosj previously approved these changes May 23, 2021

View reviewed changes

smoors reviewed May 23, 2021

View reviewed changes

update comment

5daaacb

smoors dismissed branfosj’s stale review via 5daaacb May 23, 2021 11:03

smoors approved these changes May 23, 2021

View reviewed changes

smoors merged commit a27285d into easybuilders:develop May 23, 2021

boegel deleted the 20210325170607_new_pr_FlexiBLAS304 branch May 23, 2021 11:37

	# unless otherwise specified via -DFLEXIBLAS_DEFAULT in configopts
	# unless otherwise specified via easyconfig parameter flexiblas_default

{lib}[GCC/10.3.0] FlexiBLAS v3.0.4 on top of OpenBLAS 0.3.15 #12476

{lib}[GCC/10.3.0] FlexiBLAS v3.0.4 on top of OpenBLAS 0.3.15 #12476

Conversation

boegel commented Mar 25, 2021 • edited Loading

boegel commented May 5, 2021

boegel commented May 5, 2021

boegel commented May 10, 2021

boegelbot commented May 10, 2021

boegelbot commented May 10, 2021

boegel commented May 10, 2021

boegel commented May 10, 2021

boegel commented May 10, 2021

boegel commented May 10, 2021

Flamefire commented May 10, 2021

boegel commented May 11, 2021

ocaisa commented May 11, 2021

ocaisa commented May 11, 2021

boegel commented May 11, 2021

boegel commented May 11, 2021

boegel commented May 11, 2021

boegel commented May 11, 2021

boegel commented May 11, 2021

boegelbot commented May 11, 2021

boegelbot commented May 11, 2021

boegel commented May 14, 2021

boegel commented May 14, 2021

boegel commented May 14, 2021

boegel commented May 14, 2021

boegel commented May 14, 2021

boegel commented May 22, 2021

boegel commented May 22, 2021

boegel commented May 22, 2021

boegel commented May 22, 2021

boegel commented May 22, 2021

branfosj left a comment

Choose a reason for hiding this comment

branfosj commented May 23, 2021

branfosj commented May 23, 2021

smoors May 23, 2021

Choose a reason for hiding this comment

smoors May 23, 2021

Choose a reason for hiding this comment

smoors left a comment

Choose a reason for hiding this comment

smoors commented May 23, 2021

boegelbot commented May 23, 2021

boegelbot commented May 23, 2021

smoors commented May 23, 2021

boegel commented Mar 25, 2021 •

edited

Loading