Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

failing installation of GCCcore/10.3.0 on top of EESSI 2023.04 compat layer #250

Closed
boegel opened this issue May 26, 2023 · 19 comments · Fixed by #251
Closed

failing installation of GCCcore/10.3.0 on top of EESSI 2023.04 compat layer #250

boegel opened this issue May 26, 2023 · 19 comments · Fixed by #251
Labels
bug Something isn't working pilot-2023.04

Comments

@boegel
Copy link
Contributor

boegel commented May 26, 2023

The installation of GCCcore/10.3.0 is failing with EasyBuild v4.7.1 on top of the EESSI pilot 2023.04 compat layer, with:

/tmp/boegel/easybuild/build/GCCcore/10.3.0/system-system/gcc-10.3.0/stage1_obj/./gcc/xgcc -B/tmp/boegel/easybuild/build/GCCcore/10.3.0/system-system/gcc-10.3.0/stage1_obj/./gcc/ -B/tmp/boegel/easybuild/build/GCCcore/10.3.0/system-system/GCC_stage1_eb/x86_64-pc-linux-gnu/bin/ -B/tmp/boegel/easybuild/build/GCCcore/10.3.0/system-system/GCC_stage1_eb/x86_64-pc-linux-gnu/lib/ -isystem /tmp/boegel/easybuild/build/GCCcore/10.3.0/system-system/GCC_stage1_eb/x86_64-pc-linux-gnu/include -isystem /tmp/boegel/easybuild/build/GCCcore/10.3.0/system-system/GCC_stage1_eb/x86_64-pc-linux-gnu/sys-include    -O2  -g -O2 -DIN_GCC    -W -Wall -Wno-narrowing -Wwrite-strings -Wcast-qual -Wstrict-prototypes -Wmissing-prototypes -Wold-style-definition  -isystem ./include  -fpic -mlong-double-80 -DUSE_ELF_SYMVER  -g -DIN_LIBGCC2 -fbuilding-libgcc -fno-stack-protector  -shared -nodefaultlibs -Wl,--soname=libgcc_s.so.1 -Wl,--version-script=libgcc.map -o ./libgcc_s.so.1.tmp -g -O2 -B./ _muldi3_s.o _negdi2_s.o _lshrdi3_s.o _ashldi3_s.o _ashrdi3_s.o _cmpdi2_s.o _ucmpdi2_s.o _clear_cache_s.o _trampoline_s.o __main_s.o _absvsi2_s.o _absvdi2_s.o _addvsi3_s.o _addvdi3_s.o _subvsi3_s.o _subvdi3_s.o _mulvsi3_s.o _mulvdi3_s.o _negvsi2_s.o _negvdi2_s.o _ctors_s.o _ffssi2_s.o _ffsdi2_s.o _clz_s.o _clzsi2_s.o _clzdi2_s.o _ctzsi2_s.o _ctzdi2_s.o _popcount_tab_s.o _popcountsi2_s.o _popcountdi2_s.o _paritysi2_s.o _paritydi2_s.o _powisf2_s.o _powidf2_s.o _powixf2_s.o _mulhc3_s.o _mulsc3_s.o _muldc3_s.o _mulxc3_s.o _divhc3_s.o _divsc3_s.o _divdc3_s.o _divxc3_s.o _bswapsi2_s.o _bswapdi2_s.o _clrsbsi2_s.o _clrsbdi2_s.o _fixunssfsi_s.o _fixunsdfsi_s.o _fixunsxfsi_s.o _fixsfdi_s.o _fixdfdi_s.o _fixxfdi_s.o _fixunssfdi_s.o _fixunsdfdi_s.o _fixunsxfdi_s.o _floatdisf_s.o _floatdidf_s.o _floatdixf_s.o _floatundisf_s.o _floatundidf_s.o _floatundixf_s.o _divdi3_s.o _moddi3_s.o _divmoddi4_s.o _udivdi3_s.o _umoddi3_s.o _udivmoddi4_s.o _udiv_w_sdiv_s.o cpuinfo_s.o sfp-exceptions_s.o addtf3_s.o divtf3_s.o multf3_s.o negtf2_s.o subtf3_s.o unordtf2_s.o fixtfsi_s.o fixunstfsi_s.o floatsitf_s.o floatunsitf_s.o fixtfdi_s.o fixunstfdi_s.o floatditf_s.o floatunditf_s.o fixtfti_s.o fixunstfti_s.o floattitf_s.o floatuntitf_s.o extendsftf2_s.o extenddftf2_s.o extendxftf2_s.o trunctfsf2_s.o trunctfdf2_s.o trunctfxf2_s.o getf2_s.o letf2_s.o eqtf2_s.o _divtc3_s.o _multc3_s.o _powitf2_s.o enable-execute-stack_s.o unwind-dw2_s.o unwind-dw2-fde-dip_s.o unwind-sjlj_s.o unwind-c_s.o emutls_s.o libgcc.a -lc && rm -f ./libgcc_s.so && if [ -f ./libgcc_s.so.1 ]; then mv -f ./libgcc_s.so.1 ./libgcc_s.so.1.backup; else true; fi && mv ./libgcc_s.so.1.tmp ./libgcc_s.so.1 && (echo "/* GNU ld script"; echo "   Use the shared library, but some functions are only in"; echo "   the static library.  */"; echo "GROUP ( libgcc_s.so.1 -lgcc )" ) > ./libgcc_s.so
/cvmfs/pilot.eessi-hpc.org/versions/2023.04/compat/linux/x86_64/usr/bin/ld.gold: error: cannot open /lib64/libc.so.6: No such file or directory
/cvmfs/pilot.eessi-hpc.org/versions/2023.04/compat/linux/x86_64/usr/bin/ld.gold: error: cannot open /usr/lib64/libc_nonshared.a: No such file or directory
collect2: error: ld returned 1 exit status
make[2]: *** [Makefile:994: libgcc_s.so] Error 1
make[2]: Leaving directory '/tmp/boegel/easybuild/build/GCCcore/10.3.0/system-system/gcc-10.3.0/stage1_obj/x86_64-pc-linux-gnu/libgcc'
make[1]: *** [Makefile:14332: all-target-libgcc] Error 2
make[1]: Leaving directory '/tmp/boegel/easybuild/build/GCCcore/10.3.0/system-system/gcc-10.3.0/stage1_obj'
make: *** [Makefile:967: all] Error 2

see also NorESSI#96 (cc @trz42)

@boegel boegel added bug Something isn't working pilot-2023.04 labels May 26, 2023
@boegel
Copy link
Contributor Author

boegel commented May 26, 2023

This problem is fixed if the patched GCC easyblock from easybuilders/easybuild-easyblocks#2921 is used.

@boegel
Copy link
Contributor Author

boegel commented May 26, 2023

Same problem occurs with GCCcore/11.3.0.

Although easybuilders/easybuild-easyblocks#2921 helps with fixing this build problem that happens just a couple of minutes into stage 1 of the GCC bootstrap procedure, it doesn't lead to a fully working installation in that case, since the RPATH part of sanity check for GCCcore/11.3.0 fails:

== FAILED: Installation ended unsuccessfully (build directory: /tmp/vsc40023/easybuild/build/GCCcore/11.3.0/system-system): build failed (first 300 chars): Sanity check failed: No '(RPATH)' found in
'readelf -d' output for /cvmfs/pilot.eessi-hpc.org/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/x86_64-pc-linux-gnu-gcc-11.3.0

Indeed, there's no RPATH section in binaries/libraries, although there should be:

No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.eessi-hpc.org/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libgcc_s.so.1:
Dynamic section at offset 0x17dc0 contains 27 entries:
  Tag        Type                         Name/Value
 0x0000000000000001 (NEEDED)             Shared library: [libc.so.6]
 0x000000000000000e (SONAME)             Library soname: [libgcc_s.so.1]
 0x000000000000000c (INIT)               0x3000
 0x000000000000000d (FINI)               0x14638
 0x0000000000000019 (INIT_ARRAY)         0x18da8
 0x000000000000001b (INIT_ARRAYSZ)       16 (bytes)
 0x000000000000001a (FINI_ARRAY)         0x18db8
 0x000000000000001c (FINI_ARRAYSZ)       8 (bytes)
 0x000000006ffffef5 (GNU_HASH)           0x270
 0x0000000000000005 (STRTAB)             0x1788
 0x0000000000000006 (SYMTAB)             0x768
 0x000000000000000a (STRSZ)              2227 (bytes)
 0x000000000000000b (SYMENT)             24 (bytes)
 0x0000000000000003 (PLTGOT)             0x18fe8
 0x0000000000000002 (PLTRELSZ)           1080 (bytes)
 0x0000000000000014 (PLTREL)             RELA
 0x0000000000000017 (JMPREL)             0x24a8
 0x0000000000000007 (RELA)               0x23a0
 0x0000000000000008 (RELASZ)             264 (bytes)
 0x0000000000000009 (RELAENT)            24 (bytes)
 0x000000006ffffffc (VERDEF)             0x2198
 0x000000006ffffffd (VERDEFNUM)          13
 0x000000006ffffffe (VERNEED)            0x2360
 0x000000006fffffff (VERNEEDNUM)         1
 0x000000006ffffff0 (VERSYM)             0x203c
 0x000000006ffffff9 (RELACOUNT)          4
 0x0000000000000000 (NULL)               0x0

In comparison, the successful GCCcore/10.3.0 install does have an RPATH section, as expected:

$ readelf -d /cvmfs/pilot.eessi-hpc.org/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64/libgcc_s.so.1

Dynamic section at offset 0x16da8 contains 28 entries:
  Tag        Type                         Name/Value
 0x0000000000000003 (PLTGOT)             0x17fe8
 0x0000000000000002 (PLTRELSZ)           1128 (bytes)
 0x0000000000000017 (JMPREL)             0x2688
 0x0000000000000014 (PLTREL)             RELA
 0x0000000000000007 (RELA)               0x2598
 0x0000000000000008 (RELASZ)             240 (bytes)
 0x0000000000000009 (RELAENT)            24 (bytes)
 0x000000006ffffff9 (RELACOUNT)          3
 0x0000000000000006 (SYMTAB)             0x220
 0x000000000000000b (SYMENT)             24 (bytes)
 0x0000000000000005 (STRTAB)             0x1240
 0x000000000000000a (STRSZ)              2810 (bytes)
 0x000000006ffffef5 (GNU_HASH)           0x1d40
 0x0000000000000001 (NEEDED)             Shared library: [libc.so.6]
 0x000000000000000e (SONAME)             Library soname: [libgcc_s.so.1]
 0x000000000000000c (INIT)               0x2af0
 0x000000000000000d (FINI)               0x13690
 0x000000000000001a (FINI_ARRAY)         0x17d90
 0x000000000000001c (FINI_ARRAYSZ)       8 (bytes)
 0x0000000000000019 (INIT_ARRAY)         0x17d98
 0x000000000000001b (INIT_ARRAYSZ)       16 (bytes)
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.eessi-hpc.org/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.eessi-hpc.org/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.eessi-hpc.org/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.eessi-hpc.org/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.eessi-hpc.org/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.eessi-hpc.org/versions/2023.04/compat/linux/x86_64/usr/lib]
 0x000000006ffffff0 (VERSYM)             0x2238
 0x000000006ffffffc (VERDEF)             0x2390
 0x000000006ffffffd (VERDEFNUM)          13
 0x000000006ffffffe (VERNEED)            0x2554
 0x000000006fffffff (VERNEEDNUM)         1
 0x0000000000000000 (NULL)               0x0

Same problem was observed with GCCcore/12.2.0 on top of EESSI 2023.04 compat layer.

@boegel
Copy link
Contributor Author

boegel commented May 26, 2023

The installation of GCCcore/11.3.0 outside of EESSI while using eb --rpath works fine, it leads to binaries/libraries that have an RPATH section as expected:

$ readelf -d /home/boegel/software/GCCcore/11.3.0/bin/gcc | grep RPATH
 0x000000000000000f (RPATH)              Library rpath: [/home/boegel/software/GCCcore/11.3.0/lib:/home/boegel/software/GCCcore/11.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/home/boegel/software/binutils/2.38/lib/../lib64]

$ readelf -d /home/boegel/software/GCCcore/11.3.0/lib64/libgcc_s.so.1 | grep RPATH
 0x000000000000000f (RPATH)              Library rpath: [/home/boegel/software/GCCcore/11.3.0/lib:/home/boegel/software/GCCcore/11.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/home/boegel/software/binutils/2.38/lib/../lib64]

So the problem with the failing sanity check seems to only occur when eb --sysroot is also used to install GCCcore/11.3.0 on top of the EESSI pilot 2023.04 compat layer, with the patched GCC easyblock from easybuilders/easybuild-easyblocks#2921 (or the enhanced version from trz42/easybuild-easyblocks#1 - commit 37ffbf6d001b82e1c3b117ddfc4f53a7b406bcdd).

@bartoldeman: Any ideas here?

@bartoldeman
Copy link

@boegel what's the RPATH for GCCcore/10.3.0 on top of EESSI 2023.04 ?

@trz42
Copy link
Collaborator

trz42 commented May 26, 2023

For NESSI/2023.04 (should be identical to EESSI/2023.04 compat layer), I have

$ readelf -d gcc | grep RPATH
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/generic/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/generic/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
$ readelf -d ../lib64/libgcc_s.so.1 | grep RPATH
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/generic/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/generic/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]

And similar for NESSI/2022.11 which has a compat layer built in November 2022.

@boegel
Copy link
Contributor Author

boegel commented May 26, 2023

@boegel what's the RPATH for GCCcore/10.3.0 on top of EESSI 2023.04 ?

see 2nd details block in #250 (comment)

@boegel
Copy link
Contributor Author

boegel commented May 26, 2023

The installation of GCCcore/11.3.0 is also failing to pass the RPATH part of the sanity check when installing on top of EESSI 2021.12 (using EasyBuild v4.7.1), so it seems like this problem is due to a change in GCC 11.x vs 10.x rather than a change in EESSI 2023.04 or the changes being made to the GCC easyblock...

No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.eessi-hpc.org/versions/2021.12/software/linux/x86_64/amd/zen3/software/GCCcore/11.3.0/lib64/libgcc_s.so.1:
Dynamic section at offset 0x17dd8 contains 27 entries:
Tag Type Name/Value
0x0000000000000001 (NEEDED) Shared library: [libc.so.6]
0x000000000000000e (SONAME) Library soname: [libgcc_s.so.1]
0x000000000000000c (INIT) 0x3000
0x000000000000000d (FINI) 0x14638
0x0000000000000019 (INIT_ARRAY) 0x18dc0
0x000000000000001b (INIT_ARRAYSZ) 16 (bytes)
0x000000000000001a (FINI_ARRAY) 0x18dd0
0x000000000000001c (FINI_ARRAYSZ) 8 (bytes)
0x000000006ffffef5 (GNU_HASH) 0x270
0x0000000000000005 (STRTAB) 0x1788
0x0000000000000006 (SYMTAB) 0x768
0x000000000000000a (STRSZ) 2227 (bytes)
0x000000000000000b (SYMENT) 24 (bytes)
0x0000000000000003 (PLTGOT) 0x19000
0x0000000000000002 (PLTRELSZ) 1080 (bytes)
0x0000000000000014 (PLTREL) RELA
0x0000000000000017 (JMPREL) 0x24a8
0x0000000000000007 (RELA) 0x23a0
0x0000000000000008 (RELASZ) 264 (bytes)
0x0000000000000009 (RELAENT) 24 (bytes)
0x000000006ffffffc (VERDEF) 0x2198
0x000000006ffffffd (VERDEFNUM) 13
0x000000006ffffffe (VERNEED) 0x2360
0x000000006fffffff (VERNEEDNUM) 1
0x000000006ffffff0 (VERSYM) 0x203c
0x000000006ffffff9 (RELACOUNT) 4
0x0000000000000000 (NULL) 0x0

@trz42
Copy link
Collaborator

trz42 commented May 26, 2023

I compared the logs for building GCC/10.3.0 and for building GCC/11.3.0 (on top of 2023.04), and the only difference I can spot are in options of two configure commands.

== Running pre-configure hook...
10.3.0
../configure --with-sysroot=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64 [snip] --enable-gold=default --enable-ld --with-plugin-ld=ld.gold [snip]
11.3.0
../configure --with-sysroot=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64 [snip] --enable-gold --enable-ld=default [snip]

and

== building...
10.3.0
../configure --with-sysroot=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64 [snip] --enable-gold=default --enable-ld --with-plugin-ld=ld.gold [snip]
11.3.0
../configure --with-sysroot=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64 [snip] --enable-gold --enable-ld=default [snip]

So difference between 10.3.0 and 11.3.0 is --enable-gold=default --enable-ld --with-plugin-ld=ld.gold and --enable-gold --enable-ld=default. 11.3.0 lacks the --with-plugin-ld=ld.gold.

These differences are because of changed settings in the gcc easyblock (lines 532-535)

        elif self.cfg['use_gold_linker']:
            self.configopts += " --enable-gold=default --enable-ld --with-plugin-ld=ld.gold"
        else:
            self.configopts += " --enable-gold --enable-ld=default"

and gold shall not be used from 11.3.0 because of bitrot (lines 133-135)

            # Disable the Gold linker by default for GCC 11.3.0 and newer, as it suffers from bitrot
            if self.cfg['use_gold_linker'] is None:
                self.cfg['use_gold_linker'] = version < LooseVersion('11.3.0')

@boegel
Copy link
Contributor Author

boegel commented May 26, 2023

Updates:

  • GCCcore/11.2.0 on top of EESSI 2023.04 with patched GCC easyblock: 🆗 - so could indeed be because we stopped using ld.gold from GCC 11.3.0 onwards, as @trz42 pointed out);
  • GCCcore/11.3.0 on top of EESSI 2021.12 with EasyBuild 4.5.1: 🆗 - makes sense, because changed to not use ld.gold was made in EasyBuild v4.5.5 (see don't use gold linker by default for GCC >= 11.3 easybuilders/easybuild-easyblocks#2711);
  • rebuild of GCCcore/10.3.0 on top of EESSI 2021.12 with EasyBuild v4.7.1 + patched GCC: 🆗 (makes sense)

So we need to figure out why the changes in easybuilders/easybuild-easyblocks#2711 are causing trouble when eb --rpath --sysroot=${EPREFIX} is used...

@bartoldeman
Copy link

I tried GCC 13.1 on our compatibility layer but with --rpath and without our own ld wrapper. It was ok.
Note that gcc doesn't actually need an RPATH as it only depends on system libraries just libm and libc but if I read the wrapper correctly it'll always put at least $ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64 in there, so the mystery is now, why not here?

@boegel
Copy link
Contributor Author

boegel commented May 27, 2023

@bartoldeman Which EasyBuild version were you using there? Does that GCC easyblock that was used include the changes made in easybuilders/easybuild-easyblocks#2711?

@boegel
Copy link
Contributor Author

boegel commented May 27, 2023

One more clue: some libraries in the GCCcore/11.3.0 installation for which the sanity check fails actually do have a proper RPATH section, for example libcc1.so.0.0.0:

$ readelf -d /cvmfs/pilot.eessi-hpc.org/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libcc1.so.0.0.0 | grep RPATH
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.eessi-hpc.org/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib:/cvmfs/pilot.eessi-hpc.org/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.eessi-hpc.org/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0:/cvmfs/pilot.eessi-hpc.org/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64:/cvmfs/pilot.eessi-hpc.org/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.eessi-hpc.org/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.eessi-hpc.org/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../..:/cvmfs/pilot.eessi-hpc.org/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.eessi-hpc.org/versions/2023.04/compat/linux/x86_64/usr/lib:/cvmfs/pilot.eessi-hpc.org/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/../lib64]
$
$ readelf -d /cvmfs/pilot.eessi-hpc.org/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libgcc_s.so.1 | grep RPATH
$ 

If found libcc1.so.0.0.0 by looking at the rpath_wrapper_ld.log that is produced by the EasyBuild RPATH wrapper script that wraps around ld (which resolves to /cvmfs/pilot.eessi-hpc.org/versions/2023.04/compat/linux/x86_64/usr/bin/ld).

That tells me that for some reason libgcc_s.so.1 is not getting linked with ld, and hence is escaping the RPATH wrapper script?
There's indeed no trace of libgcc_s in rpath_wrapper_ld.log...

@trz42
Copy link
Collaborator

trz42 commented May 27, 2023

I looked into a failing build of GCC/11.3.0 on top of NESSI/2023.04. Only a few libraries and binaries have the RPATH section.

libraries under GCCcore/11.3.0/lib64
Apptainer> dir=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64; for file in $(ls $dir | egrep -v -E '(py$|.la$|.a$|.o$|.spec$|libgcc_s.so$)'); do echo $file; readelf -d $dir/$file | grep RPATH; done
libasan.so.6
libasan.so.6.0.0
libatomic.so.1
libatomic.so.1.2.0
libcc1.so.0
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../..:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/../lib64]
libcc1.so.0.0.0
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../..:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/../lib64]
libgcc_s.so.1
libgfortran.so.5
libgfortran.so.5.0.0
libgomp-plugin-nvptx.so.1
libgomp-plugin-nvptx.so.1.0.0
libgomp.so.1
libgomp.so.1.0.0
libitm.so.1
libitm.so.1.0.0
liblsan.so.0
liblsan.so.0.0.0
libquadmath.so.0
libquadmath.so.0.0.0
libssp.so.0
libssp.so.0.0.0
libstdc++.so.6
libstdc++.so.6.0.29
libtsan.so.0
libtsan.so.0.0.0
libubsan.so.1
libubsan.so.1.0.0
binaries under GCCcore/11.3.0/bin
Apptainer> dir=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin; for file in $(ls $dir | egrep -v -E '(py$|.la|.spec$|libgcc_s.so$)'); do echo $file; readelf -d $dir/$file | grep RPATH; done
c++
cc
cpp
f77
f95
g++
gcc
gcc-ar
gcc-nm
gcc-ranlib
gcov
gcov-dump
gcov-tool
gfortran
lto-dump
nvptx-none-ar
nvptx-none-as
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../..:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
nvptx-none-ld
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../..:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
nvptx-none-ranlib
x86_64-pc-linux-gnu-accel-nvptx-none-gcc
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../..:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
x86_64-pc-linux-gnu-accel-nvptx-none-lto-dump
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../..:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
x86_64-pc-linux-gnu-c++
x86_64-pc-linux-gnu-g++
x86_64-pc-linux-gnu-gcc
x86_64-pc-linux-gnu-gcc-11.3.0
x86_64-pc-linux-gnu-gcc-ar
x86_64-pc-linux-gnu-gcc-nm
x86_64-pc-linux-gnu-gcc-ranlib
x86_64-pc-linux-gnu-gfortran

The sanity check lists the following (grep'ed from EasyBuild log file):

No '(RPATH)' found in ...
Apptainer> grep "^No '(RPATH)'" /tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/easybuild-GCCcore-11.3.0-20230526.194441.JciLu.log
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/c++:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/g++:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/gcov:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/gcov-dump:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/gfortran:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/x86_64-pc-linux-gnu-c++:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/x86_64-pc-linux-gnu-gfortran:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/x86_64-pc-linux-gnu-g++:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/lto-dump:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/gcc:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/x86_64-pc-linux-gnu-gcc-ar:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/gcc-ranlib:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/gcc-ar:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/x86_64-pc-linux-gnu-gcc-ranlib:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/x86_64-pc-linux-gnu-gcc-nm:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/cpp:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/gcc-nm:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/x86_64-pc-linux-gnu-gcc:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/gcov-tool:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libssp.so.0.0.0:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libatomic.so.1.2.0:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libquadmath.so.0.0.0:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libubsan.so.1.0.0:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libtsan.so.0.0.0:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libasan.so.6.0.0:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libitm.so.1.0.0:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/liblsan.so.0.0.0:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libgfortran.so.5.0.0:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libgomp.so.1.0.0:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libstdc++.so.6.0.29:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libgomp-plugin-nvptx.so.1.0.0:
No '(RPATH)' found in 'readelf -d' output for /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libgcc_s.so.1:

None of these has an RPATH section (maybe not so surprisingly). Checked with

Apptainer> for file in $(grep "^No '(RPATH)'" /tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/easybuild-GCCcore-11.3.0-20230526.194441.JciLu.log | awk '{print $NF}' | sed -e 's/:$//'); do echo $file; readelf -d $file; done | grep RPATH

Checking the path_wrapper_ld.log for those files it seems for some binaries the rpath wrapper was run, not for all though. For none of the libraries it seems to have been run. See details

checking rpath_wrapper_ld.log for binaries/libraries with no RPATH
Apptainer> for file in $(grep "^No '(RPATH)'" /tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/easybuild-GCCcore-11.3.0-20230526.194441.JciLu.log | awk '{print $NF}' | sed -e 's/:$//'); do echo $file; basefile=$(basename $file); echo checking rpath_wrapper_ld.log for $basefile; ntimes=$(grep " $basefile " /tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/rpath_wrapper_ld.log | wc -l); echo "found pattern ' $basefile ' $ntimes times in rpath_wrapper_ld.log"; cat -n /tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/rpath_wrapper_ld.log | grep --color -e "running .*ld .* -o[^ ]* $basefile " | grep --color -E "bin/ld | -rpath| -o[^ ]* $basefile "; done
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/c++
checking rpath_wrapper_ld.log for c++
found pattern ' c++ ' 0 times in rpath_wrapper_ld.log
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/g++
checking rpath_wrapper_ld.log for g++
found pattern ' g++ ' 0 times in rpath_wrapper_ld.log
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/gcov
checking rpath_wrapper_ld.log for gcov
found pattern ' gcov ' 6 times in rpath_wrapper_ld.log
  4185  (323526) [2023-05-26 20:03:26] running '/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/bin/ld -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64 -rpath=$ORIGIN -rpath=$ORIGIN/../lib -rpath=$ORIGIN/../lib64 --disable-new-dtags -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib -plugin /tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/liblto_plugin.so -plugin-opt=/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/lto-wrapper -plugin-opt=-fresolution=/tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/ccanAoaZ.res -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh -plugin-opt=-pass-through=-lc -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh --sysroot=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64 --eh-frame-hdr -m elf_x86_64 -dynamic-linker /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib64/ld-linux-x86-64.so.2 -o gcov /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crt1.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crti.o /tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtbegin.o -L./../zlib -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib gcov.o json.o hash-table.o ggc-none.o libcommon.a ../libcpp/libcpp.a ../libbacktrace/.libs/libbacktrace.a ../libiberty/libiberty.a ../libdecnumber/libdecnumber.a -lz -Bstatic -lstdc++ -Bdynamic -lm -lgcc -lgcc_eh -lc -lgcc -lgcc_eh /tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtend.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crtn.o'
  8360  (701683) [2023-05-26 20:38:33] running '/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/bin/ld -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64 -rpath=$ORIGIN -rpath=$ORIGIN/../lib -rpath=$ORIGIN/../lib64 --disable-new-dtags -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib -plugin /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/liblto_plugin.so -plugin-opt=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/lto-wrapper -plugin-opt=-fresolution=/tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/ccXhFDax.res -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh -plugin-opt=-pass-through=-lc -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh --sysroot=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64 --eh-frame-hdr -m elf_x86_64 -dynamic-linker /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib64/ld-linux-x86-64.so.2 -o gcov /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crt1.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crti.o /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtbegin.o -L./../zlib -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib gcov.o json.o hash-table.o ggc-none.o libcommon.a ../libcpp/libcpp.a ../libbacktrace/.libs/libbacktrace.a ../libiberty/libiberty.a ../libdecnumber/libdecnumber.a -lz -Bstatic -lstdc++ -Bdynamic -lm -lgcc -lgcc_eh -lc -lgcc -lgcc_eh /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtend.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crtn.o'
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/gcov-dump
checking rpath_wrapper_ld.log for gcov-dump
found pattern ' gcov-dump ' 6 times in rpath_wrapper_ld.log
  4190  (323544) [2023-05-26 20:03:26] running '/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/bin/ld -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64 -rpath=$ORIGIN -rpath=$ORIGIN/../lib -rpath=$ORIGIN/../lib64 --disable-new-dtags -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib -plugin /tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/liblto_plugin.so -plugin-opt=/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/lto-wrapper -plugin-opt=-fresolution=/tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/ccXfejwv.res -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh -plugin-opt=-pass-through=-lc -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh --sysroot=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64 --eh-frame-hdr -m elf_x86_64 -dynamic-linker /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib64/ld-linux-x86-64.so.2 -o gcov-dump /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crt1.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crti.o /tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtbegin.o -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib gcov-dump.o hash-table.o ggc-none.o libcommon.a ../libcpp/libcpp.a ../libbacktrace/.libs/libbacktrace.a ../libiberty/libiberty.a ../libdecnumber/libdecnumber.a -Bstatic -lstdc++ -Bdynamic -lm -lgcc -lgcc_eh -lc -lgcc -lgcc_eh /tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtend.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crtn.o'
  8319  (701513) [2023-05-26 20:38:32] running '/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/bin/ld -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64 -rpath=$ORIGIN -rpath=$ORIGIN/../lib -rpath=$ORIGIN/../lib64 --disable-new-dtags -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib -plugin /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/liblto_plugin.so -plugin-opt=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/lto-wrapper -plugin-opt=-fresolution=/tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/cc4wc6tk.res -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh -plugin-opt=-pass-through=-lc -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh --sysroot=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64 --eh-frame-hdr -m elf_x86_64 -dynamic-linker /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib64/ld-linux-x86-64.so.2 -o gcov-dump /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crt1.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crti.o /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtbegin.o -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib gcov-dump.o hash-table.o ggc-none.o libcommon.a ../libcpp/libcpp.a ../libbacktrace/.libs/libbacktrace.a ../libiberty/libiberty.a ../libdecnumber/libdecnumber.a -Bstatic -lstdc++ -Bdynamic -lm -lgcc -lgcc_eh -lc -lgcc -lgcc_eh /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtend.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crtn.o'
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/gfortran
checking rpath_wrapper_ld.log for gfortran
found pattern ' gfortran ' 3 times in rpath_wrapper_ld.log
  8379  (701713) [2023-05-26 20:38:34] running '/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/bin/ld -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64 -rpath=$ORIGIN -rpath=$ORIGIN/../lib -rpath=$ORIGIN/../lib64 --disable-new-dtags -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib -plugin /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/liblto_plugin.so -plugin-opt=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/lto-wrapper -plugin-opt=-fresolution=/tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/ccN2Lynf.res -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh -plugin-opt=-pass-through=-lc -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh --sysroot=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64 --eh-frame-hdr -m elf_x86_64 -dynamic-linker /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib64/ld-linux-x86-64.so.2 -o gfortran /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crt1.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crti.o /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtbegin.o -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib gcc.o gcc-main.o ggc-none.o fortran/gfortranspec.o libcommon-target.a libcommon.a ../libcpp/libcpp.a ../libbacktrace/.libs/libbacktrace.a ../libiberty/libiberty.a ../libdecnumber/libdecnumber.a -Bstatic -lstdc++ -Bdynamic -lm -lgcc -lgcc_eh -lc -lgcc -lgcc_eh /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtend.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crtn.o'
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/x86_64-pc-linux-gnu-c++
checking rpath_wrapper_ld.log for x86_64-pc-linux-gnu-c++
found pattern ' x86_64-pc-linux-gnu-c++ ' 0 times in rpath_wrapper_ld.log
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/x86_64-pc-linux-gnu-gfortran
checking rpath_wrapper_ld.log for x86_64-pc-linux-gnu-gfortran
found pattern ' x86_64-pc-linux-gnu-gfortran ' 0 times in rpath_wrapper_ld.log
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/x86_64-pc-linux-gnu-g++
checking rpath_wrapper_ld.log for x86_64-pc-linux-gnu-g++
found pattern ' x86_64-pc-linux-gnu-g++ ' 0 times in rpath_wrapper_ld.log
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/lto-dump
checking rpath_wrapper_ld.log for lto-dump
found pattern ' lto-dump ' 6 times in rpath_wrapper_ld.log
  4249  (323787) [2023-05-26 20:03:35] running '/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/bin/ld -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64 -rpath=$ORIGIN -rpath=$ORIGIN/../lib -rpath=$ORIGIN/../lib64 --disable-new-dtags -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib -plugin /tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/liblto_plugin.so -plugin-opt=/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/lto-wrapper -plugin-opt=-fresolution=/tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/ccOpbeIr.res -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh -plugin-opt=-pass-through=-lc -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh --sysroot=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64 --eh-frame-hdr -m elf_x86_64 -export-dynamic -dynamic-linker /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib64/ld-linux-x86-64.so.2 -o lto-dump /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crt1.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crti.o /tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtbegin.o -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/gcc-11.3.0/stage2_stuff/lib -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/gcc-11.3.0/stage3_obj/./gmp/.libs -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/gcc-11.3.0/stage3_obj/./mpfr/src/.libs -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/gcc-11.3.0/stage3_obj/./mpc/src/.libs -L./../zlib -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib lto/lto-lang.o lto/lto-object.o attribs.o lto/lto-partition.o lto/lto-symtab.o lto/lto-dump.o lto/lto-common.o libbackend.a main.o libcommon-target.a libcommon.a ../libcpp/libcpp.a ../libdecnumber/libdecnumber.a -lisl -lmpc -lmpfr -lgmp -lz -lzstd libcommon.a ../libcpp/libcpp.a ../libbacktrace/.libs/libbacktrace.a ../libiberty/libiberty.a ../libdecnumber/libdecnumber.a -Bstatic -lstdc++ -Bdynamic -lm -lgcc -lgcc_eh -lc -lgcc -lgcc_eh /tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtend.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crtn.o'
  8393  (701815) [2023-05-26 20:39:24] running '/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/bin/ld -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64 -rpath=$ORIGIN -rpath=$ORIGIN/../lib -rpath=$ORIGIN/../lib64 --disable-new-dtags -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib -plugin /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/liblto_plugin.so -plugin-opt=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/lto-wrapper -plugin-opt=-fresolution=/tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/ccuINiuh.res -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh -plugin-opt=-pass-through=-lc -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh --sysroot=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64 --eh-frame-hdr -m elf_x86_64 -export-dynamic -dynamic-linker /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib64/ld-linux-x86-64.so.2 -o lto-dump /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crt1.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crti.o /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtbegin.o -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/gcc-11.3.0/build-nvptx-gcc/./gmp/.libs -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/gcc-11.3.0/build-nvptx-gcc/./mpfr/src/.libs -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/gcc-11.3.0/build-nvptx-gcc/./mpc/src/.libs -L./../zlib -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib lto/lto-lang.o lto/lto-object.o attribs.o lto/lto-partition.o lto/lto-symtab.o lto/lto-dump.o lto/lto-common.o libbackend.a main.o libcommon-target.a libcommon.a ../libcpp/libcpp.a ../libdecnumber/libdecnumber.a -lmpc -lmpfr -lgmp -lz -lzstd libcommon.a ../libcpp/libcpp.a ../libbacktrace/.libs/libbacktrace.a ../libiberty/libiberty.a ../libdecnumber/libdecnumber.a -Bstatic -lstdc++ -Bdynamic -lm -lgcc -lgcc_eh -lc -lgcc -lgcc_eh /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtend.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crtn.o'
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/gcc
checking rpath_wrapper_ld.log for gcc
found pattern ' gcc ' 0 times in rpath_wrapper_ld.log
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/x86_64-pc-linux-gnu-gcc-ar
checking rpath_wrapper_ld.log for x86_64-pc-linux-gnu-gcc-ar
found pattern ' x86_64-pc-linux-gnu-gcc-ar ' 0 times in rpath_wrapper_ld.log
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/gcc-ranlib
checking rpath_wrapper_ld.log for gcc-ranlib
found pattern ' gcc-ranlib ' 6 times in rpath_wrapper_ld.log
  4222  (323653) [2023-05-26 20:03:27] running '/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/bin/ld -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64 -rpath=$ORIGIN -rpath=$ORIGIN/../lib -rpath=$ORIGIN/../lib64 --disable-new-dtags -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib -plugin /tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/liblto_plugin.so -plugin-opt=/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/lto-wrapper -plugin-opt=-fresolution=/tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/ccUpxLSx.res -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh -plugin-opt=-pass-through=-lc -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh --sysroot=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64 --eh-frame-hdr -m elf_x86_64 -dynamic-linker /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib64/ld-linux-x86-64.so.2 -o gcc-ranlib /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crt1.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crti.o /tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtbegin.o -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib gcc-ranlib.o file-find.o libcommon.a ../libcpp/libcpp.a ../libbacktrace/.libs/libbacktrace.a ../libiberty/libiberty.a ../libdecnumber/libdecnumber.a -Bstatic -lstdc++ -Bdynamic -lm -lgcc -lgcc_eh -lc -lgcc -lgcc_eh /tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtend.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crtn.o'
  8352  (701639) [2023-05-26 20:38:33] running '/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/bin/ld -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64 -rpath=$ORIGIN -rpath=$ORIGIN/../lib -rpath=$ORIGIN/../lib64 --disable-new-dtags -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib -plugin /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/liblto_plugin.so -plugin-opt=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/lto-wrapper -plugin-opt=-fresolution=/tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/cc7XORV7.res -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh -plugin-opt=-pass-through=-lc -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh --sysroot=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64 --eh-frame-hdr -m elf_x86_64 -dynamic-linker /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib64/ld-linux-x86-64.so.2 -o gcc-ranlib /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crt1.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crti.o /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtbegin.o -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib gcc-ranlib.o file-find.o libcommon.a ../libcpp/libcpp.a ../libbacktrace/.libs/libbacktrace.a ../libiberty/libiberty.a ../libdecnumber/libdecnumber.a -Bstatic -lstdc++ -Bdynamic -lm -lgcc -lgcc_eh -lc -lgcc -lgcc_eh /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtend.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crtn.o'
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/gcc-ar
checking rpath_wrapper_ld.log for gcc-ar
found pattern ' gcc-ar ' 6 times in rpath_wrapper_ld.log
  4210  (323610) [2023-05-26 20:03:27] running '/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/bin/ld -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64 -rpath=$ORIGIN -rpath=$ORIGIN/../lib -rpath=$ORIGIN/../lib64 --disable-new-dtags -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib -plugin /tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/liblto_plugin.so -plugin-opt=/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/lto-wrapper -plugin-opt=-fresolution=/tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/ccXxBFnT.res -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh -plugin-opt=-pass-through=-lc -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh --sysroot=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64 --eh-frame-hdr -m elf_x86_64 -dynamic-linker /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib64/ld-linux-x86-64.so.2 -o gcc-ar /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crt1.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crti.o /tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtbegin.o -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib gcc-ar.o file-find.o libcommon.a ../libcpp/libcpp.a ../libbacktrace/.libs/libbacktrace.a ../libiberty/libiberty.a ../libdecnumber/libdecnumber.a -Bstatic -lstdc++ -Bdynamic -lm -lgcc -lgcc_eh -lc -lgcc -lgcc_eh /tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtend.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crtn.o'
  8342  (701604) [2023-05-26 20:38:33] running '/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/bin/ld -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64 -rpath=$ORIGIN -rpath=$ORIGIN/../lib -rpath=$ORIGIN/../lib64 --disable-new-dtags -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib -plugin /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/liblto_plugin.so -plugin-opt=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/lto-wrapper -plugin-opt=-fresolution=/tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/cczd7Wa5.res -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh -plugin-opt=-pass-through=-lc -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh --sysroot=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64 --eh-frame-hdr -m elf_x86_64 -dynamic-linker /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib64/ld-linux-x86-64.so.2 -o gcc-ar /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crt1.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crti.o /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtbegin.o -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib gcc-ar.o file-find.o libcommon.a ../libcpp/libcpp.a ../libbacktrace/.libs/libbacktrace.a ../libiberty/libiberty.a ../libdecnumber/libdecnumber.a -Bstatic -lstdc++ -Bdynamic -lm -lgcc -lgcc_eh -lc -lgcc -lgcc_eh /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtend.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crtn.o'
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/x86_64-pc-linux-gnu-gcc-ranlib
checking rpath_wrapper_ld.log for x86_64-pc-linux-gnu-gcc-ranlib
found pattern ' x86_64-pc-linux-gnu-gcc-ranlib ' 0 times in rpath_wrapper_ld.log
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/x86_64-pc-linux-gnu-gcc-nm
checking rpath_wrapper_ld.log for x86_64-pc-linux-gnu-gcc-nm
found pattern ' x86_64-pc-linux-gnu-gcc-nm ' 0 times in rpath_wrapper_ld.log
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/cpp
checking rpath_wrapper_ld.log for cpp
found pattern ' cpp ' 6 times in rpath_wrapper_ld.log
  4235  (323707) [2023-05-26 20:03:27] running '/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/bin/ld -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64 -rpath=$ORIGIN -rpath=$ORIGIN/../lib -rpath=$ORIGIN/../lib64 --disable-new-dtags -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib -plugin /tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/liblto_plugin.so -plugin-opt=/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/lto-wrapper -plugin-opt=-fresolution=/tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/cc3n6Uqv.res -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh -plugin-opt=-pass-through=-lc -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh --sysroot=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64 --eh-frame-hdr -m elf_x86_64 -dynamic-linker /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib64/ld-linux-x86-64.so.2 -o cpp /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crt1.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crti.o /tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtbegin.o -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib gcc.o gcc-main.o ggc-none.o c-family/cppspec.o driver-i386.o libcommon-target.a libcommon.a ../libcpp/libcpp.a ../libbacktrace/.libs/libbacktrace.a ../libiberty/libiberty.a ../libdecnumber/libdecnumber.a -Bstatic -lstdc++ -Bdynamic -lm -lgcc -lgcc_eh -lc -lgcc -lgcc_eh /tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtend.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crtn.o'
  8377  (701712) [2023-05-26 20:38:34] running '/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/bin/ld -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64 -rpath=$ORIGIN -rpath=$ORIGIN/../lib -rpath=$ORIGIN/../lib64 --disable-new-dtags -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib -plugin /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/liblto_plugin.so -plugin-opt=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/lto-wrapper -plugin-opt=-fresolution=/tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/ccCOw74L.res -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh -plugin-opt=-pass-through=-lc -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh --sysroot=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64 --eh-frame-hdr -m elf_x86_64 -dynamic-linker /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib64/ld-linux-x86-64.so.2 -o cpp /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crt1.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crti.o /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtbegin.o -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib gcc.o gcc-main.o ggc-none.o c-family/cppspec.o libcommon-target.a libcommon.a ../libcpp/libcpp.a ../libbacktrace/.libs/libbacktrace.a ../libiberty/libiberty.a ../libdecnumber/libdecnumber.a -Bstatic -lstdc++ -Bdynamic -lm -lgcc -lgcc_eh -lc -lgcc -lgcc_eh /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtend.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crtn.o'
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/gcc-nm
checking rpath_wrapper_ld.log for gcc-nm
found pattern ' gcc-nm ' 6 times in rpath_wrapper_ld.log
  4215  (323637) [2023-05-26 20:03:27] running '/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/bin/ld -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64 -rpath=$ORIGIN -rpath=$ORIGIN/../lib -rpath=$ORIGIN/../lib64 --disable-new-dtags -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib -plugin /tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/liblto_plugin.so -plugin-opt=/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/lto-wrapper -plugin-opt=-fresolution=/tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/ccaFW1Xo.res -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh -plugin-opt=-pass-through=-lc -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh --sysroot=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64 --eh-frame-hdr -m elf_x86_64 -dynamic-linker /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib64/ld-linux-x86-64.so.2 -o gcc-nm /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crt1.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crti.o /tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtbegin.o -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib gcc-nm.o file-find.o libcommon.a ../libcpp/libcpp.a ../libbacktrace/.libs/libbacktrace.a ../libiberty/libiberty.a ../libdecnumber/libdecnumber.a -Bstatic -lstdc++ -Bdynamic -lm -lgcc -lgcc_eh -lc -lgcc -lgcc_eh /tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtend.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crtn.o'
  8345  (701614) [2023-05-26 20:38:33] running '/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/bin/ld -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64 -rpath=$ORIGIN -rpath=$ORIGIN/../lib -rpath=$ORIGIN/../lib64 --disable-new-dtags -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib -plugin /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/liblto_plugin.so -plugin-opt=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/lto-wrapper -plugin-opt=-fresolution=/tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/cc6YjkDJ.res -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh -plugin-opt=-pass-through=-lc -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh --sysroot=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64 --eh-frame-hdr -m elf_x86_64 -dynamic-linker /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib64/ld-linux-x86-64.so.2 -o gcc-nm /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crt1.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crti.o /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtbegin.o -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib gcc-nm.o file-find.o libcommon.a ../libcpp/libcpp.a ../libbacktrace/.libs/libbacktrace.a ../libiberty/libiberty.a ../libdecnumber/libdecnumber.a -Bstatic -lstdc++ -Bdynamic -lm -lgcc -lgcc_eh -lc -lgcc -lgcc_eh /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtend.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crtn.o'
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/x86_64-pc-linux-gnu-gcc
checking rpath_wrapper_ld.log for x86_64-pc-linux-gnu-gcc
found pattern ' x86_64-pc-linux-gnu-gcc ' 0 times in rpath_wrapper_ld.log
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/gcov-tool
checking rpath_wrapper_ld.log for gcov-tool
found pattern ' gcov-tool ' 6 times in rpath_wrapper_ld.log
  4197  (323565) [2023-05-26 20:03:26] running '/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/bin/ld -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64 -rpath=$ORIGIN -rpath=$ORIGIN/../lib -rpath=$ORIGIN/../lib64 --disable-new-dtags -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib -plugin /tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/liblto_plugin.so -plugin-opt=/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/lto-wrapper -plugin-opt=-fresolution=/tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/ccEeDaI2.res -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh -plugin-opt=-pass-through=-lc -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh --sysroot=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64 --eh-frame-hdr -m elf_x86_64 -dynamic-linker /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib64/ld-linux-x86-64.so.2 -o gcov-tool /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crt1.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crti.o /tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtbegin.o -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -L/tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib gcov-tool.o libgcov-util.o libgcov-driver-tool.o libgcov-merge-tool.o libcommon.a ../libcpp/libcpp.a ../libbacktrace/.libs/libbacktrace.a ../libiberty/libiberty.a ../libdecnumber/libdecnumber.a -Bstatic -lstdc++ -Bdynamic -lm -lgcc -lgcc_eh -lc -lgcc -lgcc_eh /tmp/nessibot/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtend.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crtn.o'
  8320  (701514) [2023-05-26 20:38:32] running '/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/bin/ld -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64 -rpath=$ORIGIN -rpath=$ORIGIN/../lib -rpath=$ORIGIN/../lib64 --disable-new-dtags -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib -plugin /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/liblto_plugin.so -plugin-opt=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/lto-wrapper -plugin-opt=-fresolution=/tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/ccaHUJs3.res -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh -plugin-opt=-pass-through=-lc -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh --sysroot=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64 --eh-frame-hdr -m elf_x86_64 -dynamic-linker /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib64/ld-linux-x86-64.so.2 -o gcov-tool /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crt1.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crti.o /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtbegin.o -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib gcov-tool.o libgcov-util.o libgcov-driver-tool.o libgcov-merge-tool.o libcommon.a ../libcpp/libcpp.a ../libbacktrace/.libs/libbacktrace.a ../libiberty/libiberty.a ../libdecnumber/libdecnumber.a -Bstatic -lstdc++ -Bdynamic -lm -lgcc -lgcc_eh -lc -lgcc -lgcc_eh /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtend.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crtn.o'
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libssp.so.0.0.0
checking rpath_wrapper_ld.log for libssp.so.0.0.0
found pattern ' libssp.so.0.0.0 ' 0 times in rpath_wrapper_ld.log
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libatomic.so.1.2.0
checking rpath_wrapper_ld.log for libatomic.so.1.2.0
found pattern ' libatomic.so.1.2.0 ' 0 times in rpath_wrapper_ld.log
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libquadmath.so.0.0.0
checking rpath_wrapper_ld.log for libquadmath.so.0.0.0
found pattern ' libquadmath.so.0.0.0 ' 0 times in rpath_wrapper_ld.log
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libubsan.so.1.0.0
checking rpath_wrapper_ld.log for libubsan.so.1.0.0
found pattern ' libubsan.so.1.0.0 ' 0 times in rpath_wrapper_ld.log
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libtsan.so.0.0.0
checking rpath_wrapper_ld.log for libtsan.so.0.0.0
found pattern ' libtsan.so.0.0.0 ' 0 times in rpath_wrapper_ld.log
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libasan.so.6.0.0
checking rpath_wrapper_ld.log for libasan.so.6.0.0
found pattern ' libasan.so.6.0.0 ' 0 times in rpath_wrapper_ld.log
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libitm.so.1.0.0
checking rpath_wrapper_ld.log for libitm.so.1.0.0
found pattern ' libitm.so.1.0.0 ' 0 times in rpath_wrapper_ld.log
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/liblsan.so.0.0.0
checking rpath_wrapper_ld.log for liblsan.so.0.0.0
found pattern ' liblsan.so.0.0.0 ' 0 times in rpath_wrapper_ld.log
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libgfortran.so.5.0.0
checking rpath_wrapper_ld.log for libgfortran.so.5.0.0
found pattern ' libgfortran.so.5.0.0 ' 0 times in rpath_wrapper_ld.log
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libgomp.so.1.0.0
checking rpath_wrapper_ld.log for libgomp.so.1.0.0
found pattern ' libgomp.so.1.0.0 ' 0 times in rpath_wrapper_ld.log
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libstdc++.so.6.0.29
checking rpath_wrapper_ld.log for libstdc++.so.6.0.29
found pattern ' libstdc++.so.6.0.29 ' 0 times in rpath_wrapper_ld.log
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libgomp-plugin-nvptx.so.1.0.0
checking rpath_wrapper_ld.log for libgomp-plugin-nvptx.so.1.0.0
found pattern ' libgomp-plugin-nvptx.so.1.0.0 ' 0 times in rpath_wrapper_ld.log
/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64/libgcc_s.so.1
checking rpath_wrapper_ld.log for libgcc_s.so.1
found pattern ' libgcc_s.so.1 ' 0 times in rpath_wrapper_ld.log

For the two libraries (libcc1.so.0 and libcc1.so.0.0.0) with RPATH section a slightly modified analysis shows this

information in rpath_wrapper_ld.log about libraries with RPATH section
Apptainer> for file in libcc1.so.0 libcc1.so.0.0.0; do echo $file; basefile=$(basename $file); echo checking rpath_wrapper_ld.log for $basefile; ntimes=$(grep " $basefile " /tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/rpath_wrapper_ld.log | wc -l); echo "found pattern ' $basefile ' $ntimes times in rpath_wrapper_ld.log"; cat -n /tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/rpath_wrapper_ld.log | grep --color -e "running.*ld.* $basefile "; done
libcc1.so.0
checking rpath_wrapper_ld.log for libcc1.so.0
found pattern ' libcc1.so.0 ' 3 times in rpath_wrapper_ld.log
  8415  (703721) [2023-05-26 20:39:31] running '/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/bin/ld -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64 -rpath=$ORIGIN -rpath=$ORIGIN/../lib -rpath=$ORIGIN/../lib64 --disable-new-dtags -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib -plugin /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/liblto_plugin.so -plugin-opt=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/lto-wrapper -plugin-opt=-fresolution=/tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/ccZXG4wt.res --sysroot=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64 --eh-frame-hdr -m elf_x86_64 -shared -o .libs/libcc1.so.0.0.0 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crti.o /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtbeginS.o .libs/findcomp.o .libs/libcc1.o .libs/libcp1.o .libs/names.o .libs/callbacks.o .libs/connection.o .libs/marshall.o -rpath /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/../lib64 -rpath /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/../lib64 /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/../lib64/libstdc++.so -lm -lc -lgcc_s /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtendS.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crtn.o ../libiberty/pic/libiberty.a -soname libcc1.so.0 -retain-symbols-file ../.././libcc1/libcc1.sym'
libcc1.so.0.0.0
checking rpath_wrapper_ld.log for libcc1.so.0.0.0
found pattern ' libcc1.so.0.0.0 ' 0 times in rpath_wrapper_ld.log

For the four binaries (nvptx-none-as nvptx-none-ld x86_64-pc-linux-gnu-accel-nvptx-none-gcc x86_64-pc-linux-gnu-accel-nvptx-none-lto-dump) with RPATH section a slightly modified analysis shows this

information in rpath_wrapper_ld.log about binaries with RPATH section
Apptainer> for file in nvptx-none-as nvptx-none-ld x86_64-pc-linux-gnu-accel-nvptx-none-gcc x86_64-pc-linux-gnu-accel-nvptx-none-lto-dump; do echo $file; basefile=$(basename $file); echo checking rpath_wrapper_ld.log for $basefile; ntimes=$(grep " $basefile " /tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/rpath_wrapper_ld.log | wc -l); echo "found pattern ' $basefile ' $ntimes times in rpath_wrapper_ld.log"; cat -n /tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/rpath_wrapper_ld.log | grep --color -e "running.*ld.* $basefile "; done
nvptx-none-as
checking rpath_wrapper_ld.log for nvptx-none-as
found pattern ' nvptx-none-as ' 3 times in rpath_wrapper_ld.log
  4800  (620869) [2023-05-26 20:34:06] running '/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/bin/ld -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64 -rpath=$ORIGIN -rpath=$ORIGIN/../lib -rpath=$ORIGIN/../lib64 --disable-new-dtags -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib -plugin /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/liblto_plugin.so -plugin-opt=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/lto-wrapper -plugin-opt=-fresolution=/tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/ccoNxfhh.res -plugin-opt=-pass-through=-lgcc_s -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lc -plugin-opt=-pass-through=-lgcc_s -plugin-opt=-pass-through=-lgcc --sysroot=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64 --eh-frame-hdr -m elf_x86_64 -dynamic-linker /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib64/ld-linux-x86-64.so.2 -o nvptx-none-as /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crt1.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crti.o /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtbegin.o -Llibiberty -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib /tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/ccZlNu3X.o -liberty -lstdc++ -lm -lgcc_s -lgcc -lc -lgcc_s -lgcc /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtend.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crtn.o'
nvptx-none-ld
checking rpath_wrapper_ld.log for nvptx-none-ld
found pattern ' nvptx-none-ld ' 3 times in rpath_wrapper_ld.log
  4805  (620887) [2023-05-26 20:34:06] running '/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/bin/ld -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib64 -rpath=$ORIGIN -rpath=$ORIGIN/../lib -rpath=$ORIGIN/../lib64 --disable-new-dtags -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -rpath=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib -plugin /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/liblto_plugin.so -plugin-opt=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/lto-wrapper -plugin-opt=-fresolution=/tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/ccYvzGpL.res -plugin-opt=-pass-through=-lgcc_s -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lc -plugin-opt=-pass-through=-lgcc_s -plugin-opt=-pass-through=-lgcc --sysroot=/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64 --eh-frame-hdr -m elf_x86_64 -dynamic-linker /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib64/ld-linux-x86-64.so.2 -o nvptx-none-ld /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crt1.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crti.o /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtbegin.o -Llibiberty -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../../../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64 -L/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/../../.. -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib -L/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib /tmp/eb-0klqo8p1/eb-hqluv4_f/eb-erv2kxzq/ccaldBY6.o -liberty -lstdc++ -lm -lgcc_s -lgcc -lc -lgcc_s -lgcc /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/lib/gcc/x86_64-pc-linux-gnu/11.3.0/crtend.o /cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64/crtn.o'
x86_64-pc-linux-gnu-accel-nvptx-none-gcc
checking rpath_wrapper_ld.log for x86_64-pc-linux-gnu-accel-nvptx-none-gcc
found pattern ' x86_64-pc-linux-gnu-accel-nvptx-none-gcc ' 0 times in rpath_wrapper_ld.log
x86_64-pc-linux-gnu-accel-nvptx-none-lto-dump
checking rpath_wrapper_ld.log for x86_64-pc-linux-gnu-accel-nvptx-none-lto-dump
found pattern ' x86_64-pc-linux-gnu-accel-nvptx-none-lto-dump ' 0 times in rpath_wrapper_ld.log

For GCC/10.3.0 (same CVMFS repo) it looks very different

libraries under GCCcore/10.3.0/lib64
Apptainer> dir=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64; for file in $(ls $dir | egrep -v -E '(py$|.la$|.a$|.o$|.spec$|libgcc_s.so$)'); do echo $file; readelf -d $dir/$file | grep RPATH; done
libasan.so.6
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
libasan.so.6.0.0
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
libatomic.so.1
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
libatomic.so.1.2.0
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
libcc1.so.0
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/gcc/x86_64-pc-linux-gnu/10.3.0:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/gcc/x86_64-pc-linux-gnu/10.3.0/../../../../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/gcc/x86_64-pc-linux-gnu/10.3.0/../../..:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/../lib64]
libcc1.so.0.0.0
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/gcc/x86_64-pc-linux-gnu/10.3.0:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/gcc/x86_64-pc-linux-gnu/10.3.0/../../../../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/gcc/x86_64-pc-linux-gnu/10.3.0/../../..:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/../lib64]
libgcc_s.so.1
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
libgfortran.so.5
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
libgfortran.so.5.0.0
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
libgomp-plugin-nvptx.so.1
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
libgomp-plugin-nvptx.so.1.0.0
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
libgomp.so.1
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
libgomp.so.1.0.0
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
libitm.so.1
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
libitm.so.1.0.0
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
liblsan.so.0
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
liblsan.so.0.0.0
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
libquadmath.so.0
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
libquadmath.so.0.0.0
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
libssp.so.0
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
libssp.so.0.0.0
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
libstdc++.so.6
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
libstdc++.so.6.0.28
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
libtsan.so.0
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
libtsan.so.0.0.0
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
libubsan.so.1
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
libubsan.so.1.0.0
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
binaries under GCCcore/10.3.0/bin

Only nvptx-none-ar and nvptx-none-ranlib lack the RPATH setting.

Apptainer> dir=/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/bin; for file in $(ls $dir | egrep -v -E '(py$|.la|.spec$|libgcc_s.so$)'); do echo $file; readelf -d $dir/$file | grep RPATH; done
c++
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
cc
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
cpp
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
f77
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
f95
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
g++
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
gcc
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
gcc-ar
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
gcc-nm
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
gcc-ranlib
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
gcov
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
gcov-dump
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
gcov-tool
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
gfortran
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
lto-dump
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
nvptx-none-ar
nvptx-none-as
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/gcc/x86_64-pc-linux-gnu/10.3.0:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/gcc/x86_64-pc-linux-gnu/10.3.0/../../../../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/gcc/x86_64-pc-linux-gnu/10.3.0/../../..:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
nvptx-none-ld
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/gcc/x86_64-pc-linux-gnu/10.3.0:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/gcc/x86_64-pc-linux-gnu/10.3.0/../../../../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/gcc/x86_64-pc-linux-gnu/10.3.0/../../..:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
nvptx-none-ranlib
x86_64-pc-linux-gnu-accel-nvptx-none-gcc
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/gcc/x86_64-pc-linux-gnu/10.3.0:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/gcc/x86_64-pc-linux-gnu/10.3.0/../../../../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/gcc/x86_64-pc-linux-gnu/10.3.0/../../..:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
x86_64-pc-linux-gnu-accel-nvptx-none-lto-dump
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/gcc/x86_64-pc-linux-gnu/10.3.0:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/gcc/x86_64-pc-linux-gnu/10.3.0/../../../../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib/gcc/x86_64-pc-linux-gnu/10.3.0/../../..:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
x86_64-pc-linux-gnu-c++
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
x86_64-pc-linux-gnu-g++
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
x86_64-pc-linux-gnu-gcc
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
x86_64-pc-linux-gnu-gcc-10.3.0
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
x86_64-pc-linux-gnu-gcc-ar
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
x86_64-pc-linux-gnu-gcc-nm
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
x86_64-pc-linux-gnu-gcc-ranlib
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]
x86_64-pc-linux-gnu-gfortran
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib:/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/10.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/lib:/cvmfs/pilot.nessi.no/versions/2023.04/compat/linux/x86_64/usr/lib]

@boegel
Copy link
Contributor Author

boegel commented May 27, 2023

I'm currently running the build of GCCcore/11.3.0 with EasyBuild 4.7.1, the patched GCC easyblock, on top of EESSI 2023.04 compat layer through strace to try and figure out which linker commands are used for the libraries/binaries that don't have an RPATH as expected...

@boegel
Copy link
Contributor Author

boegel commented May 27, 2023

I installed strace in the compat layer using emerge dev-util/strace to figure out the problem.

That revealed the following commands were used for building cc1 in the different stages of the GCCcore installation:

  • first cc1 binary, built during stage 1 of the GCC bootstrap performed by the GCC easyblock in EasyBuild:
[pid 135146] execve("/tmp/eb-57ieir2k/tmp017s_ef_/rpath_wrappers/gxx_wrapper/g++"
[pid 135152] execve("/cvmfs/pilot.eessi-hpc.org/versions/2021.12/compat/linux/x86_64/usr/lib/python-exec/python3.9/python"
[pid 135161] execve("/cvmfs/pilot.eessi-hpc.org/versions/2021.12/compat/linux/x86_64/usr/bin/g++"
[pid 135162] execve("/cvmfs/pilot.eessi-hpc.org/versions/2021.12/compat/linux/x86_64/usr/libexec/gcc/x86_64-pc-linux-gnu/9.4.0/collect2"
[pid 135164] execve("/cvmfs/pilot.eessi-hpc.org/versions/2021.12/compat/linux/x86_64/usr/lib/gcc/x86_64-pc-linux-gnu/9.4.0/../../../../x86_64-pc-linux-gnu/bin/ld"

This makes sense, since the g++ RPATH wrapper script that is generated by EasyBuild is being picked up, which injects -Wl,-rpath options, so the ld linker command indeed creates and RPATH section in the binary:

$ readelf -d /tmp/vsc40023/easybuild/build/GCCcore/11.3.0/system-system/gcc-11.3.0/stage3_obj/stage1-gcc/cc1 | grep RPATH
 0x000000000000000f (RPATH)              Library rpath: [/cvmfs/pilot.eessi-hpc.org/versions/2021.12/software/linux/x86_64/amd/zen3/software/GCCcore/11.3.0/lib:/cvmfs/pilot.eessi-hpc.org/versions/2021.12/software/linux/x86_64/amd/zen3/software/GCCcore/11.3.0/lib64:$ORIGIN:$ORIGIN/../lib:$ORIGIN/../lib64:/cvmfs/pilot.eessi-hpc.org/versions/2021.12/compat/linux/x86_64/lib/../lib64:/cvmfs/pilot.eessi-hpc.org/versions/2021.12/compat/linux/x86_64/usr/lib/../lib64:/cvmfs/pilot.eessi-hpc.org/versions/2021.12/compat/linux/x86_64/lib:/cvmfs/pilot.eessi-hpc.org/versions/2021.12/compat/linux/x86_64/usr/lib]

Similarly, for the 2nd cc1 (first part of stage 3 of the bootstrap, a.k.a. stage 3.1):

[pid 323827] execve("/tmp/vsc40023/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/bin/g++"
[pid 323828] execve("/tmp/vsc40023/easybuild/build/GCCcore/11.3.0/system-system/GCC_stage1_eb/libexec/gcc/x86_64-pc-linux-gnu/11.3.0/collect2"
[pid 323829] execve("/tmp/eb-57ieir2k/tmp017s_ef_/rpath_wrappers/ld_wrapper/ld"
[pid 323835] execve("/cvmfs/pilot.eessi-hpc.org/versions/2021.12/compat/linux/x86_64/usr/lib/python-exec/python3.9/python"
[pid 323849] execve("/cvmfs/pilot.eessi-hpc.org/versions/2021.12/compat/linux/x86_64/usr/bin/ld"

For the next cc1 (during stage 3.2), things are different however:

[pid 410068] execve("/tmp/vsc40023/easybuild/build/GCCcore/11.3.0/system-system/gcc-11.3.0/stage3_obj/./prev-gcc/xg++"
[pid 410070] execve("/tmp/vsc40023/easybuild/build/GCCcore/11.3.0/system-system/gcc-11.3.0/stage3_obj/./prev-gcc/collect2"
[pid 410072] execve("/tmp/vsc40023/easybuild/build/GCCcore/11.3.0/system-system/gcc-11.3.0/stage3_obj/./prev-gcc/collect-ld"
[pid 410072] execve("/cvmfs/pilot.eessi-hpc.org/versions/2021.12/compat/linux/x86_64/usr/bin/x86_64-pc-linux-gnu-ld"

The same goes from the final cc1 binary:

[pid 495583] execve("/tmp/vsc40023/easybuild/build/GCCcore/11.3.0/system-system/gcc-11.3.0/stage3_obj/./prev-gcc/xg++"
[pid 495585] execve("/tmp/vsc40023/easybuild/build/GCCcore/11.3.0/system-system/gcc-11.3.0/stage3_obj/./prev-gcc/collect2"
[pid 495586] execve("/tmp/vsc40023/easybuild/build/GCCcore/11.3.0/system-system/gcc-11.3.0/stage3_obj/./prev-gcc/collect-ld"
[pid 495586] execve("/cvmfs/pilot.eessi-hpc.org/versions/2021.12/compat/linux/x86_64/usr/bin/x86_64-pc-linux-gnu-ld"

Here, the xg++ compiler (from stage 3.1) calls x86_64-pc-linux-gnu-ld as linker command.

xg++ is probably called via an absolute path, and even if it's not there's no chance that the RPATH wrappers installed by EasyBuild kick in since that's only done for commands like gcc, g++, ld, ld.gold, etc.

EasyBuild currently (v4.7.1) doesn't install a wrapper for x86_64-pc-linux-gnu-ld, and since that command is is available in the compat layer, that's the linker command that gets used.
For some reason, this only happens when GCC is configured with --enable-gold --enable-ld=default, and not when --enable-gold=default --enable-ld --with-plugin-ld=ld.gold is used, since in that case the final binaries have an RPATH section as expected (probably because in every stage ld.gold is used as linker, and an RPATH wrapper is in place for that which ends up being used).

So, it seems we simply need to make sure there's are also wrapper in place for linker commands prefixed with x86_64-pc-linux-gnu-.
I've implemented exactly that in a hook that's called after the prepare step when GCCcore is being installed, see #251 - currently testing whether that indeed fixes the problem...

@boegel
Copy link
Contributor Author

boegel commented May 27, 2023

Hook implemented in #251 indeed fixes this problem (along with easybuilders/easybuild-easyblocks#2921 when using EasyBuild v4.7.1), test installation of GCCcore/11.3.0 on top of EESSI pilot 2023.04 now works like a charm:

== sanity checking...
  >> file 'bin/gcov' found: OK
  >> file 'bin/cpp' found: OK
  >> file 'bin/gcc' found: OK
  >> file 'bin/c++' found: OK
  >> file 'bin/g++' found: OK
  >> file 'bin/gfortran' found: OK
  >> file 'bin/nvptx-none-as' found: OK
  >> file 'bin/nvptx-none-ld' found: OK
  >> file 'lib64/libgcc_s.so' or 'lib/libgcc_s.so' or 'lib32/libgcc_s.so' found: OK
  >> file 'lib64/libasan.so' or 'lib/libasan.so' or 'lib32/libasan.so' found: OK
  >> file 'lib64/libasan.a' or 'lib/libasan.a' or 'lib32/libasan.a' found: OK
  >> file 'lib64/libstdc++.so' or 'lib/libstdc++.so' or 'lib32/libstdc++.so' found: OK
  >> file 'lib64/libstdc++.a' or 'lib/libstdc++.a' or 'lib32/libstdc++.a' found: OK
  >> file 'lib64/libgfortran.so' or 'lib/libgfortran.so' or 'lib32/libgfortran.so' found: OK
  >> file 'lib64/libgfortran.a' or 'lib/libgfortran.a' or 'lib32/libgfortran.a' found: OK
  >> file 'lib64/libgomp-plugin-nvptx.so' or 'lib/libgomp-plugin-nvptx.so' or 'lib32/libgomp-plugin-nvptx.so' found: OK
  >> file 'libexec/gcc/x86_64-pc-linux-gnu/11.3.0/cc1' or 'lib/gcc/x86_64-pc-linux-gnu/11.3.0/cc1' found: OK
  >> file 'libexec/gcc/x86_64-pc-linux-gnu/11.3.0/collect2' or 'lib/gcc/x86_64-pc-linux-gnu/11.3.0/collect2' found: OK
  >> file 'libexec/gcc/x86_64-pc-linux-gnu/11.3.0/cc1plus' or 'lib/gcc/x86_64-pc-linux-gnu/11.3.0/cc1plus' found: OK
  >> file 'libexec/gcc/x86_64-pc-linux-gnu/11.3.0/f951' or 'lib/gcc/x86_64-pc-linux-gnu/11.3.0/f951' found: OK
  >> file 'libexec/gcc/x86_64-pc-linux-gnu/11.3.0/lto1' or 'lib/gcc/x86_64-pc-linux-gnu/11.3.0/lto1' found: OK
  >> file 'libexec/gcc/x86_64-pc-linux-gnu/11.3.0/lto-wrapper' or 'lib/gcc/x86_64-pc-linux-gnu/11.3.0/lto-wrapper' found: OK
  >> file 'libexec/gcc/x86_64-pc-linux-gnu/11.3.0/liblto_plugin.so' or 'lib/gcc/x86_64-pc-linux-gnu/11.3.0/liblto_plugin.so' found: OK
  >> file 'bin/cc' found: OK
  >> file 'bin/c++' found: OK
  >> file 'bin/f77' found: OK
  >> file 'bin/f95' found: OK
  >> (non-empty) directory 'lib/gcc/x86_64-pc-linux-gnu/11.3.0' found: OK
  >> (non-empty) directory 'include/c++/11.3.0' found: OK
  >> loading modules: GCCcore/11.3.0...
  >> running command 'echo "int main(){} " | /cvmfs/pilot.eessi-hpc.org/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/gcc -x c -o/dev/null -' ...
  >> result for command 'echo "int main(){} " | /cvmfs/pilot.eessi-hpc.org/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/gcc -x c -o/dev/null -': OK
  >> running command 'echo "int main(){} " | /cvmfs/pilot.eessi-hpc.org/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/gcc -x c -flto -fuse-linker-plugin -o/dev/null
-' ...
  >> result for command 'echo "int main(){} " | /cvmfs/pilot.eessi-hpc.org/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/gcc -x c -flto -fuse-linker-plugin
-o/dev/null -': OK
  >> running command 'echo "int main(){} " | /cvmfs/pilot.eessi-hpc.org/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/g++ -x c++ -o/dev/null -' ...
  >> result for command 'echo "int main(){} " | /cvmfs/pilot.eessi-hpc.org/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/g++ -x c++ -o/dev/null -': OK
  >> running command 'echo "int main(){} " | /cvmfs/pilot.eessi-hpc.org/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/g++ -x c++ -flto -fuse-linker-plugin
-o/dev/null -' ...
  >> result for command 'echo "int main(){} " | /cvmfs/pilot.eessi-hpc.org/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/GCCcore/11.3.0/bin/g++ -x c++ -flto -fuse-linker-plugin
-o/dev/null -': OK
== ... (took 1 secs)
== cleaning up...
== ... (took 2 secs)
== creating module...
  >> generating module file @ /cvmfs/pilot.eessi-hpc.org/versions/2023.04/software/linux/x86_64/intel/cascadelake/modules/all/GCCcore/11.3.0.lua
== ... (took < 1 sec)
== permissions...
== ... (took < 1 sec)
== packaging...
== ... (took < 1 sec)
== COMPLETED: Installation ended successfully (took 46 mins 26 secs)

@boegel
Copy link
Contributor Author

boegel commented May 27, 2023

strace output with hook from #251 in place confirms that also putting an RPATH wrapper in place for x86_64-pc-linux-gnu-ld" fixes the issue, see sequence of commands from stage 3.3 that shows that the additional wrapper is picked up:

[pid 518914] execve("/tmp/vsc40023/easybuild/build/GCCcore/11.3.0/system-system/gcc-11.3.0/stage3_obj/./prev-gcc/xg++"
[pid 518916] execve("/tmp/vsc40023/easybuild/build/GCCcore/11.3.0/system-system/gcc-11.3.0/stage3_obj/./prev-gcc/collect2"
[pid 518918] execve("/tmp/vsc40023/easybuild/build/GCCcore/11.3.0/system-system/gcc-11.3.0/stage3_obj/./prev-gcc/collect-ld"
[pid 518918] execve("/tmp/eb-cre_wfju/tmpx619jw_h/rpath_wrappers/ld_wrapper/x86_64-pc-linux-gnu-ld"
[pid 518930] execve("/cvmfs/pilot.eessi-hpc.org/versions/2021.12/compat/linux/x86_64/usr/lib/python-exec/python3.9/python"
[pid 737014] execve("/cvmfs/pilot.eessi-hpc.org/versions/2021.12/compat/linux/x86_64/usr/bin/ld", ["/cvmfs/pilot.eessi-hpc.org/versions/2021.12/compat/linux/x86_64/usr/bin/ld", "-rpath=/cvmfs/pilot.eessi-hpc.org/versions/2021.12/software/linux/x86_64/amd/zen3/software/GCCcore/11.3.0/lib", ...

@bartoldeman
Copy link

I used EB 4.7.0, so using ld.bfd, but I did still use our ld wrapper with x86_64-pc-linux-gnu-ld (only overriding ld to call the binary directly, bypassing the script).

The way our ld wrapper works is as follows:

# Gentoo's binutils-config sets up symbolic links as follows:
# $EPREFIX/usr/bin/ld -> x86_64-pc-linux-gnu-ld ->
# $EPREFIX/usr/x86_64-pc-linux-gnu/bin/ld -*>
# $EPREFIX/usr/x86_64-pc-linux-gnu/binutils-bin/2.32/ld
#
# This wrapper will be symlinked at the -*> as GCC's collect2
# calls $EPREFIX/usr/x86_64-pc-linux-gnu/bin/ld

implemented via:
https://github.com/ComputeCanada/gentoo-overlay/tree/main/sys-devel/binutils-config

in practice it appears as follows:

$ ls -l `which ld`
lrwxrwxrwx 1 gentoouser gentoouser 22 May 10  2020 /cvmfs/soft.computecanada.ca/gentoo/2020/usr/bin/ld -> x86_64-pc-linux-gnu-ld
$ ls -l `which x86_64-pc-linux-gnu-ld`
lrwxrwxrwx 1 gentoouser gentoouser 71 May 10  2020 /cvmfs/soft.computecanada.ca/gentoo/2020/usr/bin/x86_64-pc-linux-gnu-ld -> /cvmfs/soft.computecanada.ca/gentoo/2020/usr/x86_64-pc-linux-gnu/bin/ld
$ ls -l /cvmfs/soft.computecanada.ca/gentoo/2020/usr/x86_64-pc-linux-gnu/bin/ld
lrwxrwxrwx 1 gentoouser gentoouser 62 May 10  2020 /cvmfs/soft.computecanada.ca/gentoo/2020/usr/x86_64-pc-linux-gnu/bin/ld -> /cvmfs/soft.computecanada.ca/gentoo/2020/usr/bin/ld-wrapper.sh

Then this wrapper will then determine the binary ld from:

PATH="${EPREFIX}/usr/bin:${EPREFIX}/bin"
MACHINE=$(gcc -dumpmachine)
source "${EPREFIX}"/etc/env.d/binutils/config-$MACHINE
source "${EPREFIX}"/etc/env.d/binutils/$MACHINE-$CURRENT
LD="${EPREFIX}"/usr/${TARGET}/binutils-bin/${VER}/ld${0#*ld}

@boegel
Copy link
Contributor Author

boegel commented May 27, 2023

Overview of GCCcore installations that worked on top of easybuilders/easybuild-easyblocks#2921 + #251 and EESSI pilot 2023.04 compat layer:

  • GCCcore/10.2.0
  • GCCcore/10.3.0
  • GCCcore/11.2.0
  • GCCcore/11.3.0
  • GCCcore/12.2.0

GCCcore/9.3.0 fails, but for a totally different reason, probably requires another patch like in easybuilders/easybuild-easyconfigs#14453, I'll look into that later.

trz42 pushed a commit to trz42/software-layer that referenced this issue Jan 23, 2024
only pick a software subdir that is present in the CVMFS repository
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working pilot-2023.04
Projects
None yet
3 participants