Snapshot for 20240603, v19.0.0, 2fbc9f2 (big-merge) #526

github-actions · 2024-06-03T01:22:40Z

Hello @kwk!

This issue exists to let you know that we are about to monitor the builds of the LLVM (v19.0.0, llvm/llvm-project@ 2fbc9f2) snapshot for 20240603.

At certain intervals the CI system will update this very comment over time to reflect the progress of builds.

Log analysis: For example if a build of the llvm project fails on the fedora-rawhide-x86_64 platform, we'll analyze the build log (if any) to identify the cause of the failure. The cause can be any of ['srpm_build_issue', 'copr_timeout', 'network_issue', 'dependency_issue', 'test', 'downstream_patch_application', 'rpm__installed_but_unpackaged_files_found', 'rpm__directory_not_found', 'rpm__file_not_found', 'cmake_error', 'unknown']. For each cause we will list the packages and the relevant log excerpts.
Use of labels: Let's assume a unit test test in upstream LLVM was broken. We will then add these labels to this issue: error/test, build_failed_on/fedora-rawhide-x86_64, project/llvm. If you manually restart a build in Copr and can bring it to a successful state, we will automatically remove the aforementioned labels.

Last updated: 2024-06-05T23:20:44.771767

Build Matrix

	llvm
fedora-39-aarch64 ✅ tests passed	✅
fedora-39-i386	✅
fedora-39-ppc64le ✅ tests passed 🔒	✅
fedora-39-s390x ❌ Copr build(s) failed	❌
fedora-39-x86_64 ✅ tests passed	✅
fedora-40-aarch64 ✅ tests passed	✅
fedora-40-i386	✅
fedora-40-ppc64le ✅ tests passed 🔒	✅
fedora-40-s390x ❌ Copr build(s) failed	❌
fedora-40-x86_64 ❌ Copr build(s) failed	❌
fedora-rawhide-aarch64 ❌ Copr build(s) failed	❌
fedora-rawhide-i386	✅
fedora-rawhide-ppc64le ❌ Copr build(s) failed	❌
fedora-rawhide-s390x ❌ Copr build(s) failed	❌
fedora-rawhide-x86_64 ❌ Copr build(s) failed	❌
rhel-9-aarch64 ✅ tests passed 🔒	✅
rhel-9-s390x ❌ Copr build(s) failed	❌
rhel-9-x86_64 ✅ tests passed 🔒	✅

Build status legend

⭕ : canceled
❌ : failed
☑️ : forked
📥 : importing
🔜 : pending
🏃 : running
🚫 : skipped
⭐ : starting
✅ : succeeded
⌛ : waiting
❔ : unknown
⚠️ : pipeline error (only relevant to testing-farm)

The text was updated successfully, but these errors were encountered:

github-actions · 2024-06-03T02:34:46Z

Errors found in Copr builds on `fedora-rawhide-x86_64`

cmake_error

llvm on fedora-rawhide-x86_64 (see build log, contribute to log-detective)

CMake Error at /usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:230 (message):
Jun 03 02:08:35   Could NOT find Threads (missing: Threads_FOUND)
Jun 03 02:08:35 Call Stack (most recent call first):
Jun 03 02:08:35   /usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:600 (_FPHSA_FAILURE_MESSAGE)
Jun 03 02:08:35   /usr/share/cmake/Modules/FindThreads.cmake:226 (FIND_PACKAGE_HANDLE_STANDARD_ARGS)
Jun 03 02:08:35   /builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/openmp/runtime/cmake/config-ix.cmake:158 (find_package)
Jun 03 02:08:35   /builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/openmp/runtime/CMakeLists.txt:279 (include)
Jun 03 02:08:35 
Jun 03 02:08:35 
Jun 03 02:08:35 -- Configuring incomplete, errors occurred!

github-actions · 2024-06-03T04:25:09Z

Errors found in Copr builds on `fedora-40-x86_64`

unknown
1. llvm on fedora-40-x86_64 (see build log, contribute to log-detective)
  
  Build log tail
  
  Sometimes the end of the build log contains useful information.
```
ssh: connect to host 3.85.189.150 port 22: Connection timed out
```
  RPM build errors
  
  If we have found RPM build errors in the log file, you'll find them here.
  Errors to look into
  
  If we have found the term error: (case insentitive) in the build log,
  you'll find all occurrences here together with the preceding lines.

github-actions · 2024-06-03T04:25:10Z

Errors found in Copr builds on `fedora-rawhide-aarch64`

cmake_error

llvm on fedora-rawhide-aarch64 (see build log, contribute to log-detective)

CMake Error at /usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:230 (message):
Jun 03 04:09:26   Could NOT find Threads (missing: Threads_FOUND)
Jun 03 04:09:26 Call Stack (most recent call first):
Jun 03 04:09:26   /usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:600 (_FPHSA_FAILURE_MESSAGE)
Jun 03 04:09:26   /usr/share/cmake/Modules/FindThreads.cmake:226 (FIND_PACKAGE_HANDLE_STANDARD_ARGS)
Jun 03 04:09:26   /builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/openmp/runtime/cmake/config-ix.cmake:158 (find_package)
Jun 03 04:09:26   /builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/openmp/runtime/CMakeLists.txt:279 (include)
Jun 03 04:09:26 
Jun 03 04:09:26 
Jun 03 04:09:26 -- Configuring incomplete, errors occurred!

github-actions · 2024-06-03T06:26:54Z

Errors found in Copr builds on `fedora-39-s390x`

unknown
1. llvm on fedora-39-s390x (see build log, contribute to log-detective)
  
  Build log tail
  
  Sometimes the end of the build log contains useful information.
```
ssh: connect to host 169.59.188.151 port 22: Connection timed out
```
  RPM build errors
  
  If we have found RPM build errors in the log file, you'll find them here.
  Errors to look into
  
  If we have found the term error: (case insentitive) in the build log,
  you'll find all occurrences here together with the preceding lines.

github-actions · 2024-06-03T06:26:57Z

Errors found in Copr builds on `fedora-40-s390x`

unknown
1. llvm on fedora-40-s390x (see build log, contribute to log-detective)
  
  Build log tail
  
  Sometimes the end of the build log contains useful information.
```
ssh: connect to host 150.239.84.156 port 22: Connection timed out
```
  RPM build errors
  
  If we have found RPM build errors in the log file, you'll find them here.
  Errors to look into
  
  If we have found the term error: (case insentitive) in the build log,
  you'll find all occurrences here together with the preceding lines.

github-actions · 2024-06-03T06:27:02Z

Errors found in Copr builds on `fedora-rawhide-s390x`

unknown
1. llvm on fedora-rawhide-s390x (see build log, contribute to log-detective)
  
  Build log tail
  
  Sometimes the end of the build log contains useful information.
```
ssh: connect to host 150.239.84.153 port 22: Connection timed out
```
  RPM build errors
  
  If we have found RPM build errors in the log file, you'll find them here.
  Errors to look into
  
  If we have found the term error: (case insentitive) in the build log,
  you'll find all occurrences here together with the preceding lines.

github-actions · 2024-06-03T06:27:04Z

Errors found in Copr builds on `rhel-9-s390x`

unknown
1. llvm on rhel-9-s390x (see build log, contribute to log-detective)
  
  Build log tail
  
  Sometimes the end of the build log contains useful information.
```
ssh: connect to host 169.59.162.238 port 22: Connection timed out
```
  RPM build errors
  
  If we have found RPM build errors in the log file, you'll find them here.
  Errors to look into
  
  If we have found the term error: (case insentitive) in the build log,
  you'll find all occurrences here together with the preceding lines.

nikic · 2024-06-03T08:09:01Z

Relevant output from redhat-linux-build/runtimes/runtimes-bins/CMakeFiles/CMakeConfigureLog.yaml shows why the nested cmake invocation fails:

    kind: "try_compile-v1"
    backtrace:
      - "/usr/share/cmake/Modules/FindThreads.cmake:136 (try_compile)"
      - "/usr/share/cmake/Modules/FindThreads.cmake:179 (_threads_check_flag_pthread)"
      - "/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/openmp/runtime/cmake/config-ix.cmake:158 (find_package)"
      - "/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/openmp/runtime/CMakeLists.txt:279 (include)"
    checks:
      - "Check if compiler accepts -pthread"
    directories:
      source: "/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/llvm/redhat-linux-build/runtimes/runtimes-bins/CMakeFiles/CMakeScratch/TryCompile-MoNDb6"
      binary: "/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/llvm/redhat-linux-build/runtimes/runtimes-bins/CMakeFiles/CMakeScratch/TryCompile-MoNDb6"
    cmakeVariables:
      CMAKE_CXX_COMPILER_CLANG_SCAN_DEPS: "CMAKE_CXX_COMPILER_CLANG_SCAN_DEPS-NOTFOUND"
      CMAKE_CXX_COMPILER_TARGET: "x86_64-redhat-linux-gnu"
      CMAKE_C_COMPILER_TARGET: "x86_64-redhat-linux-gnu"
      CMAKE_C_FLAGS: "-O2 -flto=thin -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config=/usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -m64 -march=x86-64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_DEFAULT_SOURCE -Dasm=__asm__ -Werror=date-time -Werror=unguarded-availability-new -Wall -Wextra -Wno-unused-parameter -Wwrite-strings -Wcast-qual -Wmissing-field-initializers -Wimplicit-fallthrough -Wcovered-switch-default -Wno-comment -Wstring-conversion -fdiagnostics-color -ffunction-sections -fdata-sections"
      CMAKE_C_FLAGS_DEBUG: "-g"
      CMAKE_EXE_LINKER_FLAGS: "-Wl,-z,relro -Wl,--as-needed  -Wl,-z,pack-relative-relocs -Wl,-z,now --config=/usr/lib/rpm/redhat/redhat-hardened-clang-ld.cfg  -flto=thin -ffat-lto-objects -Wl,--build-id=sha1"
      CMAKE_MODULE_PATH: "/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/openmp/runtime/cmake;/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/openmp/cmake;/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/openmp/../cmake/Modules;/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/runtimes/cmake;/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/runtimes/cmake/modules;/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/runtimes/../cmake;/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/runtimes/../cmake/Modules;/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/runtimes/../llvm/cmake;/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/runtimes/../llvm/cmake/modules"
    buildResult:
      variable: "THREADS_HAVE_PTHREAD_ARG"
      cached: true
      stdout: |
        Change Dir: '/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/llvm/redhat-linux-build/runtimes/runtimes-bins/CMakeFiles/CMakeScratch/TryCompile-MoNDb6'
        
        Run Build Command(s): /usr/bin/ninja-build -v cmTC_bd41e
        [1/2] "/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/llvm/redhat-linux-build/./bin/clang" --target=x86_64-redhat-linux-gnu   -O2 -flto=thin -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config=/usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -m64 -march=x86-64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_DEFAULT_SOURCE -Dasm=__asm__ -Werror=date-time -Werror=unguarded-availability-new -Wall -Wextra -Wno-unused-parameter -Wwrite-strings -Wcast-qual -Wmissing-field-initializers -Wimplicit-fallthrough -Wcovered-switch-default -Wno-comment -Wstring-conversion -fdiagnostics-color -ffunction-sections -fdata-sections -MD -MT CMakeFiles/cmTC_bd41e.dir/CheckForPthreads.c.o -MF CMakeFiles/cmTC_bd41e.dir/CheckForPthreads.c.o.d -o CMakeFiles/cmTC_bd41e.dir/CheckForPthreads.c.o -c '/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/llvm/redhat-linux-build/runtimes/runtimes-bins/CMakeFiles/CMakeScratch/TryCompile-MoNDb6/CheckForPthreads.c'
        [2/2] : && "/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/llvm/redhat-linux-build/./bin/clang" --target=x86_64-redhat-linux-gnu -O2 -flto=thin -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config=/usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -m64 -march=x86-64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_DEFAULT_SOURCE -Dasm=__asm__ -Werror=date-time -Werror=unguarded-availability-new -Wall -Wextra -Wno-unused-parameter -Wwrite-strings -Wcast-qual -Wmissing-field-initializers -Wimplicit-fallthrough -Wcovered-switch-default -Wno-comment -Wstring-conversion -fdiagnostics-color -ffunction-sections -fdata-sections -Wl,-z,relro -Wl,--as-needed  -Wl,-z,pack-relative-relocs -Wl,-z,now --config=/usr/lib/rpm/redhat/redhat-hardened-clang-ld.cfg  -flto=thin -ffat-lto-objects -Wl,--build-id=sha1 CMakeFiles/cmTC_bd41e.dir/CheckForPthreads.c.o -o cmTC_bd41e  -pthread && :
        FAILED: cmTC_bd41e 
        : && "/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/llvm/redhat-linux-build/./bin/clang" --target=x86_64-redhat-linux-gnu -O2 -flto=thin -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config=/usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -m64 -march=x86-64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_DEFAULT_SOURCE -Dasm=__asm__ -Werror=date-time -Werror=unguarded-availability-new -Wall -Wextra -Wno-unused-parameter -Wwrite-strings -Wcast-qual -Wmissing-field-initializers -Wimplicit-fallthrough -Wcovered-switch-default -Wno-comment -Wstring-conversion -fdiagnostics-color -ffunction-sections -fdata-sections -Wl,-z,relro -Wl,--as-needed  -Wl,-z,pack-relative-relocs -Wl,-z,now --config=/usr/lib/rpm/redhat/redhat-hardened-clang-ld.cfg  -flto=thin -ffat-lto-objects -Wl,--build-id=sha1 CMakeFiles/cmTC_bd41e.dir/CheckForPthreads.c.o -o cmTC_bd41e  -pthread && :
        /usr/bin/ld: /builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/llvm/redhat-linux-build/bin/../lib64/LLVMgold.so: error loading plugin: /builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/llvm/redhat-linux-build/bin/../lib64/LLVMgold.so: cannot open shared object file: No such file or directory
        clang: error: linker command failed with exit code 1 (use -v to see invocation)
        ninja: build stopped: subcommand failed.
        
      exitCode: 1
...

And indeed, the LLVMgold.so file is not present.

nikic · 2024-06-03T08:12:24Z

Doing an explicit ninja LLVMgold.so works though, so this seems like some kind of build order issue that was exposed by something changing on rawhide.

nikic · 2024-06-03T08:15:46Z

Rawhide updated to ninja 1.12, and the changelog (https://github.com/ninja-build/ninja/releases/tag/v1.12.0) has:

Critical path scheduler which orders the jobs by their runtime history ninja-build/ninja#2177
This may break your build if you haven't specified your dependencies correctly.

This looks very relevant!

nikic · 2024-06-03T09:33:15Z

Fix for the LLVMgold dependency issue: llvm/llvm-project#94199

nikic · 2024-06-06T06:07:02Z

Issue confirmed resolved.

github-actions bot assigned kwk Jun 3, 2024

github-actions bot added strategy/big-merge release/19.0.0 arch/x86_64 error/cmake_error project/llvm labels Jun 3, 2024

github-actions bot added in_testing/fedora-39-x86_64 in_testing/rhel-9-x86_64 arch/aarch64 error/unknown labels Jun 3, 2024

github-actions bot added tested_on/fedora-39-x86_64 tested_on/rhel-9-x86_64 arch/s390x and removed in_testing/fedora-39-x86_64 in_testing/rhel-9-x86_64 labels Jun 3, 2024

github-actions bot added the in_testing/rhel-9-aarch64 label Jun 3, 2024

github-actions bot added tested_on/fedora-40-aarch64 and removed in_testing/fedora-40-aarch64 labels Jun 3, 2024

This was referenced Jun 3, 2024

Snapshot for 20240602, v19.0.0, 0310f7f (big-merge) #525

Closed

Snapshot for 20240601, v19.0.0, f5bab96 (big-merge) #524

Closed

kwk removed arch/x86_64 labels Jun 4, 2024

nikic mentioned this issue Jun 5, 2024

Snapshot for 20240604, v19.0.0, ae1596a (big-merge) #528

Closed

nikic closed this as completed Jun 6, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Snapshot for 20240603, v19.0.0, 2fbc9f2 (big-merge) #526

Snapshot for 20240603, v19.0.0, 2fbc9f2 (big-merge) #526

github-actions bot commented Jun 3, 2024 •

edited

Loading

github-actions bot commented Jun 3, 2024

github-actions bot commented Jun 3, 2024

Build log tail

RPM build errors

Errors to look into

github-actions bot commented Jun 3, 2024

github-actions bot commented Jun 3, 2024

Build log tail

RPM build errors

Errors to look into

github-actions bot commented Jun 3, 2024

Build log tail

RPM build errors

Errors to look into

github-actions bot commented Jun 3, 2024

Build log tail

RPM build errors

Errors to look into

github-actions bot commented Jun 3, 2024

Build log tail

RPM build errors

Errors to look into

nikic commented Jun 3, 2024

nikic commented Jun 3, 2024

nikic commented Jun 3, 2024

nikic commented Jun 3, 2024

nikic commented Jun 6, 2024

Snapshot for 20240603, v19.0.0, 2fbc9f2 (big-merge) #526

Snapshot for 20240603, v19.0.0, 2fbc9f2 (big-merge) #526

Comments

github-actions bot commented Jun 3, 2024 • edited Loading

github-actions bot commented Jun 3, 2024

Errors found in Copr builds on fedora-rawhide-x86_64

github-actions bot commented Jun 3, 2024

Errors found in Copr builds on fedora-40-x86_64

Build log tail

RPM build errors

Errors to look into

github-actions bot commented Jun 3, 2024

Errors found in Copr builds on fedora-rawhide-aarch64

github-actions bot commented Jun 3, 2024

Errors found in Copr builds on fedora-39-s390x

Build log tail

RPM build errors

Errors to look into

github-actions bot commented Jun 3, 2024

Errors found in Copr builds on fedora-40-s390x

Build log tail

RPM build errors

Errors to look into

github-actions bot commented Jun 3, 2024

Errors found in Copr builds on fedora-rawhide-s390x

Build log tail

RPM build errors

Errors to look into

github-actions bot commented Jun 3, 2024

Errors found in Copr builds on rhel-9-s390x

Build log tail

RPM build errors

Errors to look into

nikic commented Jun 3, 2024

nikic commented Jun 3, 2024

nikic commented Jun 3, 2024

nikic commented Jun 3, 2024

nikic commented Jun 6, 2024

github-actions bot commented Jun 3, 2024 •

edited

Loading

Errors found in Copr builds on `fedora-rawhide-x86_64`

Errors found in Copr builds on `fedora-40-x86_64`

Errors found in Copr builds on `fedora-rawhide-aarch64`

Errors found in Copr builds on `fedora-39-s390x`

Errors found in Copr builds on `fedora-40-s390x`

Errors found in Copr builds on `fedora-rawhide-s390x`

Errors found in Copr builds on `rhel-9-s390x`