Snapshot for 20240603, v19.0.0, 2fbc9f2 (big-merge)

github-actions[bot] commented 4 weeks ago

Hello @kwk!

This issue exists to let you know that we are about to monitor the builds of the LLVM (v19.0.0, llvm/llvm-project@ 2fbc9f2) snapshot for 20240603.

At certain intervals the CI system will update this very comment over time to reflect the progress of builds.

Log analysis: For example if a build of the llvm project fails on the fedora-rawhide-x86_64 platform, we'll analyze the build log (if any) to identify the cause of the failure. The cause can be any of ['srpm_build_issue', 'copr_timeout', 'network_issue', 'dependency_issue', 'test', 'downstream_patch_application', 'rpm__installed_but_unpackaged_files_found', 'rpm__directory_not_found', 'rpm__file_not_found', 'cmake_error', 'unknown']. For each cause we will list the packages and the relevant log excerpts.
Use of labels: Let's assume a unit test test in upstream LLVM was broken. We will then add these labels to this issue: error/test, build_failed_on/fedora-rawhide-x86_64, project/llvm. If you manually restart a build in Copr and can bring it to a successful state, we will automatically remove the aforementioned labels.

Last updated: 2024-06-05T23:20:44.771767

Build Matrix

| |llvm| |:---|:---:| |fedora-39-aarch64
:white_check_mark: tests passed|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7522906)| |fedora-39-i386|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7522907)| |fedora-39-ppc64le
:white_check_mark: tests passed :lock: |[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7522908)| |fedora-39-s390x
:x: Copr build(s) failed|[:x:](https://copr.fedorainfracloud.org/coprs/build/7522909)| |fedora-39-x86_64
:white_check_mark: tests passed|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7522910)| |fedora-40-aarch64
:white_check_mark: tests passed|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7522911)| |fedora-40-i386|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7522912)| |fedora-40-ppc64le
:white_check_mark: tests passed :lock: |[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7522913)| |fedora-40-s390x
:x: Copr build(s) failed|[:x:](https://copr.fedorainfracloud.org/coprs/build/7522914)| |fedora-40-x86_64
:x: Copr build(s) failed|[:x:](https://copr.fedorainfracloud.org/coprs/build/7522915)| |fedora-rawhide-aarch64
:x: Copr build(s) failed|[:x:](https://copr.fedorainfracloud.org/coprs/build/7522916)| |fedora-rawhide-i386|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7522917)| |fedora-rawhide-ppc64le
:x: Copr build(s) failed|[:x:](https://copr.fedorainfracloud.org/coprs/build/7522918)| |fedora-rawhide-s390x
:x: Copr build(s) failed|[:x:](https://copr.fedorainfracloud.org/coprs/build/7522919)| |fedora-rawhide-x86_64
:x: Copr build(s) failed|[:x:](https://copr.fedorainfracloud.org/coprs/build/7522920)| |rhel-9-aarch64
:white_check_mark: tests passed :lock: |[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7522921)| |rhel-9-s390x
:x: Copr build(s) failed|[:x:](https://copr.fedorainfracloud.org/coprs/build/7522922)| |rhel-9-x86_64
:white_check_mark: tests passed :lock: |[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7522923)|

Build status legend

:o: : canceled
:x: : failed
:ballot_box_with_check: : forked
:inbox_tray: : importing
:soon: : pending
:running: : running
:no_entry_sign: : skipped
:star: : starting
:white_check_mark: : succeeded
:hourglass: : waiting
:grey_question: : unknown
:warning: : pipeline error (only relevant to testing-farm)

github-actions[bot] commented 4 weeks ago

Errors found in Copr builds on `fedora-rawhide-x86_64`

cmake_error
1. llvm on fedora-rawhide-x86_64 (see build log, contribute to log-detective)
``` CMake Error at /usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:230 (message): Jun 03 02:08:35 Could NOT find Threads (missing: Threads_FOUND) Jun 03 02:08:35 Call Stack (most recent call first): Jun 03 02:08:35 /usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:600 (_FPHSA_FAILURE_MESSAGE) Jun 03 02:08:35 /usr/share/cmake/Modules/FindThreads.cmake:226 (FIND_PACKAGE_HANDLE_STANDARD_ARGS) Jun 03 02:08:35 /builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/openmp/runtime/cmake/config-ix.cmake:158 (find_package) Jun 03 02:08:35 /builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/openmp/runtime/CMakeLists.txt:279 (include) Jun 03 02:08:35 Jun 03 02:08:35 Jun 03 02:08:35 -- Configuring incomplete, errors occurred! ```

github-actions[bot] commented 4 weeks ago

Errors found in Copr builds on `fedora-40-x86_64`

unknown
1. llvm on fedora-40-x86_64 (see build log, contribute to log-detective)
  ### Build log tail Sometimes the end of the build log contains useful information. ``` ssh: connect to host 3.85.189.150 port 22: Connection timed out ``` ### RPM build errors If we have found RPM build errors in the log file, you'll find them here. ``` ``` ### Errors to look into If we have found the term error: (case insentitive) in the build log, you'll find all occurrences here together with the preceding lines. ``` ```

github-actions[bot] commented 4 weeks ago

Errors found in Copr builds on `fedora-rawhide-aarch64`

cmake_error
1. llvm on fedora-rawhide-aarch64 (see build log, contribute to log-detective)
``` CMake Error at /usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:230 (message): Jun 03 04:09:26 Could NOT find Threads (missing: Threads_FOUND) Jun 03 04:09:26 Call Stack (most recent call first): Jun 03 04:09:26 /usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:600 (_FPHSA_FAILURE_MESSAGE) Jun 03 04:09:26 /usr/share/cmake/Modules/FindThreads.cmake:226 (FIND_PACKAGE_HANDLE_STANDARD_ARGS) Jun 03 04:09:26 /builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/openmp/runtime/cmake/config-ix.cmake:158 (find_package) Jun 03 04:09:26 /builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/openmp/runtime/CMakeLists.txt:279 (include) Jun 03 04:09:26 Jun 03 04:09:26 Jun 03 04:09:26 -- Configuring incomplete, errors occurred! ```

github-actions[bot] commented 4 weeks ago

Errors found in Copr builds on `fedora-39-s390x`

unknown
1. llvm on fedora-39-s390x (see build log, contribute to log-detective)
  ### Build log tail Sometimes the end of the build log contains useful information. ``` ssh: connect to host 169.59.188.151 port 22: Connection timed out ``` ### RPM build errors If we have found RPM build errors in the log file, you'll find them here. ``` ``` ### Errors to look into If we have found the term error: (case insentitive) in the build log, you'll find all occurrences here together with the preceding lines. ``` ```

github-actions[bot] commented 4 weeks ago

Errors found in Copr builds on `fedora-40-s390x`

unknown
1. llvm on fedora-40-s390x (see build log, contribute to log-detective)
  ### Build log tail Sometimes the end of the build log contains useful information. ``` ssh: connect to host 150.239.84.156 port 22: Connection timed out ``` ### RPM build errors If we have found RPM build errors in the log file, you'll find them here. ``` ``` ### Errors to look into If we have found the term error: (case insentitive) in the build log, you'll find all occurrences here together with the preceding lines. ``` ```

github-actions[bot] commented 4 weeks ago

Errors found in Copr builds on `fedora-rawhide-s390x`

unknown
1. llvm on fedora-rawhide-s390x (see build log, contribute to log-detective)
  ### Build log tail Sometimes the end of the build log contains useful information. ``` ssh: connect to host 150.239.84.153 port 22: Connection timed out ``` ### RPM build errors If we have found RPM build errors in the log file, you'll find them here. ``` ``` ### Errors to look into If we have found the term error: (case insentitive) in the build log, you'll find all occurrences here together with the preceding lines. ``` ```

github-actions[bot] commented 4 weeks ago

Errors found in Copr builds on `rhel-9-s390x`

unknown
1. llvm on rhel-9-s390x (see build log, contribute to log-detective)
  ### Build log tail Sometimes the end of the build log contains useful information. ``` ssh: connect to host 169.59.162.238 port 22: Connection timed out ``` ### RPM build errors If we have found RPM build errors in the log file, you'll find them here. ``` ``` ### Errors to look into If we have found the term error: (case insentitive) in the build log, you'll find all occurrences here together with the preceding lines. ``` ```

nikic commented 4 weeks ago

Relevant output from redhat-linux-build/runtimes/runtimes-bins/CMakeFiles/CMakeConfigureLog.yaml shows why the nested cmake invocation fails:

    kind: "try_compile-v1"
    backtrace:
      - "/usr/share/cmake/Modules/FindThreads.cmake:136 (try_compile)"
      - "/usr/share/cmake/Modules/FindThreads.cmake:179 (_threads_check_flag_pthread)"
      - "/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/openmp/runtime/cmake/config-ix.cmake:158 (find_package)"
      - "/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/openmp/runtime/CMakeLists.txt:279 (include)"
    checks:
      - "Check if compiler accepts -pthread"
    directories:
      source: "/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/llvm/redhat-linux-build/runtimes/runtimes-bins/CMakeFiles/CMakeScratch/TryCompile-MoNDb6"
      binary: "/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/llvm/redhat-linux-build/runtimes/runtimes-bins/CMakeFiles/CMakeScratch/TryCompile-MoNDb6"
    cmakeVariables:
      CMAKE_CXX_COMPILER_CLANG_SCAN_DEPS: "CMAKE_CXX_COMPILER_CLANG_SCAN_DEPS-NOTFOUND"
      CMAKE_CXX_COMPILER_TARGET: "x86_64-redhat-linux-gnu"
      CMAKE_C_COMPILER_TARGET: "x86_64-redhat-linux-gnu"
      CMAKE_C_FLAGS: "-O2 -flto=thin -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config=/usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -m64 -march=x86-64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_DEFAULT_SOURCE -Dasm=__asm__ -Werror=date-time -Werror=unguarded-availability-new -Wall -Wextra -Wno-unused-parameter -Wwrite-strings -Wcast-qual -Wmissing-field-initializers -Wimplicit-fallthrough -Wcovered-switch-default -Wno-comment -Wstring-conversion -fdiagnostics-color -ffunction-sections -fdata-sections"
      CMAKE_C_FLAGS_DEBUG: "-g"
      CMAKE_EXE_LINKER_FLAGS: "-Wl,-z,relro -Wl,--as-needed  -Wl,-z,pack-relative-relocs -Wl,-z,now --config=/usr/lib/rpm/redhat/redhat-hardened-clang-ld.cfg  -flto=thin -ffat-lto-objects -Wl,--build-id=sha1"
      CMAKE_MODULE_PATH: "/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/openmp/runtime/cmake;/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/openmp/cmake;/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/openmp/../cmake/Modules;/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/runtimes/cmake;/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/runtimes/cmake/modules;/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/runtimes/../cmake;/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/runtimes/../cmake/Modules;/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/runtimes/../llvm/cmake;/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/runtimes/../llvm/cmake/modules"
    buildResult:
      variable: "THREADS_HAVE_PTHREAD_ARG"
      cached: true
      stdout: |
        Change Dir: '/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/llvm/redhat-linux-build/runtimes/runtimes-bins/CMakeFiles/CMakeScratch/TryCompile-MoNDb6'

        Run Build Command(s): /usr/bin/ninja-build -v cmTC_bd41e
        [1/2] "/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/llvm/redhat-linux-build/./bin/clang" --target=x86_64-redhat-linux-gnu   -O2 -flto=thin -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config=/usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -m64 -march=x86-64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_DEFAULT_SOURCE -Dasm=__asm__ -Werror=date-time -Werror=unguarded-availability-new -Wall -Wextra -Wno-unused-parameter -Wwrite-strings -Wcast-qual -Wmissing-field-initializers -Wimplicit-fallthrough -Wcovered-switch-default -Wno-comment -Wstring-conversion -fdiagnostics-color -ffunction-sections -fdata-sections -MD -MT CMakeFiles/cmTC_bd41e.dir/CheckForPthreads.c.o -MF CMakeFiles/cmTC_bd41e.dir/CheckForPthreads.c.o.d -o CMakeFiles/cmTC_bd41e.dir/CheckForPthreads.c.o -c '/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/llvm/redhat-linux-build/runtimes/runtimes-bins/CMakeFiles/CMakeScratch/TryCompile-MoNDb6/CheckForPthreads.c'
        [2/2] : && "/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/llvm/redhat-linux-build/./bin/clang" --target=x86_64-redhat-linux-gnu -O2 -flto=thin -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config=/usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -m64 -march=x86-64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_DEFAULT_SOURCE -Dasm=__asm__ -Werror=date-time -Werror=unguarded-availability-new -Wall -Wextra -Wno-unused-parameter -Wwrite-strings -Wcast-qual -Wmissing-field-initializers -Wimplicit-fallthrough -Wcovered-switch-default -Wno-comment -Wstring-conversion -fdiagnostics-color -ffunction-sections -fdata-sections -Wl,-z,relro -Wl,--as-needed  -Wl,-z,pack-relative-relocs -Wl,-z,now --config=/usr/lib/rpm/redhat/redhat-hardened-clang-ld.cfg  -flto=thin -ffat-lto-objects -Wl,--build-id=sha1 CMakeFiles/cmTC_bd41e.dir/CheckForPthreads.c.o -o cmTC_bd41e  -pthread && :
        FAILED: cmTC_bd41e 
        : && "/builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/llvm/redhat-linux-build/./bin/clang" --target=x86_64-redhat-linux-gnu -O2 -flto=thin -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config=/usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -m64 -march=x86-64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_DEFAULT_SOURCE -Dasm=__asm__ -Werror=date-time -Werror=unguarded-availability-new -Wall -Wextra -Wno-unused-parameter -Wwrite-strings -Wcast-qual -Wmissing-field-initializers -Wimplicit-fallthrough -Wcovered-switch-default -Wno-comment -Wstring-conversion -fdiagnostics-color -ffunction-sections -fdata-sections -Wl,-z,relro -Wl,--as-needed  -Wl,-z,pack-relative-relocs -Wl,-z,now --config=/usr/lib/rpm/redhat/redhat-hardened-clang-ld.cfg  -flto=thin -ffat-lto-objects -Wl,--build-id=sha1 CMakeFiles/cmTC_bd41e.dir/CheckForPthreads.c.o -o cmTC_bd41e  -pthread && :
        /usr/bin/ld: /builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/llvm/redhat-linux-build/bin/../lib64/LLVMgold.so: error loading plugin: /builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/llvm/redhat-linux-build/bin/../lib64/LLVMgold.so: cannot open shared object file: No such file or directory
        clang: error: linker command failed with exit code 1 (use -v to see invocation)
        ninja: build stopped: subcommand failed.

      exitCode: 1
...

And indeed, the LLVMgold.so file is not present.

nikic commented 4 weeks ago

Doing an explicit ninja LLVMgold.so works though, so this seems like some kind of build order issue that was exposed by something changing on rawhide.

nikic commented 4 weeks ago

Rawhide updated to ninja 1.12, and the changelog (https://github.com/ninja-build/ninja/releases/tag/v1.12.0) has:

Critical path scheduler which orders the jobs by their runtime history https://github.com/ninja-build/ninja/pull/2177 This may break your build if you haven't specified your dependencies correctly.

This looks very relevant!

github-actions[bot] commented 4 weeks ago

Errors found in Copr builds on `fedora-rawhide-ppc64le`

cmake_error
1. llvm on fedora-rawhide-ppc64le (see build log, contribute to log-detective)
``` CMake Error at /usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:230 (message): Jun 03 08:56:56 Could NOT find Threads (missing: Threads_FOUND) Jun 03 08:56:56 Call Stack (most recent call first): Jun 03 08:56:56 /usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:600 (_FPHSA_FAILURE_MESSAGE) Jun 03 08:56:56 /usr/share/cmake/Modules/FindThreads.cmake:226 (FIND_PACKAGE_HANDLE_STANDARD_ARGS) Jun 03 08:56:56 /builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/openmp/runtime/cmake/config-ix.cmake:158 (find_package) Jun 03 08:56:56 /builddir/build/BUILD/llvm-19.0.0~pre20240603.g2fbc9f217e5fe8-build/llvm-project-2fbc9f217e5fe8db8444a87dbd7138a768b8aa85/openmp/runtime/CMakeLists.txt:279 (include) Jun 03 08:56:56 Jun 03 08:56:56 Jun 03 08:56:56 -- Configuring incomplete, errors occurred! ```

nikic commented 4 weeks ago

Fix for the LLVMgold dependency issue: https://github.com/llvm/llvm-project/pull/94199

nikic commented 3 weeks ago

Issue confirmed resolved.

fedora-llvm-team / llvm-snapshots