Snapshot for 20240530, v19.0.0, e20f0fe (big-merge)

[github-actions[bot]]

Hello @kwk!

This issue exists to let you know that we are about to monitor the builds of the LLVM (v19.0.0, llvm/llvm-project@ e20f0fe) snapshot for 20240530.

At certain intervals the CI system will update this very comment over time to reflect the progress of builds.

Log analysis

For example if a build of the llvm project fails on the fedora-rawhide-x86_64 platform, we'll analyze the build log (if any) to identify the cause of the failure. The cause can be any of ['srpm_build_issue', 'copr_timeout', 'network_issue', 'dependency_issue', 'test', 'downstream_patch_application', 'rpm__installed_but_unpackaged_files_found', 'rpm__directory_not_found', 'unknown']. For each cause we will list the packages and the relevant log excerpts.

Use of labels

Let's assume a unit test test in upstream LLVM was broken. We will then add these labels to this issue: error/test, arch/x86_64, os/fedora-rawhide, project/llvm. If you manually restart a build in Copr and can bring it to a successful state, we will automatically remove the aforementioned labels.

Last updated: 2024-06-01T23:23:36.939013

Build Matrix

| |llvm| |:---|:---:| |fedora-39-aarch64
:white_check_mark: tests passed|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7506280)| |fedora-39-i386|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7506281)| |fedora-39-ppc64le
:white_check_mark: tests passed :lock: |[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7506282)| |fedora-39-s390x
:x: tests failed :lock: |[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7506283)| |fedora-39-x86_64
:white_check_mark: tests passed|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7506284)| |fedora-40-aarch64
:white_check_mark: tests passed|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7506285)| |fedora-40-i386|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7506286)| |fedora-40-ppc64le
:white_check_mark: tests passed :lock: |[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7506287)| |fedora-40-s390x
:white_check_mark: tests passed :lock: |[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7506288)| |fedora-40-x86_64
:white_check_mark: tests passed|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7506289)| |fedora-rawhide-aarch64
:x: tests failed|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7506290)| |fedora-rawhide-i386
:x: Copr build(s) failed|[:x:](https://copr.fedorainfracloud.org/coprs/build/7506291)| |fedora-rawhide-ppc64le
:warning: pipeline error|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7506293)| |fedora-rawhide-s390x
:warning: pipeline error|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7506294)| |fedora-rawhide-x86_64
:x: tests failed|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7506295)| |rhel-9-aarch64
:white_check_mark: tests passed :lock: |[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7506296)| |rhel-9-s390x
:x: tests failed :lock: |[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7506297)| |rhel-9-x86_64
:white_check_mark: tests passed :lock: |[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7506298)|

Build status legend

• :o: : canceled
• :x: : failed
• :ballot_box_with_check: : forked
• :inbox_tray: : importing
• :soon: : pending
• :running: : running
• :no_entry_sign: : skipped
• :star: : starting
• :white_check_mark: : succeeded
• :hourglass: : waiting
• :grey_question: : unknown
• :warning: : pipeline error (only relevant to testing-farm)

[github-actions[bot]]

Testing-farm results are in!

Last updated: 2024-06-01T23:23:35.877479

Some (if not all) results from testing-farm are in. This comment will be updated over time and is detached from the main issue comment because we want to preserve the logs entirely and not shorten them.

[!NOTE] Please be aware that the testing-farm artifact links a valid for no longer than 90 days. That is why we persists the log outputs here.

[!WARNING] This list is not extensive if tests have been run in the Red Hat internal testing-farm ranch and failed. For those, take a look in the "chroot" column of the build matrix above and look for failed tests that show a :lock: symbol.

Failed testing-farm test cases

/clang-tests/tests/openmp-rpm on fedora-rawhide-aarch64 (see testing-farm artifacts)

``` + QA_RPATHS=1 + rpmbuild --define '_sourcedir .' --define '_builddir .' -bb test.spec warning: Macro expanded in comment on line 12: %{?scl_prefix}clang warning: Macro expanded in comment on line 13: %{?scl_prefix}libomp warning: %source_date_epoch_from_changelog is set, but %changelog has no entries to take a date from Executing(%mkbuilddir): /bin/sh -e /var/tmp/rpm-tmp.OgoLDn + umask 022 + cd ./test-1-build + test -d ./test-1-build + /usr/bin/rm -rf ./test-1-build + /usr/bin/mkdir -p ./test-1-build + /usr/bin/mkdir -p ./test-1-build/SPECPARTS + RPM_EC=0 ++ jobs -p + exit 0 Executing(%build): /bin/sh -e /var/tmp/rpm-tmp.0fUhLw + umask 022 + cd ./test-1-build + CFLAGS='-O2 -flto=thin -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -mbranch-protection=standard -fasynchronous-unwind-tables -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer ' + export CFLAGS + CXXFLAGS='-O2 -flto=thin -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -mbranch-protection=standard -fasynchronous-unwind-tables -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer ' + export CXXFLAGS + FFLAGS='-O2 -flto=thin -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -mbranch-protection=standard -fasynchronous-unwind-tables -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -I/usr/lib64/gfortran/modules ' + export FFLAGS + FCFLAGS='-O2 -flto=thin -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -mbranch-protection=standard -fasynchronous-unwind-tables -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -I/usr/lib64/gfortran/modules ' + export FCFLAGS + VALAFLAGS=-g + export VALAFLAGS + RUSTFLAGS='-Copt-level=3 -Cdebuginfo=2 -Ccodegen-units=1 -Cstrip=none -Cforce-frame-pointers=yes --cap-lints=warn' + export RUSTFLAGS + LDFLAGS='-Wl,-z,relro -Wl,--as-needed -Wl,-z,now --config /usr/lib/rpm/redhat/redhat-hardened-clang-ld.cfg -flto=thin -ffat-lto-objects -Wl,--build-id=sha1 ' + export LDFLAGS + LT_SYS_LIBRARY_PATH=/usr/lib64: + export LT_SYS_LIBRARY_PATH + CC=clang + export CC + CXX=clang++ + export CXX + clang -O2 -flto=thin -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -mbranch-protection=standard -fasynchronous-unwind-tables -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -c ./test.c -o test.o clang: error: no such file or directory: './test.c' clang: error: no input files error: Bad exit status from /var/tmp/rpm-tmp.0fUhLw (%build) RPM build warnings: Macro expanded in comment on line 12: %{?scl_prefix}clang Macro expanded in comment on line 13: %{?scl_prefix}libomp %source_date_epoch_from_changelog is set, but %changelog has no entries to take a date from RPM build errors: Bad exit status from /var/tmp/rpm-tmp.0fUhLw (%build) Shared connection to 3.140.250.214 closed. ```

/clang-tests/tests/openmp-rpm on fedora-rawhide-x86_64 (see testing-farm artifacts)

``` + QA_RPATHS=1 + rpmbuild --define '_sourcedir .' --define '_builddir .' -bb test.spec warning: Macro expanded in comment on line 12: %{?scl_prefix}clang warning: Macro expanded in comment on line 13: %{?scl_prefix}libomp warning: %source_date_epoch_from_changelog is set, but %changelog has no entries to take a date from Executing(%mkbuilddir): /bin/sh -e /var/tmp/rpm-tmp.npJgXL + umask 022 + cd ./test-1-build + test -d ./test-1-build + /usr/bin/rm -rf ./test-1-build + /usr/bin/mkdir -p ./test-1-build + /usr/bin/mkdir -p ./test-1-build/SPECPARTS + RPM_EC=0 ++ jobs -p + exit 0 Executing(%build): /bin/sh -e /var/tmp/rpm-tmp.ov66qV + umask 022 + cd ./test-1-build + CFLAGS='-O2 -flto=thin -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -m64 -march=x86-64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer ' + export CFLAGS + CXXFLAGS='-O2 -flto=thin -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -m64 -march=x86-64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer ' + export CXXFLAGS + FFLAGS='-O2 -flto=thin -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -m64 -march=x86-64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -I/usr/lib64/gfortran/modules ' + export FFLAGS + FCFLAGS='-O2 -flto=thin -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -m64 -march=x86-64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -I/usr/lib64/gfortran/modules ' + export FCFLAGS + VALAFLAGS=-g + export VALAFLAGS + RUSTFLAGS='-Copt-level=3 -Cdebuginfo=2 -Ccodegen-units=1 -Cstrip=none -Cforce-frame-pointers=yes --cap-lints=warn' + export RUSTFLAGS + LDFLAGS='-Wl,-z,relro -Wl,--as-needed -Wl,-z,pack-relative-relocs -Wl,-z,now --config /usr/lib/rpm/redhat/redhat-hardened-clang-ld.cfg -flto=thin -ffat-lto-objects -Wl,--build-id=sha1 ' + export LDFLAGS + LT_SYS_LIBRARY_PATH=/usr/lib64: + export LT_SYS_LIBRARY_PATH + CC=clang + export CC + CXX=clang++ + export CXX + clang -O2 -flto=thin -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -m64 -march=x86-64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -c ./test.c -o test.o clang: error: no such file or directory: './test.c' clang: error: no input files error: Bad exit status from /var/tmp/rpm-tmp.ov66qV (%build) RPM build warnings: Macro expanded in comment on line 12: %{?scl_prefix}clang Macro expanded in comment on line 13: %{?scl_prefix}libomp %source_date_epoch_from_changelog is set, but %changelog has no entries to take a date from RPM build errors: Bad exit status from /var/tmp/rpm-tmp.ov66qV (%build) Shared connection to 18.220.47.142 closed. ```

[github-actions[bot]]

Errors found in Copr builds on fedora-rawhide-i386

• unknown
  1. llvm on fedora-rawhide-i386 (see build log, contribute to log-detective)

     ### Build log tail Sometimes the end of the build log contains useful information. ``` ERROR: Exception(/var/lib/copr-rpmbuild/results/llvm-19.0.0~pre20240530.ge20f0fe29f714a-1.fc41.src.rpm) Config(fedora-rawhide-i686) 364 minutes 20 seconds INFO: Results and/or logs in: /var/lib/copr-rpmbuild/results INFO: Cleaning up build root ('cleanup_on_failure=True') Start: clean chroot INFO: unmounting tmpfs. Finish: clean chroot ERROR: Command failed: # /usr/bin/systemd-nspawn -q -M 4fdf69d9afb647a99ed836cf109faa54 -D /var/lib/mock/fedora-rawhide-i686-1717033741.937504/root -a -u mockbuild --capability=cap_ipc_lock --rlimit=RLIMIT_NOFILE=10240 --capability=cap_ipc_lock --bind=/tmp/mock-resolv.7vk8k0g6:/etc/resolv.conf --bind=/dev/btrfs-control --bind=/dev/mapper/control --bind=/dev/fuse --bind=/dev/loop-control --bind=/dev/loop0 --bind=/dev/loop1 --bind=/dev/loop2 --bind=/dev/loop3 --bind=/dev/loop4 --bind=/dev/loop5 --bind=/dev/loop6 --bind=/dev/loop7 --bind=/dev/loop8 --bind=/dev/loop9 --bind=/dev/loop10 --bind=/dev/loop11 --console=pipe --setenv=TERM=vt100 --setenv=SHELL=/bin/bash --setenv=HOME=/builddir --setenv=HOSTNAME=mock --setenv=PATH=/usr/bin:/bin:/usr/sbin:/sbin '--setenv=PROMPT_COMMAND=printf "\033]0;\007"' '--setenv=PS1= \s-\v\$ ' --setenv=LANG=C.UTF-8 --resolv-conf=off bash --login -c '/usr/bin/rpmbuild -bb --target i686 --nodeps /builddir/build/originals/llvm.spec' Copr build error: Build failed ``` ### RPM build errors If we have found RPM build errors in the log file, you'll find them here. ``` ``` ### Errors to look into If we have found the term error: (case insentitive) in the build log, you'll find all occurrences here together with the preceding lines. ``` May 30 07:52:13 + /builddir/build/BUILD/llvm-19.0.0~pre20240530.ge20f0fe29f714a-build/llvm-project-e20f0fe29f714a22679214b499744735d528fc1a/llvm/redhat-linux-build/bin/FileCheck --check-prefix=LINES /builddir/build/BUILD/llvm-19.0.0~pre20240530.ge20f0fe29f714a-build/llvm-project-e20f0fe29f714a22679214b499744735d528fc1a/llvm/test/tools/llvm-objdump/X86/source-interleave-x86_64.test May 30 07:52:13 /builddir/build/BUILD/llvm-19.0.0~pre20240530.ge20f0fe29f714a-build/llvm-project-e20f0fe29f714a22679214b499744735d528fc1a/llvm/test/tools/llvm-objdump/X86/source-interleave-x86_64.test:14:15: error: LINES-NEXT: expected string not found in input -- May 30 07:52:13 19: ; main(): May 30 07:52:13 next:14'0 X error: no match found -- RPM build errors: error: Bad exit status from /var/tmp/rpm-tmp.2Dbs3s (%check) -- INFO: /var/lib/mock/fedora-rawhide-i686-1717033741.937504/root/var/log/dnf5.log ERROR: Exception(/var/lib/copr-rpmbuild/results/llvm-19.0.0~pre20240530.ge20f0fe29f714a-1.fc41.src.rpm) Config(fedora-rawhide-i686) 364 minutes 20 seconds -- Finish: clean chroot ERROR: Command failed: -- Copr build error: Build failed ```

[nikic]

https://github.com/llvm/llvm-project/pull/93789 should fix that i386 failure -- though I'm a bit stumped on why this failure occurred only in that one build. The build directory contains ~ for all builds. From a local test having ~ in the directory name does make the test fail, so I don't really get why it is usually passing...

[nikic]

For the rawhide tmt failures, see https://src.fedoraproject.org/tests/clang/pull-request/42. This is due to an RPM update. That PR shows the kind of change that is needed, though for a different tests (pie-rpm).

[nikic]

llvm/llvm-project#93789 should fix that i386 failure -- though I'm a bit stumped on why this failure occurred only in that one build. The build directory contains ~ for all builds. From a local test having ~ in the directory name does make the test fail, so I don't really get why it is usually passing...

Turns out that only this one i386 build got the rpm 4.20 alpha, which uses a different build directory, so actually only that one has the ~ and the failing test. The others still have the old version.

[nikic]

Jesus filed https://src.fedoraproject.org/tests/clang/pull-request/43 to fix the openmp-rpm test.