Hello @tuliom!

This issue exists to let you know that we are about to monitor the builds of the LLVM (v19.0.0, llvm/llvm-project@ 7cbd899) snapshot for 20240721.

At certain intervals the CI system will update this very comment over time to reflect the progress of builds.

Log analysis: For example if a build of the llvm project fails on the fedora-rawhide-x86_64 platform, we'll analyze the build log (if any) to identify the cause of the failure. The cause can be any of ['srpm_build_issue', 'copr_timeout', 'network_issue', 'dependency_issue', 'test', 'downstream_patch_application', 'rpm__installed_but_unpackaged_files_found', 'rpm__directory_not_found', 'rpm__file_not_found', 'cmake_error', 'unknown']. For each cause we will list the packages and the relevant log excerpts.
Use of labels: Let's assume a unit test test in upstream LLVM was broken. We will then add these labels to this issue: error/test, build_failed_on/fedora-rawhide-x86_64, project/llvm. If you manually restart a build in Copr and can bring it to a successful state, we will automatically remove the aforementioned labels.

Last updated: 2024-07-23T23:23:43.895993

Build Matrix

| |llvm| |:---|:---:| |fedora-39-aarch64
:white_check_mark: tests passed|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7766605)| |fedora-39-i386|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7766606)| |fedora-39-ppc64le
:white_check_mark: tests passed :lock: |[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7766607)| |fedora-39-s390x
:white_check_mark: tests passed :lock: |[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7766608)| |fedora-39-x86_64
:white_check_mark: tests passed|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7766610)| |fedora-40-aarch64
:x: tests failed|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7766611)| |fedora-40-i386|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7767505)| |fedora-40-ppc64le
:x: tests failed :lock: |[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7766613)| |fedora-40-s390x
:x: tests failed :lock: |[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7766614)| |fedora-40-x86_64
:x: tests failed|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7766615)| |fedora-rawhide-aarch64
:white_check_mark: tests passed|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7766616)| |fedora-rawhide-i386|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7766617)| |fedora-rawhide-ppc64le
:warning: pipeline error|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7766618)| |fedora-rawhide-s390x
:warning: pipeline error|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7766619)| |fedora-rawhide-x86_64
:white_check_mark: tests passed|[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7766620)| |rhel-8-aarch64
:white_check_mark: tests passed :lock: |[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7766621)| |rhel-8-s390x
:x: tests error :lock: |[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7766622)| |rhel-8-x86_64
:white_check_mark: tests passed :lock: |[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7766623)| |rhel-9-aarch64
:white_check_mark: tests passed :lock: |[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7766624)| |rhel-9-s390x
:white_check_mark: tests passed :lock: |[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7766625)| |rhel-9-x86_64
:white_check_mark: tests passed :lock: |[:white_check_mark:](https://copr.fedorainfracloud.org/coprs/build/7766626)|

Build status legend

:o: : canceled
:x: : failed
:ballot_box_with_check: : forked
:inbox_tray: : importing
:soon: : pending
:running: : running
:no_entry_sign: : skipped
:star: : starting
:white_check_mark: : succeeded
:hourglass: : waiting
:grey_question: : unknown
:warning: : pipeline error (only relevant to testing-farm)

Testing-farm results are in!

Last updated: 2024-07-23T23:23:42.502492

Some (if not all) results from testing-farm are in. This comment will be updated over time and is detached from the main issue comment because we want to preserve the logs entirely and not shorten them.

[!NOTE] Please be aware that the testing-farm artifact links a valid for no longer than 90 days. That is why we persists the log outputs here.

[!WARNING] This list is not extensive if tests have been run in the Red Hat internal testing-farm ranch and failed. For those, take a look in the "chroot" column of the build matrix above and look for failed tests that show a :lock: symbol.

Failed testing-farm test cases

/clang-tests/tests/pie-rpm on fedora-40-aarch64 (see testing-farm artifacts)

``` + set pipefail + QA_RPATHS=1 + rpmbuild -bb ./pie.spec setting SOURCE_DATE_EPOCH=1721520000 Executing(%prep): /bin/sh -e /var/tmp/rpm-tmp.xaXNcG + umask 022 + cd /root/rpmbuild/BUILD + cd /root/rpmbuild/BUILD + rm -rf pie-1 + /usr/bin/mkdir -p pie-1 + cd pie-1 + rm -rf /root/rpmbuild/BUILD/pie-1-SPECPARTS + /usr/bin/mkdir -p /root/rpmbuild/BUILD/pie-1-SPECPARTS + /usr/bin/chmod -Rf a+rX,u+w,g-w,o-w . + cat + RPM_EC=0 ++ jobs -p + exit 0 Executing(%build): /bin/sh -e /var/tmp/rpm-tmp.ux2WZJ + umask 022 + cd /root/rpmbuild/BUILD + CFLAGS='-O2 -flto=thin -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -mbranch-protection=standard -fasynchronous-unwind-tables -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer ' + export CFLAGS + CXXFLAGS='-O2 -flto=thin -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -mbranch-protection=standard -fasynchronous-unwind-tables -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer ' + export CXXFLAGS + FFLAGS='-O2 -flto=thin -fexceptions -g -grecord-gcc-switches -pipe -Wall -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -mbranch-protection=standard -fasynchronous-unwind-tables -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -I/usr/lib64/gfortran/modules ' + export FFLAGS + FCFLAGS='-O2 -flto=thin -fexceptions -g -grecord-gcc-switches -pipe -Wall -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -mbranch-protection=standard -fasynchronous-unwind-tables -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -I/usr/lib64/gfortran/modules ' + export FCFLAGS + VALAFLAGS=-g + export VALAFLAGS + RUSTFLAGS='-Copt-level=3 -Cdebuginfo=2 -Ccodegen-units=1 -Cstrip=none -Cforce-frame-pointers=yes --cap-lints=warn' + export RUSTFLAGS + LDFLAGS='-Wl,-z,relro -Wl,--as-needed -Wl,-z,now -flto=thin -Wl,--build-id=sha1 ' + export LDFLAGS + LT_SYS_LIBRARY_PATH=/usr/lib64: + export LT_SYS_LIBRARY_PATH + CC=clang + export CC + CXX=clang++ + export CXX + cd pie-1 + LDFLAGS='-Wl,-z,relro -Wl,--as-needed -Wl,-z,now -flto=thin -Wl,--build-id=sha1 -Werror' + clang -O2 -flto=thin -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -mbranch-protection=standard -fasynchronous-unwind-tables -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -c pie.c -o pie.o + clang -Wl,-z,relro -Wl,--as-needed -Wl,-z,now -flto=thin -Wl,--build-id=sha1 -Werror pie.o -o pie + clang -Wl,-z,relro -Wl,--as-needed -Wl,-z,now -flto=thin -Wl,--build-id=sha1 -Werror -shared pie.o -o pie-shared-pre + clang -shared -Wl,-z,relro -Wl,--as-needed -Wl,-z,now -flto=thin -Wl,--build-id=sha1 -Werror pie.o -o pie-shared-post + clang -Wl,-z,relro -Wl,--as-needed -Wl,-z,now -flto=thin -Wl,--build-id=sha1 -Werror -static pie.o -o pie-static-pre + clang -static -Wl,-z,relro -Wl,--as-needed -Wl,-z,now -flto=thin -Wl,--build-id=sha1 -Werror pie.o -o pie-static-post + clang -Wl,-z,relro -Wl,--as-needed -Wl,-z,now -flto=thin -Wl,--build-id=sha1 -Werror -no-pie pie.o -o pie-no-pie-pre + clang -no-pie -Wl,-z,relro -Wl,--as-needed -Wl,-z,now -flto=thin -Wl,--build-id=sha1 -Werror pie.o -o pie-no-pie-post + RPM_EC=0 ++ jobs -p + exit 0 Executing(%check): /bin/sh -e /var/tmp/rpm-tmp.KJZ1HM + umask 022 + cd /root/rpmbuild/BUILD + CFLAGS='-O2 -flto=thin -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -mbranch-protection=standard -fasynchronous-unwind-tables -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer ' + export CFLAGS + CXXFLAGS='-O2 -flto=thin -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -mbranch-protection=standard -fasynchronous-unwind-tables -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer ' + export CXXFLAGS + FFLAGS='-O2 -flto=thin -fexceptions -g -grecord-gcc-switches -pipe -Wall -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -mbranch-protection=standard -fasynchronous-unwind-tables -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -I/usr/lib64/gfortran/modules ' + export FFLAGS + FCFLAGS='-O2 -flto=thin -fexceptions -g -grecord-gcc-switches -pipe -Wall -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -mbranch-protection=standard -fasynchronous-unwind-tables -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -I/usr/lib64/gfortran/modules ' + export FCFLAGS + VALAFLAGS=-g + export VALAFLAGS + RUSTFLAGS='-Copt-level=3 -Cdebuginfo=2 -Ccodegen-units=1 -Cstrip=none -Cforce-frame-pointers=yes --cap-lints=warn' + export RUSTFLAGS + LDFLAGS='-Wl,-z,relro -Wl,--as-needed -Wl,-z,now -flto=thin -Wl,--build-id=sha1 ' + export LDFLAGS + LT_SYS_LIBRARY_PATH=/usr/lib64: + export LT_SYS_LIBRARY_PATH + CC=clang + export CC + CXX=clang++ + export CXX + cd pie-1 ++ file ./pie + [[ ./pie: ELF 64-bit LSB executable, ARM aarch64, version 1 (SYSV), dynamically linked, interpreter /lib/ld-linux-aarch64.so.1, BuildID[sha1]=caa903a1905cafc5843b4f0a6284dc03218cda30, for GNU/Linux 3.7.0, with debug_info, not stripped != *\p\i\e\ \e\x\e\c\u\t\a\b\l\e* ]] + exit 1 error: Bad exit status from /var/tmp/rpm-tmp.KJZ1HM (%check) RPM build errors: Bad exit status from /var/tmp/rpm-tmp.KJZ1HM (%check) Shared connection to 3.17.190.15 closed. ```

/clang-tests/tests/llvm-test-suite on fedora-40-x86_64 (see testing-farm artifacts)

``` + git clone --depth 1 https://src.fedoraproject.org/rpms/llvm-test-suite.git llvm-test-suite Cloning into 'llvm-test-suite'... + cd llvm-test-suite/tests/test-suite + ./runtest.sh ++ mktemp -d + cd /tmp/tmp.Db8wnNzgWZ + cmake -G Ninja /usr/share/llvm-test-suite/ -DCMAKE_C_COMPILER=clang -DCMAKE_CXX_COMPILER=clang++ -DTEST_SUITE_LIT_FLAGS=-sv [... CMAKE CONFIGURE LOG SHORTENED ...] + ninja check [... CMAKE BUILD LOG SHORTENED ...] FAILED: Bitcode/Benchmarks/Halide/bilateral_grid/halide_bilateral_grid : && /tmp/tmp.Db8wnNzgWZ/tools/timeit --summary Bitcode/Benchmarks/Halide/bilateral_grid/halide_bilateral_grid.link.time /usr/bin/clang++ -O3 -DNDEBUG Bitcode/Benchmarks/Halide/bilateral_grid/CMakeFiles/halide_bilateral_grid.dir/driver.cpp.o Bitcode/Benchmarks/Halide/bilateral_grid/CMakeFiles/halide_bilateral_grid.dir/__/common/x86_halide_runtime.bc.o Bitcode/Benchmarks/Halide/bilateral_grid/CMakeFiles/halide_bilateral_grid.dir/bilateral_grid.bc.o -o Bitcode/Benchmarks/Halide/bilateral_grid/halide_bilateral_grid -ldl && cd /tmp/tmp.Db8wnNzgWZ/Bitcode/Benchmarks/Halide/bilateral_grid && /usr/bin/llvm-size --format=sysv /tmp/tmp.Db8wnNzgWZ/Bitcode/Benchmarks/Halide/bilateral_grid/halide_bilateral_grid > /tmp/tmp.Db8wnNzgWZ/Bitcode/Benchmarks/Halide/bilateral_grid/halide_bilateral_grid.size && cd /tmp/tmp.Db8wnNzgWZ/Bitcode/Benchmarks/Halide/bilateral_grid && /usr/bin/cmake -E make_directory ../images && cd /tmp/tmp.Db8wnNzgWZ/Bitcode/Benchmarks/Halide/bilateral_grid && /usr/bin/cmake -E create_symlink /usr/share/llvm-test-suite/Bitcode/Benchmarks/Halide/bilateral_grid/../images/rgb.bytes /tmp/tmp.Db8wnNzgWZ/Bitcode/Benchmarks/Halide/bilateral_grid/../images/rgb.bytes && cd /tmp/tmp.Db8wnNzgWZ/Bitcode/Benchmarks/Halide/bilateral_grid && /usr/bin/cmake -E make_directory output && cd /tmp/tmp.Db8wnNzgWZ/Bitcode/Benchmarks/Halide/bilateral_grid && /usr/bin/cmake -E create_symlink /usr/share/llvm-test-suite/Bitcode/Benchmarks/Halide/bilateral_grid/output/rgb_out.bytes /tmp/tmp.Db8wnNzgWZ/Bitcode/Benchmarks/Halide/bilateral_grid/output/rgb_out.bytes && cd /tmp/tmp.Db8wnNzgWZ/Bitcode/Benchmarks/Halide/bilateral_grid && /usr/bin/cmake -E make_directory ../images && cd /tmp/tmp.Db8wnNzgWZ/Bitcode/Benchmarks/Halide/bilateral_grid && /usr/bin/cmake -E create_symlink /usr/share/llvm-test-suite/Bitcode/Benchmarks/Halide/bilateral_grid/../images/rgba.bytes /tmp/tmp.Db8wnNzgWZ/Bitcode/Benchmarks/Halide/bilateral_grid/../images/rgba.bytes && cd /tmp/tmp.Db8wnNzgWZ/Bitcode/Benchmarks/Halide/bilateral_grid && /usr/bin/cmake -E make_directory output && cd /tmp/tmp.Db8wnNzgWZ/Bitcode/Benchmarks/Halide/bilateral_grid && /usr/bin/cmake -E create_symlink /usr/share/llvm-test-suite/Bitcode/Benchmarks/Halide/bilateral_grid/output/rgba_out.bytes /tmp/tmp.Db8wnNzgWZ/Bitcode/Benchmarks/Halide/bilateral_grid/output/rgba_out.bytes CMake Error: failed to create symbolic link '/tmp/tmp.Db8wnNzgWZ/Bitcode/Benchmarks/Halide/bilateral_grid/../images/rgba.bytes': File exists ninja: build stopped: subcommand failed. Shared connection to 18.188.74.226 closed. ```

/clang-tests/tests/pie-rpm on fedora-40-x86_64 (see testing-farm artifacts)

``` + set pipefail + QA_RPATHS=1 + rpmbuild -bb ./pie.spec setting SOURCE_DATE_EPOCH=1721520000 Executing(%prep): /bin/sh -e /var/tmp/rpm-tmp.XPUJhw + umask 022 + cd /root/rpmbuild/BUILD + cd /root/rpmbuild/BUILD + rm -rf pie-1 + /usr/bin/mkdir -p pie-1 + cd pie-1 + rm -rf /root/rpmbuild/BUILD/pie-1-SPECPARTS + /usr/bin/mkdir -p /root/rpmbuild/BUILD/pie-1-SPECPARTS + /usr/bin/chmod -Rf a+rX,u+w,g-w,o-w . + cat + RPM_EC=0 ++ jobs -p + exit 0 Executing(%build): /bin/sh -e /var/tmp/rpm-tmp.22HrVi + umask 022 + cd /root/rpmbuild/BUILD + CFLAGS='-O2 -flto=thin -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -m64 -march=x86-64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer ' + export CFLAGS + CXXFLAGS='-O2 -flto=thin -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -m64 -march=x86-64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer ' + export CXXFLAGS + FFLAGS='-O2 -flto=thin -fexceptions -g -grecord-gcc-switches -pipe -Wall -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -m64 -march=x86-64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -I/usr/lib64/gfortran/modules ' + export FFLAGS + FCFLAGS='-O2 -flto=thin -fexceptions -g -grecord-gcc-switches -pipe -Wall -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -m64 -march=x86-64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -I/usr/lib64/gfortran/modules ' + export FCFLAGS + VALAFLAGS=-g + export VALAFLAGS + RUSTFLAGS='-Copt-level=3 -Cdebuginfo=2 -Ccodegen-units=1 -Cstrip=none -Cforce-frame-pointers=yes --cap-lints=warn' + export RUSTFLAGS + LDFLAGS='-Wl,-z,relro -Wl,--as-needed -Wl,-z,pack-relative-relocs -Wl,-z,now -flto=thin -Wl,--build-id=sha1 ' + export LDFLAGS + LT_SYS_LIBRARY_PATH=/usr/lib64: + export LT_SYS_LIBRARY_PATH + CC=clang + export CC + CXX=clang++ + export CXX + cd pie-1 + LDFLAGS='-Wl,-z,relro -Wl,--as-needed -Wl,-z,pack-relative-relocs -Wl,-z,now -flto=thin -Wl,--build-id=sha1 -Werror' + clang -O2 -flto=thin -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -m64 -march=x86-64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -c pie.c -o pie.o + clang -Wl,-z,relro -Wl,--as-needed -Wl,-z,pack-relative-relocs -Wl,-z,now -flto=thin -Wl,--build-id=sha1 -Werror pie.o -o pie + clang -Wl,-z,relro -Wl,--as-needed -Wl,-z,pack-relative-relocs -Wl,-z,now -flto=thin -Wl,--build-id=sha1 -Werror -shared pie.o -o pie-shared-pre + clang -shared -Wl,-z,relro -Wl,--as-needed -Wl,-z,pack-relative-relocs -Wl,-z,now -flto=thin -Wl,--build-id=sha1 -Werror pie.o -o pie-shared-post + clang -Wl,-z,relro -Wl,--as-needed -Wl,-z,pack-relative-relocs -Wl,-z,now -flto=thin -Wl,--build-id=sha1 -Werror -static pie.o -o pie-static-pre + clang -static -Wl,-z,relro -Wl,--as-needed -Wl,-z,pack-relative-relocs -Wl,-z,now -flto=thin -Wl,--build-id=sha1 -Werror pie.o -o pie-static-post + clang -Wl,-z,relro -Wl,--as-needed -Wl,-z,pack-relative-relocs -Wl,-z,now -flto=thin -Wl,--build-id=sha1 -Werror -no-pie pie.o -o pie-no-pie-pre + clang -no-pie -Wl,-z,relro -Wl,--as-needed -Wl,-z,pack-relative-relocs -Wl,-z,now -flto=thin -Wl,--build-id=sha1 -Werror pie.o -o pie-no-pie-post + RPM_EC=0 ++ jobs -p + exit 0 Executing(%check): /bin/sh -e /var/tmp/rpm-tmp.mEjG79 + umask 022 + cd /root/rpmbuild/BUILD + CFLAGS='-O2 -flto=thin -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -m64 -march=x86-64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer ' + export CFLAGS + CXXFLAGS='-O2 -flto=thin -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -m64 -march=x86-64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer ' + export CXXFLAGS + FFLAGS='-O2 -flto=thin -fexceptions -g -grecord-gcc-switches -pipe -Wall -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -m64 -march=x86-64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -I/usr/lib64/gfortran/modules ' + export FFLAGS + FCFLAGS='-O2 -flto=thin -fexceptions -g -grecord-gcc-switches -pipe -Wall -Wp,-U_FORTIFY_SOURCE,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS --config /usr/lib/rpm/redhat/redhat-hardened-clang.cfg -fstack-protector-strong -m64 -march=x86-64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -I/usr/lib64/gfortran/modules ' + export FCFLAGS + VALAFLAGS=-g + export VALAFLAGS + RUSTFLAGS='-Copt-level=3 -Cdebuginfo=2 -Ccodegen-units=1 -Cstrip=none -Cforce-frame-pointers=yes --cap-lints=warn' + export RUSTFLAGS + LDFLAGS='-Wl,-z,relro -Wl,--as-needed -Wl,-z,pack-relative-relocs -Wl,-z,now -flto=thin -Wl,--build-id=sha1 ' + export LDFLAGS + LT_SYS_LIBRARY_PATH=/usr/lib64: + export LT_SYS_LIBRARY_PATH + CC=clang + export CC + CXX=clang++ + export CXX + cd pie-1 ++ file ./pie + [[ ./pie: ELF 64-bit LSB executable, x86-64, version 1 (SYSV), dynamically linked, interpreter /lib64/ld-linux-x86-64.so.2, BuildID[sha1]=b85662c2cab64fdadcc0a3b6ea5665721942d56d, for GNU/Linux 3.2.0, with debug_info, not stripped != *\p\i\e\ \e\x\e\c\u\t\a\b\l\e* ]] + exit 1 error: Bad exit status from /var/tmp/rpm-tmp.mEjG79 (%check) RPM build errors: Bad exit status from /var/tmp/rpm-tmp.mEjG79 (%check) Shared connection to 18.188.74.226 closed. ```

Errors found in Copr builds on `fedora-40-i386`

rpm__installed_but_unpackaged_files_found
1. llvm on fedora-40-i386 (see build log, contribute to log-detective)
``` Installed (but unpackaged) file(s) found: /usr/lib/libLLVM.so.19.0pre20240721.g7cbd89921bed66.gdb-index-dBV3s5 RPM build warnings: RPM build errors: absolute symlink: /usr/bin/clang-format-diff -> /usr/share/clang/clang-format-diff.py Installed (but unpackaged) file(s) found: /usr/lib/libLLVM.so.19.0pre20240721.g7cbd89921bed66.gdb-index-dBV3s5 Finish: rpmbuild llvm-19.0.0~pre20240721.g7cbd89921bed66-1.fc40.src.rpm Finish: build phase for llvm-19.0.0~pre20240721.g7cbd89921bed66-1.fc40.src.rpm INFO: chroot_scan: 1 files copied to /var/lib/copr-rpmbuild/results/chroot_scan INFO: /var/lib/mock/fedora-40-i686-1721527280.068743/root/var/log/dnf5.log ERROR: Exception(/var/lib/copr-rpmbuild/results/llvm-19.0.0~pre20240721.g7cbd89921bed66-1.fc40.src.rpm) Config(fedora-40-i686) 518 minutes 17 seconds INFO: Results and/or logs in: /var/lib/copr-rpmbuild/results INFO: Cleaning up build root ('cleanup_on_failure=True') Start: clean chroot INFO: unmounting tmpfs. Finish ```

Here's an excerpt from a test log on rhel-8-s390x. At first sight it looks like there's no compat package available for that architecture. Taking a look at the copr monitor of the compat packages this impression is confirmed because we don't have any rhel-8 build roots. I know that for RHEL we usually do bundle build of compat packages. Shall we try to do this for the snapshots builds as well maybe when building for RHEL? I'd like that because eventually we need to do this anyways. What is the Fedora policy for this anyways? Would bundled compat packages also work for Fedora? Then we can use one mechanism for both OSes. @tuliom @tstellar @nikic @tbaederr what are your opinions?

        Errors during downloading metadata for repository 'coprdep:https_download_copr_fedorainfracloud_org_results_40fedora_llvm_team_llvm_compat_packages_distname_releasever_basearch':
          - Status code: 404 for https://download.copr.fedorainfracloud.org/results/%40fedora-llvm-team/llvm-compat-packages/rhel-8-s390x/repodata/repomd.xml (IP: 108.139.15.57)
        Error: Failed to download metadata for repo 'coprdep:https_download_copr_fedorainfracloud_org_results_40fedora_llvm_team_llvm_compat_packages_distname_releasever_basearch': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried
        Ignoring repositories: coprdep:https_download_copr_fedorainfracloud_org_results_40fedora_llvm_team_llvm_compat_packages_distname_releasever_basearch
        Error: 
         Problem 1: package lld-19.0.0~pre20240721.g7cbd89921bed66-1.el8.s390x from copr:copr.fedorainfracloud.org:group_fedora-llvm-team:llvm-snapshots-big-merge-20240721 requires libLLVM.so.19.0pre20240721.g7cbd89921bed66()(64bit), but none of the providers can be installed
          - package lld-19.0.0~pre20240721.g7cbd89921bed66-1.el8.s390x from copr:copr.fedorainfracloud.org:group_fedora-llvm-team:llvm-snapshots-big-merge-20240721 requires libLLVM.so.19.0pre20240721.g7cbd89921bed66(LLVM_19.0)(64bit), but none of the providers can be installed
          - conflicting requests
          - package llvm-libs-19.0.0~pre20240721.g7cbd89921bed66-1.el8.s390x from copr:copr.fedorainfracloud.org:group_fedora-llvm-team:llvm-snapshots-big-merge-20240721 is filtered out by modular filtering
         Problem 2: package libomp-devel-19.0.0~pre20240721.g7cbd89921bed66-1.el8.s390x from copr:copr.fedorainfracloud.org:group_fedora-llvm-team:llvm-snapshots-big-merge-20240721 requires llvm = 19.0.0~pre20240721.g7cbd89921bed66-1.el8, but none of the providers can be installed
          - conflicting requests
          - package llvm-19.0.0~pre20240721.g7cbd89921bed66-1.el8.s390x from copr:copr.fedorainfracloud.org:group_fedora-llvm-team:llvm-snapshots-big-merge-20240721 is filtered out by modular filtering

@kwk The error relating to compat packages here is a red-herring. This just occurs because we have it listed as a dependency, but the rhel 8 chroots aren't enabled in that copr. I went ahead and added them.

The actual error here is modularity related. Note that the builds on x86_64 and aarch64 pass -- the reason is that they actually test the LLVM 17 version in the current compose, not the copr packages. On s390x there is an error because the compose does not have lld/libomp, so those get installed from copr but then we can't install their dependencies due to modularity.

It's possible that we need to use a module build on RHEL 8 to make this work out of the box. I'll look into it.

Regarding your question about the bundled compact packages, no, they cannot be used on Fedora. The compat package requirements on Fedora and RHEL are actually very different. On Fedora, we want to ship full compat toolchains that stay available in the medium term and other packages can use. On RHEL, we only want to temporarily provide the old libraries so packages until packages are rebuilt against the new version. The compat libraries are never shipped to customers. (On RHEL 8 the situation is a bit more complicated, but this is the general idea.)

/recheck rhel-8-x86_64

I've enabled the module hotfixes option on the incubator project, let's see if that allows the correct rpms to be installed...

/retest rhel-8-x86_64

Okay, that worked, in the sense that we're now testing the correct version. Now we get the compat library error when installing rust:

        Error: 
         Problem 1: cannot install both llvm-libs-17.0.6-2.module+el8.10.0+21256+978ccea6.x86_64 from rhel-AppStream and llvm-libs-19.0.0~pre20240721.g7cbd89921bed66-1.el8.x86_64 from copr:copr.fedorainfracloud.org:group_fedora-llvm-team:llvm-snapshots-big-merge-20240721
          - package rust-1.75.0-1.module+el8.10.0+21160+cc6a0df8.x86_64 from rhel-AppStream requires libLLVM-17.so()(64bit), but none of the providers can be installed
          - package rust-1.75.0-1.module+el8.10.0+21160+cc6a0df8.x86_64 from rhel-AppStream requires libLLVM-17.so(LLVM_17)(64bit), but none of the providers can be installed
          - cannot install the best candidate for the job
          - conflicting requests
         Problem 2: cannot install both llvm-libs-17.0.6-2.module+el8.10.0+21256+978ccea6.x86_64 from rhel-AppStream and llvm-libs-19.0.0~pre20240721.g7cbd89921bed66-1.el8.x86_64 from copr:copr.fedorainfracloud.org:group_fedora-llvm-team:llvm-snapshots-big-merge-20240721
          - package rust-1.75.0-1.module+el8.10.0+21160+cc6a0df8.x86_64 from rhel-AppStream requires libLLVM-17.so()(64bit), but none of the providers can be installed
          - package rust-1.75.0-1.module+el8.10.0+21160+cc6a0df8.x86_64 from rhel-AppStream requires libLLVM-17.so(LLVM_17)(64bit), but none of the providers can be installed
          - package lldb-19.0.0~pre20240721.g7cbd89921bed66-1.el8.x86_64 from copr:copr.fedorainfracloud.org:group_fedora-llvm-team:llvm-snapshots-big-merge-20240721 requires libLLVM.so.19.0pre20240721.g7cbd89921bed66()(64bit), but none of the providers can be installed
          - package lldb-19.0.0~pre20240721.g7cbd89921bed66-1.el8.x86_64 from copr:copr.fedorainfracloud.org:group_fedora-llvm-team:llvm-snapshots-big-merge-20240721 requires libLLVM.so.19.0pre20240721.g7cbd89921bed66(LLVM_19.0)(64bit), but none of the providers can be installed
          - package cargo-1.75.0-1.module+el8.10.0+21160+cc6a0df8.x86_64 from rhel-AppStream requires rust, but none of the providers can be installed
          - cannot install the best candidate for the job
          - conflicting requests

Note that this needs LLVM 17 compat libraries, not LLVM 18. I'll see about building those sometime.

I've put up https://github.com/fedora-llvm-team/llvm-snapshots/pull/602 to enable the --module-hotfixes option.

/retest rhel-8-x86_64

Testing again with compat libraries built.

/retest rhel-8-x86_64

Looks like that worked, though I can't confirm it uses the correct builds, as the testing farm artifact viewer seems to be broken right now...

Confirmed this has been fixed. Thanks!

fedora-llvm-team / llvm-snapshots

Snapshot for 20240721, v19.0.0, 7cbd899 (big-merge) #600

Testing-farm results are in!

Failed testing-farm test cases

Errors found in Copr builds on `fedora-40-i386`

fedora-llvm-team / llvm-snapshots

Snapshot for 20240721, v19.0.0, 7cbd899 (big-merge) #600

Testing-farm results are in!

Failed testing-farm test cases

Errors found in Copr builds on fedora-40-i386

Errors found in Copr builds on `fedora-40-i386`