github-actions[bot] commented 2 months ago

Summary

Build failures: 6 Test failures: 16

TRSS Pipeline Links

JDK8: https://trss.adoptium.net/resultSummary?parentId=66abea49d24e1b006e9b858d JDK8 Alpine: https://trss.adoptium.net/resultSummary?parentId=66abee86d24e1b006e9bc05f JDK11: https://trss.adoptium.net/resultSummary?parentId=66b67768d24e1b006eb25140 JDK17: https://trss.adoptium.net/resultSummary?parentId=66b67299d24e1b006eb21f31 JDK21: https://trss.adoptium.net/resultSummary?parentId=66b66901d24e1b006eb1cc88 JDK23: https://trss.adoptium.net/resultSummary?parentId=66b5192bd24e1b006eaadef6 JDK24: https://trss.adoptium.net/resultSummary?parentId=66b51946d24e1b006eaadef8

Failed Builds

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-temurin/504/ Cause: Error/exception found. Preventable: no

[2024-08-01T20:01:43.321Z] hudson.plugins.git.GitException: Command "/usr/local/bin/git fetch --tags --force --progress -- https://github.com/adoptium/ci-jenkins-pipelines.git +refs/heads/*:refs/remotes/origin/*" returned status code 128:

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-ppc64le-temurin/353/ Cause: No error found

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk23/job/jdk23-alpine-linux-x64-temurin/15/ Cause: Error/exception found. Preventable: no

[2024-08-08T19:01:26.278Z] Execution error: hudson.AbortException: script returned exit code 1

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-alpine-linux-x64-temurin/313/ Cause: Error/exception found. Preventable: no

[2024-08-08T19:02:29.954Z] Execution error: hudson.AbortException: script returned exit code 1

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-x64-temurin/516/ Cause: Error/exception found. Preventable: no

[2024-08-08T19:02:07.101Z] Execution error: hudson.AbortException: script returned exit code 1

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-s390x-temurin/290/ Cause: Error/exception found. Preventable: no

[2024-08-08T20:44:56.327Z] Execution error: hudson.AbortException: No artifacts found that match the file pattern "workspace/target/*". Configuration error?

Builds with Failed Tests (suspected)

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-temurin/523/ Cause: Post-build AQATest subjob failed. Preventable: no

[2024-08-03T01:12:49.878Z] Build Test_openjdk8_hs_dev.functional_x86-64_mac #23 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-ppc64le-temurin/479/ Cause: Post-build AQATest subjob failed. Preventable: no

[2024-08-01T20:35:22.762Z] Build Test_openjdk8_hs_special.functional_ppc64le_linux #199 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-x64-temurin/488/ Cause: Post-build AQATest subjob failed. Preventable: no

[2024-08-02T02:33:48.092Z] Build Test_openjdk8_hs_extended.functional_x86-64_linux #629 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x64-temurin/507/ Cause: Post-build AQATest subjob failed. Preventable: no

[2024-08-02T01:18:27.666Z] Build Test_openjdk8_hs_extended.system_x86-64_windows #932 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-alpine-linux-x64-temurin/444/ Cause: Smoke test failed. Preventable: no

[2024-08-01T22:39:27.786Z] Build build-scripts » jobs » jdk8u » jdk8u-alpine-linux-x64-temurin_SmokeTests #312 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-x64-temurin/408/ Cause: Post-build AQATest subjob failed. Preventable: no

[2024-08-10T02:31:33.866Z] Build Test_openjdk11_hs_sanity.external_x86-64_linux #639 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk17u/job/jdk17u-linux-ppc64le-temurin/453/ Cause: Post-build AQATest subjob failed. Preventable: no

[2024-08-09T20:48:06.013Z] Build Test_openjdk17_hs_extended.functional_ppc64le_linux #415 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk17u/job/jdk17u-linux-x64-temurin/602/ Cause: Post-build AQATest subjob failed. Preventable: no

[2024-08-10T01:21:26.783Z] Build Test_openjdk17_hs_sanity.external_x86-64_linux #27 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk17u/job/jdk17u-linux-arm-temurin/357/ Cause: Post-build AQATest subjob failed. Preventable: no

[2024-08-10T23:56:57.142Z] Build Test_openjdk17_hs_extended.openjdk_arm_linux #165 completed: ABORTED

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk21u/job/jdk21u-linux-ppc64le-temurin/157/ Cause: Post-build AQATest subjob failed. Preventable: no

[2024-08-09T22:06:35.137Z] Build Test_openjdk21_hs_sanity.openjdk_ppc64le_linux #149 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk21u/job/jdk21u-mac-aarch64-temurin/143/ Cause: Post-build AQATest subjob failed. Preventable: no

[2024-08-10T20:56:38.932Z] Build Test_openjdk21_hs_extended.openjdk_aarch64_mac #59 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk21u/job/jdk21u-linux-x64-temurin/262/ Cause: Post-build AQATest subjob failed. Preventable: no

[2024-08-09T22:31:52.546Z] Build Test_openjdk21_hs_sanity.external_x86-64_linux #29 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk23/job/jdk23-linux-ppc64le-temurin/15/ Cause: Post-build AQATest subjob failed. Preventable: no

[2024-08-08T22:18:48.528Z] Build Test_openjdk23_hs_special.openjdk_ppc64le_linux #27 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk23/job/jdk23-aix-ppc64-temurin/16/ Cause: Post-build AQATest subjob failed. Preventable: no

[2024-08-09T06:52:15.538Z] Build Test_openjdk23_hs_extended.system_ppc64_aix #17 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk23/job/jdk23-linux-riscv64-temurin/14/ Cause: Test job aborted. Preventable: no

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-alpine-linux-aarch64-temurin/142/ Cause: Post-build AQATest subjob failed. Preventable: no

[2024-08-08T21:02:20.164Z] Build Test_openjdk24_hs_extended.openjdk_aarch64_alpine-linux #7 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-ppc64le-temurin/299/ Cause: Post-build AQATest subjob failed. Preventable: no

[2024-08-08T22:25:04.897Z] Build Test_openjdk24_hs_sanity.openjdk_ppc64le_linux #6 completed: FAILURE

End of list

Script Issues

Issue 0: Could not find all three of the pipelines for jdk8. Will triage the pipelines we could find.
Issue 1: Error: Platform linux-arm should be built for jdk8u, but was not launched.
Issue 3: Riscv not correctly identified as having failed.
End of Issues

sxa commented 1 month ago

@adamfarley It doesn't look like this picked up the ABORTED build + extended.openjdk in the riscv64 job for jdk23 - perhaps that's something we could look at improving.

Ref: https://github.com/adoptium/ci-jenkins-pipelines/issues/1097

adamfarley commented 1 month ago

@adamfarley It doesn't look like this picked up the ABORTED build + extended.openjdk in the riscv64 job for jdk23 - perhaps that's something we could look at improving.

Ref: adoptium/ci-jenkins-pipelines#1097

That's odd. Will look into it. Aborted jobs should be identified as failures, you're right.

adamfarley commented 1 month ago

Build Triage

Failed Builds

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-temurin/504/ Noted and fixed here

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-ppc64le-temurin/353/

21:02:28  docker-osuosl-ubuntu2004-ppc64le-1 does not seem to be running inside a container
21:02:30  $ docker run -t -d -u 1000:1000 -e BUILDIMAGESHA=adoptopenjdk/centos7_build_image@sha256:d7158d02fc35bdbc9654a7e2dcfc649ccb3e347b570eab98562808c6ed939783
21:02:30   --init -w /home/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-linux-ppc64le-temurin -v /home/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-linux-ppc64le-temurin:/home/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-linux-ppc64le-temurin:rw,z -v /home/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-linux-ppc64le-temurin@tmp:/home/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-linux-ppc64le-temurin@tmp:rw,z -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** adoptopenjdk/centos7_build_image cat
21:05:30  ERROR: Timeout after 180 seconds

Looks like this issue is consistent-ish on docker-osuosl-ubuntu2004-ppc64le-1, and started happening on the 26th of June (with the previous run on the 7th taking 14 seconds). Raised a new issue here.

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk23/job/jdk23-alpine-linux-x64-temurin/15/
Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-alpine-linux-x64-temurin/313/
Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-x64-temurin/516/
```
20:01:26  + docker pull adoptopenjdk/alpine3_build_image
20:01:26  Using default tag: latest
20:01:26  Error response from daemon: Get "https://registry-1.docker.io/v2/": dial tcp: lookup registry-1.docker.io on 127.0.0.53:53: server misbehaving
```
The jobs before and after these ones show no sign of this issue. Will ignore for now, and raise an issue if it occurs again in the future. Documented here.

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-s390x-temurin/290/

21:44:52  Downloading GA release of boot JDK version 23 failed.
21:44:52  Attempting to download EA release of boot JDK version 23 from https://api.adoptium.net/v3/binary/latest/23/ea/linux/s390x/jdk/hotspot/normal/adoptium
21:44:52    % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
21:44:52                                   Dload  Upload   Total   Spent    Left  Speed
21:44:52  
21:44:52    0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
21:44:52    0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
21:44:52  
21:44:52    0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
21:44:52    0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
21:44:52  
21:44:52    5  192M    5 10.0M    0     0  13.9M      0  0:00:13 --:--:--  0:00:13 13.9M
21:44:52  curl: (18) transfer closed with 191282016 bytes remaining to read

Looks like we lost the connection to api.adoptium.net in the middle of the boot jdk download. Making a note in the networking issue.

adamfarley commented 1 month ago

Test failure triage

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-temurin/523/ Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-ppc64le-temurin/479/ Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-x64-temurin/488/ Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x64-temurin/507/ Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-alpine-linux-x64-temurin/444/

Triaged here.

https://ci.adoptium.net/job/Test_openjdk11_hs_sanity.external_x86-64_linux_testList_0/10/ https://ci.adoptium.net/job/Test_openjdk17_hs_sanity.external_x86-64_linux_testList_0/5/console

ERROR: failed to solve: failed to read dockerfile: failed to prepare  as n8vdqkm4s4m4cl6yvnkb63lkq: symlink ../n8vdqkm4s4m4cl6yvnkb63lkq/diff /var/lib/docker/overlay2

This issue should be removed as a cause for failure once the functional test exclusion has been completed. Issue link.

https://ci.adoptium.net/job/Test_openjdk17_hs_extended.functional_ppc64le_linux_testList_0/6/console https://ci.adoptium.net/job/Test_openjdk21_hs_sanity.openjdk_ppc64le_linux_testList_1/7/console https://ci.adoptium.net/job/Test_openjdk23_hs_special.openjdk_ppc64le_linux_testList_0/8/console https://ci.adoptium.net/job/Test_openjdk24_hs_sanity.openjdk_ppc64le_linux_rerun/2/console

All of the ppcle failures seem to be caused by the Xvfb timeout issue here.

There are many more failures than those listed above. These are just examples for each affected JDK version.

https://ci.adoptium.net/job/Test_openjdk17_hs_extended.openjdk_arm_linux_testList_2/19/

Job timeout.

Looks like the one before that failed as well, but not the one before that.

All three ran on the same machine (test-docker-ubuntu2004-armv7l-3) so my first theory is that something happened between job 18 and job 17 (the 31st of July and the 8th of August 2024) to make this machine much slower.

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk21u/job/jdk21u-mac-aarch64-temurin/143/

Lost connection to test-orka-macos14-arm64-t6n2q

https://ci.adoptium.net/job/Test_openjdk21_hs_sanity.external_x86-64_linux_testList_0/5/console

[exec] [91mE: Problem executing scripts APT::Update::Post-Invoke 'rm -f /var/cache/apt/archives/*.deb /var/cache/apt/archives/partial/*.deb /var/cache/apt/*.bin || true'

Issue link.

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk23/job/jdk23-aix-ppc64-temurin/16/

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk23/job/jdk23-linux-riscv64-temurin/14/

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-alpine-linux-aarch64-temurin/142/

adoptium / temurin-build

Build Issue Summary for 2024-08-12 #3909

Summary

TRSS Pipeline Links

Failed Builds

Builds with Failed Tests (suspected)

End of list

Script Issues

End of Issues

Build Triage

Test failure triage