search

adoptium / aqa-tests

Home of test infrastructure for Adoptium builds
https://adoptium.net/aqavit
Apache License 2.0
128 stars 308 forks source link

July 2024 JDK11 Release Triage #5442

Closed smlambert closed 1 month ago

smlambert commented 1 month ago

Release Summary Report for release-openjdk11-pipeline

Report generated at: Tue, 16 Jul 2024 23:37:00 GMT

TRSS Build and TRSS Grid View Jenkins Build URL https://ci.adoptium.net/job/build-scripts/job/release-openjdk11-pipeline/48/ Started by upstream project "build-scripts/utils/releaseTrigger_jdk11u" build number 4007 at 7/16/2024, 6:42:14 PM

✔️ results in these Tables means the activity has successfully completed. ⏳ results means that we are actively working on closing off the runs needed for this version, platform, binaryType. ⛔ means there is no build planned for that version/platform combination. ⏸️ means activity not yet started.

Platform Status Results Actions
x86-64_mac ✔️ comment
x86-64_linux ✔️ comment
x86-64_windows ✔️ comment
aarch64_linux ✔️ comment
aarch64_mac ✔️ comment
x86-64_alpine-linux ✔️ comment
ppc64le_linux ✔️ all pass
s390x_linux ✔️ comment
ppc64_aix ✔️ comment
arm_linux n/a see below comment Need to cherrypick https://github.com/adoptium/ci-jenkins-pipelines/pull/1079 to release branch and rerun build

Separate pipeline for win32 and rerun of arm32 TRSS Build and TRSS Grid View Jenkins Build URL https://ci.adoptium.net/job/build-scripts/job/release-openjdk11-pipeline/49/ Started by upstream project "build-scripts/utils/releaseTrigger_jdk11u" build number 4007 at 7/18/2024, 10:50:32 PM

Platform Status Results Actions
x86-32_windows ✔️ comment
arm_linux ✔️ comment
jiekang commented 1 month ago

x86-64_windows ✔️

jiekang: @smlambert FYI: Looks okay to me

sanity.perf

Failed when collecting artifacts via machine test-docker-ubuntu2004-armv7l-2:

[2024-07-17T06:28:29.146Z] Running on test-docker-ubuntu2004-armv7l-2 in /home/jenkins/workspace/Test_openjdk11_hs_sanity.perf_x86-64_windows
...
[2024-07-17T06:57:29.351Z] Exception: hudson.remoting.RequestAbortedException: java.nio.channels.ClosedChannelException

https://ci.adoptium.net/job/Test_openjdk11_hs_extended.perf_x86-64_windows/177/consoleText Actual test job passes, but fails to upload artifacts, uploading TAP file showing success here Test_openjdk11_hs_extended.perf_x86-64_windows_testList_0.tap.txt

extended.openjdk Passed via Grinder on test-azure-win2019-x64-1 https://ci.adoptium.net/job/Grinder/10609/ - passes Grinder_20240717145634_jdk11_x64Win.tap.txt

jdk_tools_1 build-azure-win2022-x64-2 sun/tools/jhsdb/JShellHeapDumpTest.java Passed via Grinder on test-azure-win2019-x64-1

jdk_custom_0 test-azure-win2022-x64-1 sun/tools/jhsdb/JShellHeapDumpTest.java Passed via Grinder on test-azure-win2019-x64-1

smlambert commented 1 month ago

aarch64_linux ✔️

extended.openjdk has 1 testcase failing in original, passes on rerun

# Timestamp: Wed Jul 17 09:43:04 2024 UTC 
# CUSTOM_TARGET: javax/imageio/plugins/shared/RepeatingWriteTest.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 1   FAILED: 0   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 1; failed: 0; error: 0; skipped: 0 
1..1
ok 1 - jdk_custom_0
  ---
    output:
      |
        Test results: passed: 1
    duration_ms: 36940
  ...
smlambert commented 1 month ago

aarch64_mac ✔️ extended.openjdk, 1 testcase failure that is excluded (but was not cherrypicked to release branch in time for this platform)

# Timestamp: Wed Jul 17 03:39:48 2024 UTC 
# CUSTOM_TARGET: java/nio/channels/DatagramChannel/BasicMulticastTests.java build/AbsPathsInImage.java build/AbsPathsInImage.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 0   FAILED: 1   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 1; failed: 1; error: 0; skipped: 0 
1..1
not ok 1 - jdk_custom_0
  ---
    output:
      |
        Failed test cases: 
        TEST: build/AbsPathsInImage.java
        Test results: passed: 1; failed: 1
    duration_ms: 7684
  ...
smlambert commented 1 month ago

x86-64_mac ✔️

extended.openjdk 1 testcase failure that passes in rerun

# Timestamp: Wed Jul 17 13:15:56 2024 UTC 
# CUSTOM_TARGET: jdk/jfr/javaagent/TestLoadedAgent.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 1   FAILED: 0   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 1; failed: 0; error: 0; skipped: 0 
1..1
ok 1 - jdk_custom_0
  ---
    output:
      |
        Test results: passed: 1
    duration_ms: 21658
  ...
smlambert commented 1 month ago

x86-64_linux ✔️

extended.openjdk has 1 testcase failing in original, passes in rerun

# Timestamp: Wed Jul 17 13:12:51 2024 UTC 
# CUSTOM_TARGET: tools/jmod/hashes/HashesOrderTest.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 1   FAILED: 0   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 1; failed: 0; error: 0; skipped: 0 
1..1
ok 1 - jdk_custom_0
  ---
    output:
      |
        Test results: passed: 1
    duration_ms: 37625
  ...

sanity.system has 1 target failing in original, passes in rerun

# Timestamp: Wed Jul 17 05:44:54 2024 UTC 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 1   FAILED: 0   DISABLED: 0   SKIPPED: 0
1..1
ok 1 - TestJlmRemoteMemoryNoAuth_1
  ---
    duration_ms: 635522
  ...
smlambert commented 1 month ago

x86-64_alpine-linux ✔️ https://ci.adoptium.net/job/build-scripts/job/jobs/job/release/job/jobs/job/jdk11u/job/jdk11u-release-alpine-linux-x64-temurin/20/ - all pass

smlambert commented 1 month ago

s390x_linux ✔️

extended.openjdk has 6 targets fail in original, all pass in rerun

# Timestamp: Wed Jul 17 14:53:20 2024 UTC 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 6   EXECUTED: 6   PASSED: 6   FAILED: 0   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 2,570; failed: 0; error: 0; skipped: 0 
1..6
ok 1 - jvm_compiler_1
  ---
    output:
      |
        Test results: passed: 867
    duration_ms: 1943970
  ...
ok 2 - jdk_beans_1
  ---
    output:
      |
        Test results: passed: 363
    duration_ms: 373072
  ...
ok 3 - jdk_jmx_1
  ---
    output:
      |
        Test results: passed: 250
    duration_ms: 387529
  ...
ok 4 - jdk_tools_1
  ---
    output:
      |
        Test results: passed: 222
    duration_ms: 413101
  ...
ok 5 - jdk_jfr_0
  ---
    output:
      |
        Test results: passed: 434
    duration_ms: 503022
  ...
ok 6 - jdk_jfr_1
  ---
    output:
      |
        Test results: passed: 434
    duration_ms: 528180
  ...
smlambert commented 1 month ago

ppc64_aix ✔️

extended.openjdk has 3 testcases fail in rerun (which can pass on TC nodes in TCGrinder/4375) - 2 testcases pass Grinder_20240717192203_jdk11_ppc64Aix.tap.txt TestUTCParse still fails, try in Grinder/10620 passes Grinder_20240717201747_jdk11_aix.tap.txt

# Timestamp: Wed Jul 17 13:35:00 2024 UTC 
# CUSTOM_TARGET: java/time/test/java/time/format/TestUTCParse.java java/net/httpclient/SpecialHeadersTest.java java/net/httpclient/StreamingBody.java java/net/httpclient/SpecialHeadersTest.java java/net/httpclient/StreamingBody.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 0   FAILED: 1   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 0; failed: 3; error: 0; skipped: 0 
1..1
not ok 1 - jdk_custom_0
  ---
    output:
      |
        Failed test cases: 
        TEST: java/net/httpclient/SpecialHeadersTest.java
        TEST: java/net/httpclient/StreamingBody.java
        TEST: java/time/test/java/time/format/TestUTCParse.java
        Test results: failed: 3
    duration_ms: 132912
  ...

extended.system 1 target fails in original, passes in rerun

# Timestamp: Wed Jul 17 13:35:44 2024 UTC 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 1   FAILED: 0   DISABLED: 0   SKIPPED: 0
1..1
ok 1 - MiniMix_aot_5m_0
  ---
    duration_ms: 694892
  ...
smlambert commented 1 month ago

arm_linux ✔️

Build fails in same way as dry-run, workaround/fix (https://github.com/adoptium/ci-jenkins-pipelines/pull/1079) went into master, but not cherrypicked to release branch so still fails

2nd try, from release-openjdk11-pipeline/49

extended.openjdk 1 child job failed, lost connection with node, other 2 child jobs passed, rerun failed test job in https://ci.adoptium.net/job/Test_openjdk11_hs_extended.openjdk_arm_linux_testList_1/17/, passes Test_openjdk11_hs_extended.openjdk_arm_linux_testList_1.tap.txt

00:57:33  Cannot contact test-docker-ubuntu2404-armv7-1: java.lang.InterruptedException
11:05:14  apparent clock skew in /home/jenkins/workspace/Test_openjdk11_hs_extended.openjdk_arm_linux_testList_1@tmp/durable-5594a31f
11:10:28  wrapper script does not seem to be touching the log file in /home/jenkins/workspace/Test_openjdk11_hs_extended.openjdk_arm_linux_testList_1@tmp/durable-5594a31f
11:10:28  (JENKINS-48300: if on an extremely laggy filesystem, consider -Dorg.jenkinsci.plugins.durabletask.BourneShellScript.HEARTBEAT_CHECK_INTERVAL=86400)

all other top-level test targets passed

smlambert commented 1 month ago

x86-32_windows ✔️

extended.openjdk has 1 testcase failure, rerun in Grinder/10631 passes Grinder_20240719232120_jdk11_win32.tap.txt

# Timestamp: Fri Jul 19 09:44:57 2024 UTC 
# CUSTOM_TARGET: sun/tools/jhsdb/JShellHeapDumpTest.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 0   FAILED: 1   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 0; failed: 1; error: 0; skipped: 0 
1..1
not ok 1 - jdk_custom_0
  ---
    output:
      |
        Failed test cases: 
        TEST: sun/tools/jhsdb/JShellHeapDumpTest.java
        Test results: failed: 1
    duration_ms: 141886
  ...
sophia-guo commented 1 month ago

All taps https://ci.adoptium.net/view/Test_grinder/job/TAP_Collection/12/

sophia-guo commented 1 month ago

Uploaded https://github.com/adoptium/temurin11-binaries/releases/download/jdk-11.0.24%2B8/AQAvitTapFiles.tar.gz