search

adoptium / aqa-tests

Home of test infrastructure for Adoptium builds
https://adoptium.net/aqavit
Apache License 2.0
128 stars 308 forks source link

July 2024 JDK21 Release Triage #5444

Closed smlambert closed 1 month ago

smlambert commented 1 month ago

Release Summary Report for release-openjdk21-pipeline

Report generated at: Tue, 16 Jul 2024 23:38:40 GMT

TRSS Build and TRSS Grid View Jenkins Build URL https://ci.adoptium.net/job/build-scripts/job/release-openjdk21-pipeline/34/ Started by upstream project "build-scripts/utils/releaseTrigger_jdk21u" build number 2837 at 7/16/2024, 6:42:14 PM

✔️ results in these Tables means the activity has successfully completed. ⏳ results means that we are actively working on closing off the runs needed for this version, platform, binaryType. ⛔ means there is no build planned for that version/platform combination. ⏸️ means activity not yet started.

Platform Status Results Actions
x86-64_mac ✔️ comment
x86-64_linux ✔️ comment
x86-64_windows ✔️ comment
aarch64_linux ✔️ comment
aarch64_mac ✔️ comment
x86-64_alpine-linux ✔️ comment
ppc64le_linux ✔️ comment
s390x_linux ✔️ comment
ppc64_aix ✔️ all pass
aarch64_alpine-linux ✔️ comment
riscv64_linux ✔️ comment
smlambert commented 1 month ago

aarch64_mac ✔️

extended.openjdk, 1 testcase failure, passes on rerun

# Timestamp: Wed Jul 17 01:38:55 2024 UTC 
# CUSTOM_TARGET: jdk/jfr/jcmd/TestJcmdDump.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 1   FAILED: 0   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 1; failed: 0; error: 0; skipped: 0 
1..1
ok 1 - jdk_custom_0
  ---
    output:
      |
        Test results: passed: 1
    duration_ms: 11838
  ...
jiekang commented 1 month ago

x86-64_windows 21 ✔️

jiekang: @smlambert FYI: Looks okay to me

sanity.perf

Failed when collecting artifacts via machine test-sxa-armv7l-ubuntu2004-odroid-2

[2024-07-17T06:00:38.100Z] Running on test-sxa-armv7l-ubuntu2004-odroid-2 in /ssd/jenkins/workspace/Test_openjdk21_hs_sanity.perf_x86-64_windows
...
[2024-07-17T06:04:49.333Z] Exception: hudson.remoting.RequestAbortedException: java.nio.channels.ClosedChannelException

https://ci.adoptium.net/job/Test_openjdk21_hs_sanity.perf_x86-64_windows/159/consoleText

Test job passes: Test_openjdk21_hs_sanity.perf_x86-64_windows_testList_0.tap.txt

extended.openjdk jdk_imageio_0 build-azure-win2022-x64-2 jdk_imageio_1 build-azure-win2022-x64-2

javax/imageio/plugins/jpeg/JPEGsNotAcceleratedTest.java

Known headless issue Passed via jdk_custom_0 rerun

jdk_net_0 build-azure-win2022-x64-3 jdk_net_1 test-azure-win2022-x64-1

com/sun/net/httpserver/simpleserver/jwebserver/CommandLinePositiveTest.java com/sun/net/httpserver/simpleserver/CommandLinePositiveTest.java

Known failure to bind all interfaces Passed via Grinder on test-azure-win2016-x64-1

jdk_tools_0 test-azure-win2022-x64-1 jdk_tools_1 test-azure-win2022-x64-1

sun/tools/jhsdb/HeapDumpTestWithActiveProcess.java sun/tools/jhsdb/JShellHeapDumpTest.java

Passed via jdk_custom_0 rerun

tools/jpackage/share/ServiceTest.java tools/jpackage/windows/WinLongVersionTest.java#id1

Passed via Grinder on test-azure-win2016-x64-1

jdk_jfr_1 test-azure-win2022-x64-1

jdk/jfr/jcmd/TestJcmdDump.java

Out of memory error Passed via jdk_custom_0 rerun

jdk_beans_0 test-azure-win2022-x64-2 jdk_beans_1 test-azure-win2022-x64-2

java/beans/PropertyEditor/6380849/TestPropertyEditor.java java/beans/PropertyEditor/TestColorClass.java java/beans/PropertyEditor/TestColorClassJava.java java/beans/PropertyEditor/TestColorClassNull.java java/beans/PropertyEditor/TestColorClassValue.java java/beans/PropertyEditor/TestFontClassJava.java java/beans/PropertyEditor/TestFontClassNull.java java/beans/PropertyEditor/TestFontClass.java java/beans/PropertyEditor/TestFontClassValue.java java/beans/XMLEncoder/java_awt_ScrollPane.java

Passed via jdk_custom_0 rerun

jdk_custom_0 test-azure-win2019-x64-1 Passed via Grinder on test-azure-win2016-x64-1 https://ci.adoptium.net/job/Grinder/10610/

com/sun/net/httpserver/simpleserver/CommandLinePositiveTest.java com/sun/net/httpserver/simpleserver/jwebserver/CommandLinePositiveTest.java

Failure to bind all interfaces Passed via Grinder on test-azure-win2016-x64-1

tools/jpackage/share/ServiceTest.java tools/jpackage/windows/WinLongVersionTest.java#id1

MSI/WIX issue Passed via Grinder on test-azure-win2016-x64-1

jiekang commented 1 month ago

aarch64_linux 21 ✔️

jiekang: @smlambert FYI: aarch64_linux 21 looks okay to me.

sanity.openjdk Passed via Grinder on test-docker-ubi8-armv8-1 https://ci.adoptium.net/job/Grinder/10608/

jdk_lang_0 test-aws-rhel76-armv8-1

same as jdk_lang_1

jdk_lang_1 test-aws-rhel76-armv8-1

java/lang/Thread/virtual/stress/PingPong.java#ltq

Agent timeout Passed via Grinder on test-docker-ubi8-armv8-1

java/lang/Thread/virtual/stress/PingPong.java#sq

Agent timeout Passed via Grinder on test-docker-ubi8-armv8-1

java/lang/Thread/virtual/stress/Skynet.java#default

Program timeout Passed via Grinder on test-docker-ubi8-armv8-1

extended.openjdk

jdk_jdi_1 test-docker-ubuntu2004-armv8l-2 com/sun/jdi/FinalizerTest.java

Out of Memory error Known intermittent failure, non-blocking, based on https://github.com/adoptium/aqa-tests/issues/5437#issuecomment-2225700225

jdk_security3_0 test-docker-ubuntu1804-armv8l-4 sun/security/ec/ed/EdDSATest.java

Agent timeout. Passed via jdk_custom_0 rerun

jdk_custom_0 test-docker-amazon2023-armv8l-1

com/sun/jdi/FinalizerTest.java

Out of Memory error Known intermittent failure, non-blocking, based on https://github.com/adoptium/aqa-tests/issues/5437#issuecomment-2225700225

smlambert commented 1 month ago

x86-64_linux ✔️

sanity.openjdk has 1 testcase failure that passes in rerun

# Timestamp: Wed Jul 17 08:41:41 2024 UTC 
# CUSTOM_TARGET: java/lang/Thread/virtual/stress/GetStackTraceALotWhenPinned.java#id0 java/lang/Thread/virtual/stress/GetStackTraceALotWhenPinned.java#id0 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 1   FAILED: 0   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 1; failed: 0; error: 0; skipped: 0 
1..1
ok 1 - jdk_custom_0
  ---
    output:
      |
        Test results: passed: 1
    duration_ms: 249272
  ...

extended.openjdk has 2 testcase failures that pass on rerun

# Timestamp: Wed Jul 17 12:58:37 2024 UTC 
# CUSTOM_TARGET: jdk/jfr/jcmd/TestJcmdDump.java java/net/httpclient/ManyRequests2.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 1   FAILED: 0   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 2; failed: 0; error: 0; skipped: 0 
1..1
ok 1 - jdk_custom_0
  ---
    output:
      |
        Test results: passed: 2
    duration_ms: 101130
  ...
smlambert commented 1 month ago

x86-64_mac ✔️

sanity.openjdk has 2 testcase failures in original that pass in rerun

# Timestamp: Wed Jul 17 13:42:51 2024 UTC 
# CUSTOM_TARGET: java/lang/Thread/virtual/stress/GetStackTraceALotWhenPinned.java#id0 java/lang/Thread/virtual/stress/ParkALot.java#id0 java/lang/Thread/virtual/stress/GetStackTraceALotWhenPinned.java#id0 java/lang/Thread/virtual/stress/ParkALot.java#id0 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 1   FAILED: 0   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 2; failed: 0; error: 0; skipped: 0 
1..1
ok 1 - jdk_custom_0
  ---
    output:
      |
        Test results: passed: 2
    duration_ms: 68538
  ...

extended.openjdk has 3 testcase failures that fail in original and pass in rerun

# Timestamp: Wed Jul 17 12:06:43 2024 UTC 
# CUSTOM_TARGET: java/nio/channels/DatagramChannel/AdaptorMulticasting.java java/nio/channels/DatagramChannel/BasicMulticastTests.java jdk/jfr/api/consumer/streaming/TestOutOfProcessMigration.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 1   FAILED: 0   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 3; failed: 0; error: 0; skipped: 0 
1..1
ok 1 - jdk_custom_0
  ---
    output:
      |
        Test results: passed: 3
    duration_ms: 34586
  ...
smlambert commented 1 month ago

aarch64_alpine-linux ✔️

extended.openjdk 1 testcase fails in rerun, run in Grinder/10619 - passes Grinder_20240717192707_jdk21_aarch64AlpineLinux.tap.txt

# Timestamp: Wed Jul 17 14:02:46 2024 UTC 
# CUSTOM_TARGET: com/sun/jdi/FinalizerTest.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 0   FAILED: 1   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 0; failed: 1; error: 0; skipped: 0 
1..1
not ok 1 - jdk_custom_0
  ---
    output:
      |
        Failed test cases: 
        TEST: com/sun/jdi/FinalizerTest.java
        Test results: failed: 1
    duration_ms: 23682
  ...
smlambert commented 1 month ago

ppc64le_linux ✔️

extended.openjdk 2 testcases fail in original, pass in rerun

# Timestamp: Wed Jul 17 06:33:33 2024 UTC 
# CUSTOM_TARGET: java/beans/Beans/TypoInBeanDescription.java jdk/jfr/jcmd/TestJcmdDump.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 1   FAILED: 0   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 2; failed: 0; error: 0; skipped: 0 
1..1
ok 1 - jdk_custom_0
  ---
    output:
      |
        Test results: passed: 2
    duration_ms: 52345
  ...
smlambert commented 1 month ago

s390x_linux ✔️

extended.openjdk 61 testcases fail in original pass in rerun

# Timestamp: Wed Jul 17 12:29:13 2024 UTC 
# CUSTOM_TARGET: com/sun/jndi/rmi/registry/objects/RmiFactoriesFilterTest.java javax/rmi/ssl/SSLSocketParametersTest.java com/sun/management/DiagnosticCommandMBean/DcmdMBeanDoubleInvocationTest.java com/sun/management/DiagnosticCommandMBean/DcmdMBeanInvocationTest.java com/sun/management/DiagnosticCommandMBean/DcmdMBeanTest.java sun/management/jdp/JdpDefaultsTest.java sun/management/jdp/JdpJmxRemoteDynamicPortTest.java sun/management/jdp/JdpSpecificAddressTest.java sun/management/jmxremote/bootstrap/CustomLauncherTest.java sun/management/jmxremote/bootstrap/JMXInterfaceBindingTest.java sun/management/jmxremote/bootstrap/JvmstatCountersTest.java sun/management/jmxremote/bootstrap/LocalManagementTest.java sun/management/jmxremote/bootstrap/RmiRegistrySslTest.java sun/management/jmxremote/startstop/JMXStartStopTest.java sun/management/jmxremote/startstop/JMXStatusPerfCountersTest.java jdk/jfr/jcmd/TestJcmdDump.java java/net/DatagramPacket/ReuseBuf.java java/net/DatagramSocket/SetDatagramSocketImplFactory/ADatagramSocket.java java/net/DatagramSocket/B6411513.java java/net/DatagramSocket/DatagramSocketExample.java java/net/DatagramSocket/DatagramSocketMulticasting.java java/net/DatagramSocket/Send12k.java java/net/DatagramSocket/SendReceiveMaxSize.java java/net/DatagramSocket/SendSize.java java/net/MulticastSocket/SetLoopbackModeIPv4.java java/net/PlainSocketImpl/BigBacklog.java java/net/PortUnreachableException/Concurrent.java java/net/PortUnreachableException/OneExceptionOnly.java java/net/Socket/asyncClose/BrokenPipe.java java/net/Socket/setReuseAddress/Restart.java java/net/Socket/B6210227.java java/net/Socket/CloseAvailable.java java/net/Socket/GetLocalAddress.java java/net/Socket/HttpProxy.java java/net/Socket/InheritTimeout.java java/net/Socket/ProxyCons.java java/net/Socket/ReadTimeout.java java/net/Socket/SetSoLinger.java java/net/Socket/SocksConnectTimeout.java java/net/Socket/SoTimeout.java java/net/SocketInputStream/SocketTimeout.java java/net/Socks/BadProxySelector.java jdk/net/ExtendedSocketOption/AsynchronousSocketChannelNAPITest.java jdk/net/ExtendedSocketOption/DatagramChannelNAPITest.java jdk/net/ExtendedSocketOption/DatagramSocketNAPITest.java jdk/net/ExtendedSocketOption/SocketChannelNAPITest.java jdk/net/ExtendedSocketOption/SocketNAPITest.java sun/net/www/http/HttpClient/B8025710.java sun/net/www/protocol/http/B6299712.java sun/net/www/protocol/http/B6369510.java sun/net/www/protocol/http/HttpOnly.java sun/net/www/protocol/http/NoCache.java sun/net/www/protocol/https/HttpsURLConnection/B6216082.java sun/net/www/protocol/https/HttpsURLConnection/ImpactOnSNI.java com/sun/tools/attach/BasicTests.java com/sun/tools/attach/StartManagementAgent.java sun/tools/jstatd/TestJstatdDefaults.java sun/tools/jstatd/TestJstatdExternalRegistry.java sun/tools/jstatd/TestJstatdPort.java sun/tools/jstatd/TestJstatdPortAndServer.java sun/tools/jstatd/TestJstatdServer.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 1   FAILED: 0   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 61; failed: 0; error: 0; skipped: 0 
1..1
ok 1 - jdk_custom_0
  ---
    output:
      |
        Test results: passed: 61
    duration_ms: 172034
  ...
smlambert commented 1 month ago

x86-64_alpine-linux ✔️

extended.openjdk pending - waiting on https://ci.adoptium.net/job/Test_openjdk21_hs_extended.openjdk_x86-64_alpine-linux/56/ - 1 testcase fails, passes in rerun

# Timestamp: Thu Jul 18 05:43:08 2024 UTC 
# CUSTOM_TARGET: jdk/jfr/jcmd/TestJcmdDump.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 1   FAILED: 0   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 1; failed: 0; error: 0; skipped: 0 
1..1
ok 1 - jdk_custom_0
  ---
    output:
      |
        Test results: passed: 1
    duration_ms: 43877
  ...

extended.system pending - waiting on https://ci.adoptium.net/job/Test_openjdk21_hs_extended.system_x86-64_alpine-linux_testList_0/4/ - passes

all other top-level targets passing

smlambert commented 1 month ago

riscv64_linux ✔️

sanity.openjdk testcase failures in original, pass in rerun 

# Timestamp: Thu Jul 18 01:16:35 2024 UTC 
# CUSTOM_TARGET: java/util/concurrent/ConcurrentQueues/ConcurrentQueueLoops.java java/util/prefs/CheckUserPrefsStorage.java java/lang/String/StringContentEqualsBug.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 1   FAILED: 0   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 3; failed: 0; error: 0; skipped: 0 
1..1
ok 1 - jdk_custom_0
  ---
    output:
      |
        Test results: passed: 3
    duration_ms: 133805
  ...

extended.openjdk pending - waiting on https://ci.adoptium.net/job/Test_openjdk21_hs_extended.openjdk_riscv64_linux/84/ 3 targets failing, pass in rerun

# Timestamp: Thu Jul 18 13:04:39 2024 UTC 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 3   EXECUTED: 3   PASSED: 3   FAILED: 0   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 2,597; failed: 0; error: 0; skipped: 0 
1..3
ok 1 - jvm_compiler_1
  ---
    output:
      |
        Test results: passed: 1,370
    duration_ms: 6834367
  ...
ok 2 - jdk_security3_1
  ---
    output:
      |
        Test results: passed: 933
    duration_ms: 11217738
  ...
ok 3 - jdk_tools_0
  ---
    output:
      |
        Test results: passed: 294
    duration_ms: 11343391
  ...

extended.perf pending - waiting on https://ci.adoptium.net/job/Test_openjdk21_hs_extended.perf_riscv64_linux/45/ - 1 child job terminates (hits TIME_LIMIT?), so rerun it in https://ci.adoptium.net/job/Test_openjdk21_hs_extended.perf_riscv64_linux_testList_1/3 passes Test_openjdk21_hs_extended.perf_riscv64_linux_testList_1.tap.txt

sophia-guo commented 1 month ago

Taps https://ci.adoptium.net/view/Test_grinder/job/TAP_Collection/15/

sophia-guo commented 1 month ago

uploaded https://github.com/adoptium/temurin21-binaries/releases/download/jdk-21.0.4%2B7/AQAvitTapFiles.tar.gz