search

adoptium / aqa-tests

Home of test infrastructure for Adoptium builds
https://adoptium.net/aqavit
Apache License 2.0
128 stars 308 forks source link

July 2024 JDK17 Dry-run Triage #5436

Closed smlambert closed 1 month ago

smlambert commented 1 month ago

TBD https://ci.adoptium.net/job/build-scripts/job/release-openjdk17-pipeline/67/

✔️ results in these Tables means the activity has successfully completed. ⏳ results means that we are actively working on closing off the runs needed for this version, platform, binaryType. ⛔ means there is no build planned for that version/platform combination. ⏸️ means activity not yet started.

Platform Status Results Actions
x86-64_mac ✔️ comment
x86-64_linux ✔️ comment raised https://github.com/adoptium/infrastructure/issues/3667
x86-64_windows ⏳ comment
aarch64_linux ✔️ comment
aarch64_mac ✔️ comment all pass
x86-64_alpine-linux ⏳ comment
ppc64le_linux ✔️ comment
s390x_linux ✔️ comment
ppc64_aix ⏳ comment
x86-32_windows ⏳ comment need to raise infra issue against build-azure-win2022-x64-3 for jdk_beans / font editor failures
arm_linux ⏳ comment
riscv64_linux ⏳ comment
smlambert commented 1 month ago

aarch64_mac ✔️

AQAvitTaps_jdk17_aarch64_mac.zip

smlambert commented 1 month ago

x86-64_mac ✔️ all pass

smlambert commented 1 month ago

x86-64_linux ✔️

not ok 3 - jdk_tools_0
  ---
    output:
      |
        Failed test cases: 
        TEST: tools/jpackage/linux/AppAboutUrlTest.java#id0
        TEST: tools/jpackage/linux/AppCategoryTest.java
        TEST: tools/jpackage/linux/LinuxBundleNameTest.java
        TEST: tools/jpackage/linux/LinuxResourceTest.java
        TEST: tools/jpackage/linux/jdk/jpackage/tests/UsrTreeTest.java
        TEST: tools/jpackage/linux/MaintainerTest.java
        TEST: tools/jpackage/linux/PackageDepsTest.java
        TEST: tools/jpackage/linux/ReleaseTest.java
        TEST: tools/jpackage/linux/ShortcutHintTest.java#id0
        TEST: tools/jpackage/share/jdk/jpackage/tests/BasicTest.java
        TEST: tools/jpackage/share/jdk/jpackage/tests/VendorTest.java#id1
        TEST: tools/jpackage/share/AppImagePackageTest.java
        TEST: tools/jpackage/share/AddLauncherTest.java#id1
        TEST: tools/jpackage/share/EmptyFolderPackageTest.java
        TEST: tools/jpackage/share/IconTest.java
        TEST: tools/jpackage/share/FileAssociationsTest.java#id0
        TEST: tools/jpackage/share/InstallDirTest.java#id0
        TEST: tools/jpackage/share/LicenseTest.java#id1
        TEST: tools/jpackage/share/LicenseTest.java#id0
        TEST: tools/jpackage/share/MultiLauncherTwoPhaseTest.java
        TEST: tools/jpackage/share/MultiNameTwoPhaseTest.java
        TEST: tools/jpackage/share/SimplePackageTest.java
        TEST: tools/jpackage/share/RuntimePackageTest.java#id0
        Test results: passed: 251; failed: 23
    duration_ms: 3664093
13:24:13.388] Running dpkg
[13:24:13.526] Command [PID: 936657]:
    dpkg -S /lib/x86_64-linux-gnu/libbrotlidec.so.1
[13:24:13.526] Output:
    dpkg-query: no path found matching pattern /lib/x86_64-linux-gnu/libbrotlidec.so.1
[13:24:13.526] Returned: 1

[13:24:13.527] java.io.IOException: Command [dpkg, -S, /lib/x86_64-linux-gnu/libbrotlidec.so.1] exited with 1 code
    at jdk.jpackage/jdk.jpackage.internal.Executor.executeExpectSuccess(Executor.java:90)
    at jdk.jpackage/jdk.jpackage.internal.LinuxDebBundler.lambda$initLibProvidersLookup$13(LinuxDebBundler.java:245)
    at jdk.jpackage/jdk.jpackage.internal.LibProvidersLookup.lambda$execute$1(LibProvidersLookup.java:73)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)
    at java.base/java.util.HashMap$KeySpliterator.forEachRemaining(HashMap.java:1707)
    at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509)
    at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)
    at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:575)
    at java.base/java.util.stream.AbstractPipeline.evaluateToArrayNode(AbstractPipeline.java:260)
    at java.base/java.util.stream.ReferencePipeline.toArray(ReferencePipeline.java:616)
    at java.base/java.util.stream.ReferencePipeline.toArray(ReferencePipeline.java:622)
    at java.base/java.util.stream.ReferencePipeline.toList(ReferencePipeline.java:627)
    at jdk.jpackage/jdk.jpackage.internal.LibProvidersLookup.execute(LibProvidersLookup.java:84)
    at jdk.jpackage/jdk.jpackage.internal.LinuxPackageBundler.getListOfNeededPackages(LinuxPackageBundler.java:197)
    at jdk.jpackage/jdk.jpackage.internal.LinuxPackageBundler.createDefaultReplacementData(LinuxPackageBundler.java:225)
    at jdk.jpackage/jdk.jpackage.internal.LinuxPackageBundler.execute(LinuxPackageBundler.java:153)
    at jdk.jpackage/jdk.jpackage.internal.Arguments.generateBundle(Arguments.java:674)
    at jdk.jpackage/jdk.jpackage.internal.Arguments.processArguments(Arguments.java:551)
    at jdk.jpackage/jdk.jpackage.main.Main.execute(Main.java:91)
    at jdk.jpackage/jdk.jpackage.main.Main.main(Main.java:52)
[13:24:13.530] Running dpkg
[13:24:13.665] Command [PID: 936658]:
    dpkg -S /lib/x86_64-linux-gnu/libmd.so.0
[13:24:13.665] Output:
    dpkg-query: no path found matching pattern /lib/x86_64-linux-gnu/libmd.so.0
[13:24:13.665] Returned: 1

extended.openjdk had 1 target jdk_tools with 23 testcases failing in original on test-azure-ubuntu2404-x64-1, all pass in rerun on test-aws-rhel8-x64-1 :

# CUSTOM_TARGET: tools/jpackage/linux/AppAboutUrlTest.java#id0 tools/jpackage/linux/AppCategoryTest.java tools/jpackage/linux/LinuxBundleNameTest.java tools/jpackage/linux/LinuxResourceTest.java tools/jpackage/linux/jdk/jpackage/tests/UsrTreeTest.java tools/jpackage/linux/MaintainerTest.java tools/jpackage/linux/PackageDepsTest.java tools/jpackage/linux/ReleaseTest.java tools/jpackage/linux/ShortcutHintTest.java#id0 tools/jpackage/share/jdk/jpackage/tests/BasicTest.java tools/jpackage/share/jdk/jpackage/tests/VendorTest.java#id1 tools/jpackage/share/AppImagePackageTest.java tools/jpackage/share/AddLauncherTest.java#id1 tools/jpackage/share/EmptyFolderPackageTest.java tools/jpackage/share/IconTest.java tools/jpackage/share/FileAssociationsTest.java#id0 tools/jpackage/share/InstallDirTest.java#id0 tools/jpackage/share/LicenseTest.java#id1 tools/jpackage/share/LicenseTest.java#id0 tools/jpackage/share/MultiLauncherTwoPhaseTest.java tools/jpackage/share/MultiNameTwoPhaseTest.java tools/jpackage/share/SimplePackageTest.java tools/jpackage/share/RuntimePackageTest.java#id0 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 1   FAILED: 0   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 23; failed: 0; error: 0; skipped: 0 
1..1
ok 1 - jdk_custom_0
  ---
    output:
      |
        Test results: passed: 23
    duration_ms: 161082
  ...

Raised https://github.com/adoptium/infrastructure/issues/3667

smlambert commented 1 month ago

x86-64_windows ⏳

2 targets, jdk_beans,jdk_tools with 13 testcases failing in original and in the rerun build (on test-azure-win-2 and bld-win2022-1): 

# Timestamp: Fri Jul 12 19:09:26 2024 UTC 
# CUSTOM_TARGET: java/beans/PropertyEditor/6380849/TestPropertyEditor.java java/beans/PropertyEditor/TestColorClass.java java/beans/PropertyEditor/TestColorClassJava.java java/beans/PropertyEditor/TestColorClassNull.java java/beans/PropertyEditor/TestColorClassValue.java java/beans/PropertyEditor/TestFontClass.java java/beans/PropertyEditor/TestFontClassJava.java java/beans/PropertyEditor/TestFontClassNull.java java/beans/PropertyEditor/TestFontClassValue.java java/beans/XMLEncoder/java_awt_ScrollPane.java javax/imageio/plugins/jpeg/JPEGsNotAcceleratedTest.java javax/imageio/plugins/jpeg/JPEGsNotAcceleratedTest.java java/beans/PropertyEditor/6380849/TestPropertyEditor.java java/beans/PropertyEditor/TestColorClassJava.java java/beans/PropertyEditor/TestColorClass.java java/beans/PropertyEditor/TestColorClassNull.java java/beans/PropertyEditor/TestColorClassValue.java java/beans/PropertyEditor/TestFontClassJava.java java/beans/PropertyEditor/TestFontClass.java java/beans/PropertyEditor/TestFontClassNull.java java/beans/PropertyEditor/TestFontClassValue.java java/beans/XMLEncoder/java_awt_ScrollPane.java sun/tools/jhsdb/JShellHeapDumpTest.java sun/tools/jhsdb/HeapDumpTestWithActiveProcess.java sun/tools/jhsdb/JShellHeapDumpTest.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 0   FAILED: 1   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 0; failed: 13; error: 0; skipped: 0 
1..1
not ok 1 - jdk_custom_0
  ---
    output:
      |
        Failed test cases: 
        TEST: java/beans/PropertyEditor/6380849/TestPropertyEditor.java
        TEST: java/beans/PropertyEditor/TestColorClassJava.java
        TEST: java/beans/PropertyEditor/TestColorClass.java
        TEST: java/beans/PropertyEditor/TestColorClassNull.java
        TEST: java/beans/PropertyEditor/TestColorClassValue.java
        TEST: java/beans/PropertyEditor/TestFontClass.java
        TEST: java/beans/PropertyEditor/TestFontClassJava.java
        TEST: java/beans/PropertyEditor/TestFontClassValue.java
        TEST: java/beans/PropertyEditor/TestFontClassNull.java
        TEST: javax/imageio/plugins/jpeg/JPEGsNotAcceleratedTest.java
        TEST: java/beans/XMLEncoder/java_awt_ScrollPane.java
        TEST: sun/tools/jhsdb/HeapDumpTestWithActiveProcess.java
        TEST: sun/tools/jhsdb/JShellHeapDumpTest.java
        Test results: failed: 13
    duration_ms: 46050
  ...
smlambert commented 1 month ago

aarch64_linux ✔️

extended.openjdk had 17 testcases failing in original, passing in rerun:

# 
# Timestamp: Fri Jul 12 22:42:20 2024 UTC 
# CUSTOM_TARGET: javax/imageio/plugins/shared/ImageWriterCompressionTest.java tools/jpackage/linux/AppAboutUrlTest.java#id0 tools/jpackage/linux/AppCategoryTest.java tools/jpackage/linux/LinuxResourceTest.java tools/jpackage/linux/LinuxBundleNameTest.java tools/jpackage/linux/MaintainerTest.java tools/jpackage/linux/PackageDepsTest.java tools/jpackage/linux/ReleaseTest.java tools/jpackage/linux/jdk/jpackage/tests/UsrTreeTest.java tools/jpackage/linux/ShortcutHintTest.java#id0 tools/jpackage/share/AppImagePackageTest.java tools/jpackage/share/EmptyFolderPackageTest.java tools/jpackage/share/AddLauncherTest.java#id1 tools/jpackage/share/LicenseTest.java#id1 tools/jpackage/share/FileAssociationsTest.java#id0 tools/jpackage/linux/AppAboutUrlTest.java#id0 tools/jpackage/linux/AppCategoryTest.java tools/jpackage/linux/LinuxResourceTest.java tools/jpackage/linux/LinuxBundleNameTest.java tools/jpackage/linux/PackageDepsTest.java tools/jpackage/linux/MaintainerTest.java tools/jpackage/linux/jdk/jpackage/tests/UsrTreeTest.java tools/jpackage/linux/ReleaseTest.java tools/jpackage/linux/ShortcutHintTest.java#id0 tools/jpackage/share/AppImagePackageTest.java tools/jpackage/share/EmptyFolderPackageTest.java tools/jpackage/share/AddLauncherTest.java#id1 tools/jpackage/share/LicenseTest.java#id1 tools/jpackage/share/FileAssociationsTest.java#id0 java/net/httpclient/BufferingSubscriberTest.java sun/security/ec/ed/EdDSATest.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 1   FAILED: 0   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 17; failed: 0; error: 0; skipped: 0 
1..1
ok 1 - jdk_custom_0
  ---
    output:
      |
        Test results: passed: 17
    duration_ms: 3259345
  ...
smlambert commented 1 month ago

x86-64_alpine-linux

still running

smlambert commented 1 month ago

ppc64le_linux ✔️

2 testcases failed in original, passed in rerun

# Timestamp: Fri Jul 12 16:58:03 2024 UTC 
# CUSTOM_TARGET: jdk/incubator/vector/AddTest.java jdk/incubator/vector/Vector128ConversionTests.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 1   FAILED: 0   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 2; failed: 0; error: 0; skipped: 0 
1..1
ok 1 - jdk_custom_0
  ---
    output:
      |
        Test results: passed: 2
    duration_ms: 633140
  ...
smlambert commented 1 month ago

s390x_linux ✔️

sanity.system, 9 test targets failed in original (on test-marist-sles15-s390x-2.adoptopenjdk.net), pass on rerun on test-marist-ubuntu2204-s390x-1.adoptopenjdk.net (same behaviour seen for jdk21)

# Timestamp: Fri Jul 12 21:55:34 2024 UTC 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 9   EXECUTED: 9   PASSED: 9   FAILED: 0   DISABLED: 0   SKIPPED: 0
1..9

extended.openjdk, 6 targets fail in original, pass on rerun on test-docker-sles15-s390x-1

# Timestamp: Sat Jul 13 01:05:39 2024 UTC 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 6   EXECUTED: 6   PASSED: 6   FAILED: 0   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 3,204; failed: 0; error: 0; skipped: 0 
1..6
smlambert commented 1 month ago

ppc64_aix

extended.openjdk 2 testcases fail in original (test-osuosl-aix72-ppc64-6 and test-osuosl-aix72-ppc64-1, and also fail in rerun on test-osuosl-aix72-ppc64-1

# Timestamp: Sat Jul 13 03:23:31 2024 UTC 
# CUSTOM_TARGET: javax/management/mxbean/ThreadStartTest.java javax/management/mxbean/ThreadStartTest.java java/net/httpclient/StreamingBody.java 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 1   EXECUTED: 1   PASSED: 0   FAILED: 1   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 0; failed: 2; error: 0; skipped: 0 
1..1
not ok 1 - jdk_custom_0
  ---
    output:
      |
        Failed test cases: 
        TEST: java/net/httpclient/StreamingBody.java
        TEST: javax/management/mxbean/ThreadStartTest.java
        Test results: failed: 2
    duration_ms: 77780
  ...

Rerun them in Grinder/10588

smlambert commented 1 month ago

x86-32_windows ⏳

extended.openjdk, 4 targets fail in original on build-azure-win2022-x64-3, also fail in rerun (on build-azure-win2022-x64-3)

# Timestamp: Sat Jul 13 08:33:01 2024 UTC 
# TEST TARGETS RESULTS SUMMARY: TOTAL: 4   EXECUTED: 4   PASSED: 0   FAILED: 4   DISABLED: 0   SKIPPED: 0
# TESTCASES RESULTS SUMMARY: passed: 1,710; failed: 14; error: 0; skipped: 0 
1..4
not ok 1 - jvm_compiler_2
  ---
    output:
      |
        Failed test cases: 
        TEST: compiler/arguments/CheckCICompilerCount.java
        Test results: passed: 914; failed: 1
    duration_ms: 18555260
  ...
not ok 2 - jdk_beans_2
  ---
    output:
      |
        Failed test cases: 
        TEST: java/beans/PropertyEditor/6380849/TestPropertyEditor.java
        TEST: java/beans/PropertyEditor/TestColorClass.java
        TEST: java/beans/PropertyEditor/TestColorClassJava.java
        TEST: java/beans/PropertyEditor/TestColorClassNull.java
        TEST: java/beans/PropertyEditor/TestColorClassValue.java
        TEST: java/beans/PropertyEditor/TestFontClassJava.java
        TEST: java/beans/PropertyEditor/TestFontClass.java
        TEST: java/beans/PropertyEditor/TestFontClassNull.java
        TEST: java/beans/PropertyEditor/TestFontClassValue.java
        TEST: java/beans/XMLEncoder/java_awt_ScrollPane.java
        Test results: passed: 354; failed: 10
    duration_ms: 589613
  ...
not ok 3 - jdk_tools_2
  ---
    output:
      |
        Failed test cases: 
        TEST: sun/tools/jhsdb/HeapDumpTestWithActiveProcess.java
        TEST: sun/tools/jhsdb/JShellHeapDumpTest.java
        Test results: passed: 243; failed: 2
    duration_ms: 1086613
  ...
not ok 4 - jdk_imageio_2
  ---
    output:
      |
        Failed test cases: 
        TEST: javax/imageio/plugins/jpeg/JPEGsNotAcceleratedTest.java
        Test results: passed: 199; failed: 1
    duration_ms: 197492
  ...

JPEGsNotAcceleratedTest.java throws: 

java.awt.HeadlessException: 
The application does not have desktop access,
but this program performed an operation which requires it.
    at java.desktop/java.awt.GraphicsEnvironment.checkHeadless(GraphicsEnvironment.java:164)
    at java.desktop/java.awt.Window.<init>(Window.java:553)
    at java.desktop/java.awt.Frame.<init>(Frame.java:428)
    at java.desktop/java.awt.Frame.<init>(Frame.java:393)
    at JPEGsNotAcceleratedTest.main(JPEGsNotAcceleratedTest.java:307)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.base/java.lang.reflect.Method.invoke(Method.java:569)
    at com.sun.javatest.regtest.agent.MainWrapper$MainTask.run(MainWrapper.java:138)
    at java.base/java.lang.Thread.run(Thread.java:840)

JavaTest Message: Test threw exception: java.awt.HeadlessException: 
The application does not have desktop access,
but this program performed an operation which requires it.
JavaTest Message: shutting down test

STATUS:Failed.`main' threw exception: java.awt.HeadlessException: The application does not have desktop access, but this program performed an operation which requires it.

jdk_beans give this type of failure (also seen for x64 windows for JDK21):

java.lang.Error: could not find editor for class java.awt.Color
    at TestEditor.<init>(TestEditor.java:35)
    at TestColorClassJava.main(TestColorClassJava.java:39)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.base/java.lang.reflect.Method.invoke(Method.java:569)
    at com.sun.javatest.regtest.agent.MainWrapper$MainTask.run(MainWrapper.java:138)
    at java.base/java.lang.Thread.run(Thread.java:840)

JavaTest Message: Test threw exception: java.lang.Error: could not find editor for class java.awt.Color
JavaTest Message: shutting down test

STATUS:Failed.`main' threw exception: java.lang.Error: could not find editor for class java.awt.Color
smlambert commented 1 month ago

arm_linux

Failure to uncompress the JDK binary on test-docker-ubuntu2404-armv7l-1, see https://ci.adoptium.net/job/Test_openjdk17_hs_extended.system_arm_linux/380/

06:05:39  Uncompressing file: OpenJDK17U-jdk_arm_linux_hotspot_17.0.12_5.tar.gz ...
06:05:43  tar: jdk-17.0.12+5/legal/jdk.hotspot.agent/LICENSE: Cannot change mode to rwxrwxr-x: Operation not permitted
06:05:43  tar: jdk-17.0.12+5/legal/jdk.hotspot.agent/ADDITIONAL_LICENSE_INFO: Cannot change mode to rwxrwxr-x: Operation not permitted
...
smlambert commented 1 month ago

riscv64_linux

Failures in child test jobs, parent at https://ci.adoptium.net/job/Test_openjdk17_hs_extended.openjdk_riscv64_linux/27/

jiekang commented 1 month ago

x86-64_windows

https://trss.adoptium.net/allTestsInfo?buildId=669288f0d24e1b006e205b05&limit=5&hasChildren=true

jdk_beans_1 test-azure-win2022-x64-1

Likely same headless issue as for jdk 21 https://github.com/adoptium/aqa-tests/issues/5437#issuecomment-2228548692

jdk_imageio_0 test-azure-win2022-x64-1

Likely same headless issue as for jdk 21 https://github.com/adoptium/aqa-tests/issues/5437#issuecomment-2228548692

jdk_imageio_1 test-azure-win2022-x64-1

Likely same headless issue as for jdk 21 https://github.com/adoptium/aqa-tests/issues/5437#issuecomment-2228548692

jdk_beans_0 test-azure-win2022-x64-3

Likely same headless issue as for jdk 21 https://github.com/adoptium/aqa-tests/issues/5437#issuecomment-2228548692

jdk_tools_0 test-azure-win2022-x64-3

JShellHeapDumpTest

Issue with debug attach? Permissions? May work on win2019 machines based on JDK 21 runs.

[2024-07-12T11:36:36.628Z] Error attaching to process: Windbg Error: WaitForEvent failed! (hr: 0x80004002)
[2024-07-12T11:36:36.628Z] sun.jvm.hotspot.debugger.DebuggerException: Windbg Error: WaitForEvent failed! (hr: 0x80004002)
...
[2024-07-12T11:36:36.629Z] [JShell] jshell> Exception in thread "main" java.io.IOError: java.io.IOException: The pipe is being closed
[2024-07-12T11:36:36.629Z] [JShell]     at jdk.internal.le/jdk.internal.org.jline.keymap.BindingReader.readCharacter(BindingReader.java:170)

jdk_tools_1 test-azure-win2022-x64-3

Same as jdk_tool_0

smlambert commented 1 month ago

Closing as we head into actual release triage.