Promote AdoptOpenJDK Version jdk-15.0.1+9

re: https://github.com/AdoptOpenJDK/TSC/issues/180#issuecomment-715264753 jdk_foreign is part of the sanity.openjdk set because sanity.openjdk is equivalent to tier1 tests at the OpenJDK project

Looks like that target which contains 19 testcases was passing until now (where now 2/19 testcases fail):

So that failure requires triage to understand why it now fails (is it an infra/test/product issue?)

From a quick look at 1 of the 2 failing testcases, TestSlices looks like not enough space issue:

In which case predict that on rerun this testcase would pass and is susceptible to intermittent failures at the mercy of the machine environment, failure is non-blocking. Ideally testcases would check if their requirements can be met before they run, but we see that some openjdk test material is not pro-active/defensive in that way.

andrew-m-leonard commented 3 years ago

openj9: aarch64XL: Tests all good apart from usual intermittent Jlm failures:

4:23:43  FAILED test targets:
14:23:43    TestJlmRemoteClassAuth_0
14:23:43    TestJlmRemoteMemoryAuth_0
14:23:43    TestJlmRemoteNotifierProxyAuth_0
14:23:43    TestJlmRemoteThreadAuth_0
14:23:43    TestIBMJlmRemoteMemoryAuth_0

sanity.openjdk_ppc64le_linux:

Exitsing issue: https://github.com/eclipse/openj9/issues/10256

pshipton commented 3 years ago

lgtm, no concerns publishing this release.

andrew-m-leonard commented 3 years ago

jdk-15.0.1+9_openj9-0.23.0 is clear for Publish, pipelines to publish: Aarch64 EA :https://ci.adoptopenjdk.net/job/build-scripts/job/openjdk15-pipeline/340/ Others: https://ci.adoptopenjdk.net/job/build-scripts/job/openjdk15-pipeline/335/

gdams commented 3 years ago

JDK15 hotspot re-run:

TRSS link Build URL https://ci.adoptopenjdk.net/job/build-scripts/job/openjdk15-pipeline/341/ Started by user George Adams

Test_openjdk15_hs_extended.system_aarch64_linux MathLoadTest_all_0 => deep history 0/6 passed LockingLoadTest_0 => deep history 0/6 passed

Test_openjdk15_hs_sanity.openjdk_aarch64_linux jdk_lang_0 => deep history 4/11 passed jdk_util_0 => deep history 4/11 passed

Test_openjdk15_hs_sanity.openjdk_x86-64_linux jdk_util_0 => deep history 8/13 passed jdk_foreign_0 => deep history 9/13 passed

Test_openjdk15_hs_sanity.system_aarch64_linux MauveSingleThreadLoadTest_HotSpot_0 => deep history 0/6 passed MauveSingleInvocationLoadTest_HotSpot_0 => deep history 0/6 passed MauveMultiThreadLoadTest_0 => deep history 0/6 passed

smlambert commented 3 years ago

The sanity.openjdk (jdk_lang and jdk_util) failures fail with: Unable to map CDS archive -- os::vm_allocation_granularity() expected: 4096 actual: 65536

Had not seen that before in openjdk tests, but we have seen before in system test failures on that platform. Not sure if it's correlated to running on certain machines or not.

andrew-m-leonard commented 3 years ago

OpenJ9 jdk15 shipped.

smlambert commented 3 years ago

For hotspot, the MathLoadTest_all issue has been around a while, https://github.com/AdoptOpenJDK/openjdk-tests/issues/1893.

There is some recent new info, based on investigation by OpenJ9 team on a different math issue and some digging by @pshipton and @lumpfish ... Hotspot is not as precise in its Math answers as this test material expects or as a StrictMath answer. Java spec does not require an implementation to have Math answer match a StrictMath answer (to same precision).

We will have to decide if we update test material accordingly.

smlambert commented 3 years ago

Rerunning jdk_lang and jdk_util on non-aws aarch64 machines (suspect the failures are machine related). jdk_lang rerun: https://ci.adoptopenjdk.net/job/Test_openjdk15_hs_sanity.openjdk_aarch64_linux/82 jdk_util rerun: https://ci.adoptopenjdk.net/job/Test_openjdk15_hs_sanity.openjdk_aarch64_linux/84

Since jdk_util rerun saw the original failure pass, but a new failure seen: java.lang.RuntimeException: FAILED: Pacific/Fiji at TestZoneInfo310.main(TestZoneInfo310.java:204)

I have kicked off a couple of Grinders (2x4 nodesByIterations): https://ci.adoptopenjdk.net/job/Grinder/4300/ Node1=test-aws-rhel76-armv8-5, jdk_util 4x Grinder Node2=test-aws-rhel76-armv8-3, jdk_util 4x Grinder

gdams commented 3 years ago

JDK15 hotspot shipped

gdams commented 3 years ago

JDK15 OpenJ9 macOS re-spin:

TRSS link Build URL https://ci.adoptopenjdk.net/job/build-scripts/job/openjdk15-pipeline/343/ Started by user George Adams

NO TEST FAILURES

AdoptOpenJDK / TSC

Promote AdoptOpenJDK Version jdk-15.0.1+9 #180

⚠️ jdk15u-windows-x64-hotspot has a build result of FAILURE ⚠️