search

adoptium / aqa-tests

Home of test infrastructure for Adoptium builds
https://adoptium.net/aqavit
Apache License 2.0
131 stars 312 forks source link

Extended.system tests failed with jdk20 from enabled. #4428

Closed sophia-guo closed 1 year ago

sophia-guo commented 1 year ago

aarch64_linux

Test_openjdk20_hs_extended.system_aarch64_linux ⚠️ UNSTABLE ⚠️ Rerun failed

java -version MiniMix_5m_1 => deep history 0/7 passed | possible issues MiniMix_5m_0 => deep history 0/7 passed | possible issues MiniMix_aot_5m_0 => deep history 0/7 passed | possible issues HCRLateAttachWorkload_previewEnabled_1 => deep history 0/7 passed | possible issues HCRLateAttachWorkload_previewEnabled_0 => deep history 1/7 passed | possible issues rerun: https://ci.adoptium.net/job/Grinder/6866/ --failed.

Same for aarch64_mac Test_openjdk20_hs_extended.system_aarch64_mac ⚠️ UNSTABLE ⚠️ Rerun failed

java -version MiniMix_5m_0 => deep history 0/9 passed | possible issues MiniMix_5m_1 => deep history 0/9 passed | possible issues MiniMix_aot_5m_0 => deep history 0/9 passed | possible issues HCRLateAttachWorkload_previewEnabled_0 => deep history 0/9 passed | possible issues HCRLateAttachWorkload_previewEnabled_1 => deep history 0/9 passed | possible issues

Similar to other platforms. Generic one.

smlambert commented 1 year ago

Check if these are similar to or related to these other recent issues (which have been fixed): https://github.com/adoptium/aqa-systemtest/pull/480 https://github.com/adoptium/aqa-systemtest/pull/481

sophia-guo commented 1 year ago

Not the same according to the output. Both https://github.com/adoptium/aqa-systemtest/pull/480 and https://github.com/adoptium/aqa-systemtest/pull/481 were merged in a few weeks ago. Those tests failed with jdk20 since jdk20 test jobs enabled. Failed with both aqa-tests master or v0.9.6.

smlambert commented 1 year ago

Minimix contains Mauve tests, so that is why I thought there may be similarities and also https://github.com/eclipse-openj9/openj9-systemtest/issues/147#issuecomment-1423455810

smlambert commented 1 year ago

Ya, I see it is a different failure:

[2023-03-12T13:12:25.948Z] LT  JUnit Test Results for: net.adoptopenjdk.test.bigdecimal.TestSuite002
[2023-03-12T13:12:25.948Z] LT    Ran    : 935
[2023-03-12T13:12:25.948Z] LT    Passed : 933
[2023-03-12T13:12:25.948Z] LT    Failed : 2
[2023-03-12T13:12:25.948Z] LT    Ignored: 0
[2023-03-12T13:12:25.948Z] LT    Result : FAILED
sophia-guo commented 1 year ago

HCRLateAttachWorkload_previewEnabled https://github.com/adoptium/aqa-systemtest/issues/479

Others see https://github.com/adoptium/aqa-systemtest/issues/482

Mesbah-Alam commented 1 year ago

Similar : https://github.com/eclipse-openj9/openj9-systemtest/issues/148.

Math API tests, (e.g. bigdecimal) are giving unusual results when run on OpenJ9 JDK20. The failures are also evident in Adoptium JDK20.

smlambert commented 1 year ago

bigdecimal issue summarized here: https://github.com/adoptium/aqa-systemtest/issues/482

Mesbah-Alam commented 1 year ago

https://github.com/adoptium/aqa-systemtest/pull/483 should fix the failures related to bigdecimal (e.g. MiniMix_5m).

sophia-guo commented 1 year ago

Closed by https://github.com/adoptium/aqa-systemtest/pull/483

Mesbah-Alam commented 1 year ago

Hi @sophia-guo , I don't think https://github.com/adoptium/aqa-systemtest/pull/483 would fix errors you see in system tests that don't run bigdecimal tests , e.g. HCRLateAttachWorkload_previewEnabled_0. They are likely failing due to some other reasons.

sophia-guo commented 1 year ago

@Mesbah-Alam

HCRLateAttachWorkload_previewEnabled_0. see comment

https://github.com/adoptium/aqa-tests/issues/4428#issuecomment-1474399642