eclipse-openj9 / openj9

Eclipse OpenJ9: A Java Virtual Machine for OpenJDK that's optimized for small footprint, fast start-up, and high throughput. Builds on Eclipse OMR (https://github.com/eclipse/omr) and combines with the Extensions for OpenJDK for OpenJ9 repo.
Other
3.27k stars 721 forks source link

Unexpected exit from test [exit code: 137] #15508

Open JasonFengJ9 opened 2 years ago

JasonFengJ9 commented 2 years ago

Failure link

From an internal build job/Test_openjdk17_j9_sanity.openjdk_x86-64_mac_testList_1/143/(osxrt3):

java version "17.0.4-beta" 2022-07-19
IBM Semeru Runtime Certified Edition 17.0.4+7-202207060403 (build 17.0.4-beta+7-202207060403)
Eclipse OpenJ9 VM 17.0.4+7-202207060403 (build master-a9bdd6d1a, JRE 17 Mac OS X amd64-64-Bit Compressed References 20220706_187 (JIT enabled, AOT enabled)
OpenJ9   - a9bdd6d1a
OMR      - a029645f1
JCL      - f52f804ea based on jdk-17.0.4+7)

Rerun in Grinder - Change TARGET to run only the failed test targets.

Optional info

Failure output (captured from console output)

[2022-07-06T05:45:19.711Z] variation: -Xdump:system:none -Xdump:heap:none -Xdump:system:events=gpf+abort+traceassert+corruptcache Mode650
[2022-07-06T05:45:19.711Z] JVM_OPTIONS:  -Xdump:system:none -Xdump:heap:none -Xdump:system:events=gpf+abort+traceassert+corruptcache -XX:-UseCompressedOops 

[2022-07-06T06:00:24.519Z] TEST RESULT: Failed. Unexpected exit from test [exit code: 137]
[2022-07-06T06:00:24.519Z] --------------------------------------------------
[2022-07-06T06:13:01.459Z] Test results: passed: 890; failed: 1
[2022-07-06T06:13:25.354Z] Report written to /Users/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_x86-64_mac_testList_1/jvmtest/openjdk/report/html/report.html
[2022-07-06T06:13:25.354Z] Results written to /Users/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_x86-64_mac_testList_1/aqa-tests/TKG/output_16570837819607/jdk_util_1/work
[2022-07-06T06:13:25.354Z] Error: Some tests failed or other problems occurred.
[2022-07-06T06:13:25.354Z] 
[2022-07-06T06:13:25.354Z] jdk_util_1_FAILED

job/Test_openjdk17_j9_sanity.openjdk_x86-64_mac_testList_1/143/

[2022-07-06T05:13:05.125Z] TEST RESULT: Failed. Unexpected exit from test [exit code: 137]
[2022-07-06T05:13:05.125Z] --------------------------------------------------
[2022-07-06T05:26:48.197Z] Test results: passed: 786; failed: 2
[2022-07-06T05:27:29.970Z] Report written to /Users/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_x86-64_mac_testList_1/jvmtest/openjdk/report/html/report.html
[2022-07-06T05:27:29.970Z] Results written to /Users/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_x86-64_mac_testList_1/aqa-tests/TKG/output_16570837819607/jdk_lang_1/work
[2022-07-06T05:27:29.970Z] Error: Some tests failed or other problems occurred.
[2022-07-06T05:27:29.970Z] 
[2022-07-06T05:27:29.970Z] jdk_lang_1_FAILED

job/Test_openjdk17_j9_special.system_s390x_linux_testList_3/208/(ub18s390xrt-1-3)

java version "17.0.4-beta" 2022-07-19
IBM Semeru Runtime Certified Edition 17.0.4+7-202207060405 (build 17.0.4-beta+7-202207060405)
Eclipse OpenJ9 VM 17.0.4+7-202207060405 (build master-a9bdd6d1a, JRE 17 Linux s390x-64-Bit Compressed References 20220705_181 (JIT enabled, AOT enabled)
OpenJ9   - a9bdd6d1a
OMR      - a029645f1
JCL      - f52f804ea based on jdk-17.0.4+7)

[2022-07-06T09:54:17.269Z] variation: Mode614
[2022-07-06T09:54:17.269Z] JVM_OPTIONS:  -Xcompressedrefs -Xgcpolicy:gencon -Xjit:counts=- - - - - - 1 1 1 1000 250 250 - - - 10000 100000 10000,gcOnResolve,rtResolve,sampleInterval=2,scorchingSampleThreshold=10000,quickProfile -Xmn512k -Xcheck:gc:vmthreads:all:quiet 

[2022-07-06T09:57:08.730Z] STF 02:56:53.140 - **FAILED** Process DLT ended with exit code (137) and not the expected exit code/s (0)
[2022-07-06T09:57:08.730Z] STF 02:56:53.144 - Monitoring Report Summary:
[2022-07-06T09:57:08.730Z] STF 02:56:53.153 -   o Process DLT ended with exit code (137) and not the expected exit code/s (0)
[2022-07-06T09:57:08.730Z] STF 02:56:53.300 - Killing processes: DLT
[2022-07-06T09:57:08.730Z] STF 02:56:53.302 -   o Process DLT pid 24156 is not running
[2022-07-06T09:57:08.730Z] **FAILED** at step 1 (Run daa load test). Expected return value=0 Actual=1 at /home/jenkins/workspace/Test_openjdk17_j9_special.system_s390x_linux_testList_3/aqa-tests/TKG/../TKG/output_1657083387115/DaaLoadTest_all_special_5m_20/20220706-025417-DaaLoadTest/execute.pl line 118.
[2022-07-06T09:57:08.730Z] STF 02:56:54.053 - **FAILED** execute script failed. Expected return value=0 Actual=1
[2022-07-06T09:57:08.730Z] STF 02:56:54.062 - 
[2022-07-06T09:57:08.730Z] STF 02:56:54.068 - ====================   T E A R D O W N   ====================
[2022-07-06T09:57:08.730Z] STF 02:56:54.069 - Running teardown: perl /home/jenkins/workspace/Test_openjdk17_j9_special.system_s390x_linux_testList_3/aqa-tests/TKG/../TKG/output_1657083387115/DaaLoadTest_all_special_5m_20/20220706-025417-DaaLoadTest/tearDown.pl
[2022-07-06T09:57:08.730Z] STF 02:56:54.408 - TEARDOWN stage completed
[2022-07-06T09:57:08.730Z] STF 02:56:54.417 - 
[2022-07-06T09:57:08.730Z] STF 02:56:54.418 - =====================   R E S U L T S   =====================
[2022-07-06T09:57:08.730Z] STF 02:56:54.419 - Stage results:
[2022-07-06T09:57:08.730Z] STF 02:56:54.421 -   setUp:     pass
[2022-07-06T09:57:08.730Z] STF 02:56:54.421 -   execute:  *fail*
[2022-07-06T09:57:08.730Z] STF 02:56:54.421 -   teardown:  pass
[2022-07-06T09:57:08.730Z] STF 02:56:54.422 - 
[2022-07-06T09:57:08.730Z] STF 02:56:54.422 - Overall result: **FAILED**
[2022-07-06T09:57:08.730Z] 
[2022-07-06T09:57:08.730Z] DaaLoadTest_all_special_5m_20_FAILED
pshipton commented 2 years ago

The OpenJDK failures with the following seems like a dup of https://github.com/eclipse-openj9/openj9/issues/13368 java/lang/invoke/VarHandles/VarHandleTestAccessString.java java/lang/invoke/VarHandles/VarHandleTestMethodHandleAccessBoolean.java

The failure with java/util/regex/NegativeArraySize.java is new.

For the special.system failure, I find Killed in the 1.DLT.stderr output. I suspect these are machine resource issues.

JasonFengJ9 commented 2 years ago

An internal build(osxrt3)

openjdk version "1.8.0_352"
IBM Semeru Runtime Open Edition (build 1.8.0_352-b01)
Eclipse OpenJ9 VM (build master-1719d2e01, JRE 1.8.0 Mac OS X amd64-64-Bit Compressed References 20220826_493 (JIT enabled, AOT enabled)
OpenJ9   - 1719d2e01
OMR      - 938f0686f
JCL      - f2a9dfa9c based on jdk8u352-b01)

[2022-08-27T06:56:39.406Z] variation: -Xdump:system:none -Xdump:heap:none -Xdump:system:events=gpf+abort+traceassert+corruptcache Mode650
[2022-08-27T06:56:39.406Z] JVM_OPTIONS:  -Xdump:system:none -Xdump:heap:none -Xdump:system:events=gpf+abort+traceassert+corruptcache -XX:-UseCompressedOops 

[2022-08-27T06:59:32.454Z] TEST: java/math/BigInteger/LargeValueExceptions.java

[2022-08-27T06:59:32.455Z] TEST RESULT: Failed. Unexpected exit from test [exit code: 137]
[2022-08-27T06:59:32.455Z] --------------------------------------------------
[2022-08-27T06:59:32.455Z] Test results: passed: 36; failed: 1
[2022-08-27T06:59:42.016Z] Report written to /Users/jenkins/workspace/Test_openjdk8_j9_sanity.openjdk_x86-64_mac_testList_1/aqa-tests/TKG/output_16615831174952/jdk_math_1/report/html/report.html
[2022-08-27T06:59:42.016Z] Results written to /Users/jenkins/workspace/Test_openjdk8_j9_sanity.openjdk_x86-64_mac_testList_1/aqa-tests/TKG/output_16615831174952/jdk_math_1/work
[2022-08-27T06:59:42.016Z] Error: Some tests failed or other problems occurred.
[2022-08-27T06:59:42.016Z] 
[2022-08-27T06:59:42.016Z] jdk_math_1_FAILED
pshipton commented 2 years ago

Seems like it could be a machine issue, before the test output is

 Cannot contact osxrt3.rtp.raleigh.ibm.com: hudson.remoting.ChannelClosedException: Channel "hudson.remoting.Channel@3d3e8796:osxrt3.rtp.raleigh.ibm.com": Remote call on osxrt3.rtp.raleigh.ibm.com failed. The channel is closing down or has closed down
JasonFengJ9 commented 2 years ago

hudson.remoting.ChannelClosedException occurred before running java/math/BigInteger/LargeValueExceptions.java, I think the machine/network recovered otherwise the test won't be able to run.

pshipton commented 2 years ago

I suspect it didn't properly recover in order to complete java/math/BigInteger/LargeValueExceptions.java successfully and that's why Unexpected exit from test [exit code: 137]. Can the failure be reproduced?

JasonFengJ9 commented 2 years ago

50x internal grinder - all passed

JasonFengJ9 commented 1 year ago

JDK20 s390x_linux 0.39(ub18s390xrt-1-5)

openjdk version "20.0.1" 2023-04-18
IBM Semeru Runtime Open Edition 20.0.1.0-m1 (build 20.0.1+9)
Eclipse OpenJ9 VM 20.0.1.0-m1 (build v0.39.0-release-8f80c760e, JRE 20 Linux s390x-64-Bit Compressed References 20230418_22 (JIT enabled, AOT enabled)
OpenJ9   - 8f80c760e
OMR      - e4f52d2e4
JCL      - c6bbabab95e based on jdk-20.0.1+9)

[2023-05-10T06:26:36.971Z] variation: Mode614
[2023-05-10T06:26:36.971Z] JVM_OPTIONS:  -Xcompressedrefs -Xgcpolicy:gencon -Xjit:counts=- - - - - - 1 1 1 1000 250 250 - - - 10000 100000 10000,gcOnResolve,rtResolve,sampleInterval=2,scorchingSampleThreshold=10000,quickProfile -Xmn512k -Xcheck:gc:vmthreads:all:quiet 

[2023-05-10T06:26:41.918Z] DLT 23:26:41.637 - Starting thread. Suite=0 thread=0
[2023-05-10T06:26:41.918Z] DLT 23:26:41.640 - Starting thread. Suite=0 thread=1
[2023-05-10T06:28:25.336Z] DLT stderr Killed
[2023-05-10T06:28:25.336Z] STF 23:28:21.483 - **FAILED** Process DLT ended with exit code (137) and not the expected exit code/s (0)
[2023-05-10T06:28:25.336Z] STF 23:28:21.489 - Monitoring Report Summary:
[2023-05-10T06:28:25.336Z] STF 23:28:21.497 -   o Process DLT ended with exit code (137) and not the expected exit code/s (0)
[2023-05-10T06:28:25.336Z] STF 23:28:21.579 - Killing processes: DLT
[2023-05-10T06:28:25.336Z] STF 23:28:21.581 -   o Process DLT pid 32045 is not running
[2023-05-10T06:28:25.336Z] **FAILED** at step 1 (Run daa load test). Expected return value=0 Actual=1 at /home/jenkins/workspace/Test_openjdk20_j9_special.system_s390x_linux_testList_4/aqa-tests/TKG/../TKG/output_16836839988426/DaaLoadTest_all_special_5m_20/20230509-232636-DaaLoadTest/execute.pl line 118.
[2023-05-10T06:28:25.336Z] STF 23:28:22.558 - **FAILED** execute script failed. Expected return value=0 Actual=1
[2023-05-10T06:28:25.336Z] STF 23:28:22.567 - 
[2023-05-10T06:28:25.336Z] STF 23:28:22.574 - ====================   T E A R D O W N   ====================
[2023-05-10T06:28:25.336Z] STF 23:28:22.574 - Running teardown: perl /home/jenkins/workspace/Test_openjdk20_j9_special.system_s390x_linux_testList_4/aqa-tests/TKG/../TKG/output_16836839988426/DaaLoadTest_all_special_5m_20/20230509-232636-DaaLoadTest/tearDown.pl
[2023-05-10T06:28:25.336Z] STF 23:28:22.865 - TEARDOWN stage completed
[2023-05-10T06:28:25.336Z] STF 23:28:22.872 - 
[2023-05-10T06:28:25.336Z] STF 23:28:22.872 - =====================   R E S U L T S   =====================
[2023-05-10T06:28:25.336Z] STF 23:28:22.874 - Stage results:
[2023-05-10T06:28:25.336Z] STF 23:28:22.876 -   setUp:     pass
[2023-05-10T06:28:25.336Z] STF 23:28:22.878 -   execute:  *fail*
[2023-05-10T06:28:25.336Z] STF 23:28:22.878 -   teardown:  pass
[2023-05-10T06:28:25.336Z] STF 23:28:22.878 - 
[2023-05-10T06:28:25.336Z] STF 23:28:22.878 - Overall result: **FAILED**
[2023-05-10T06:28:25.336Z] -----------------------------------
[2023-05-10T06:28:25.336Z] DaaLoadTest_all_special_5m_20_FAILED