Open pshipton opened 3 years ago
@knn-k
I ran the test on cent7-aarch64-1 using the 0.23 m2 binary more than 20 times, but I could not reproduce it.
I ran the test 30 more times, and I saw no failures.
Seeing it in last 2 Adopt nightly builds:
Test Info Test Name: jdk_util_j9_0 Test Duration: 44 min 58 sec Machine: test-aws-rhel76-armv8-3 TRSS link for the test output: https://trss.adoptopenjdk.net/output/test?id=5f86f7e111d26031c10c6c74
Build Info Build Name: Test_openjdk15_j9_sanity.openjdk_aarch64_linux_xl Jenkins Build start time: Oct 14 2020, 05:23 am Jenkins Build URL: https://ci.adoptopenjdk.net/job/Test_openjdk15_j9_sanity.openjdk_aarch64_linux_xl/53/ TRSS link for the build: https://trss.adoptopenjdk.net/allTestsInfo?buildId=5f86f75f11d26031c10c679c
Java Version openjdk version "15" 2020-09-15 OpenJDK Runtime Environment Openj9 (build 15+36-202010140839) Eclipse OpenJ9 VM Openj9 (build master-ff0dde998, JRE 15 Linux aarch64-64-Bit 20201014_70 (JIT enabled, AOT enabled) OpenJ9 - ff0dde998 OMR - b406ab284 JCL - c52d2e0810 based on jdk-15+36)
This test has been failed 2 times since Oct 12 2020, 05:12 pm Java Version when the issue first seen openjdk version "15" 2020-09-15 OpenJDK Runtime Environment Openj9 (build 15+36-202010122034) Eclipse OpenJ9 VM Openj9 (build master-1e0f329b6, JRE 15 Linux aarch64-64-Bit 20201012_69 (JIT enabled, AOT enabled) OpenJ9 - 1e0f329b6 OMR - cfd55882d JCL - c52d2e0810 based on jdk-15+36) Jenkins Build URL: https://ci.adoptopenjdk.net/job/Test_openjdk15_j9_sanity.openjdk_aarch64_linux_xl/52/
The test failed on machine test-aws-rhel76-armv8-3 2 times
Git Diff of first seen failure and last success https://github.com/eclipse/openj9/compare/ad71f4fa5...1e0f329b6
Can I ask for an access to test-aws-rhel76-armv8-3? I cannot reproduce the failure on my own device nor on cent7-aarch64-1.
TEST RESULT: Failed. Unexpected exit from test [exit code: 137]
This means java process was killed by SIGKILL. I am not sure why this happened, but I think possibly kernel OOM killer was related. https://tldp.org/LDP/abs/html/exitcodes.html https://wiki.jenkins.io/display/JENKINS/I'm+getting+OutOfMemoryError
Can somebody check if there is any suspicious log in dmesg or Jenkins log?
I ran this test on test-aws-rhel76-armv8-3 using the 0.23.0 m2 binary more than 50 times, and got no failures.
Seen on x86-64_linux jdk16 build:
openjdk version "16" 2021-03-16
OpenJDK Runtime Environment AdoptOpenJDK-16+36 (build 16+36)
Eclipse OpenJ9 VM AdoptOpenJDK-16+36 (build master-ee83667b9, JRE 16 Linux amd64-64-Bit Compressed References 20210411_17 (JIT enabled, AOT enabled)
OpenJ9 - ee83667b9
OMR - d7a31696c
JCL - 073accb86d based on jdk-16+36)
Test machine: test-packet-ubuntu1604-x64-1
The jdk_util_0 variation with -XX:+UseCompressedOops failed.
Job link: https://ci.adoptopenjdk.net/job/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/60/consoleFull
Output of failing test:
08:09:56 TEST: java/util/StringJoiner/MergeTest.java
08:09:56 TEST JDK: /home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdkbinary/j2sdk-image
08:09:56
08:09:56 ACTION: build -- Passed. Build successful
08:09:56 REASON: Named class compiled on demand
08:09:56 TIME: 0.119 seconds
08:09:56 messages:
08:09:56 command: build MergeTest
08:09:56 reason: Named class compiled on demand
08:09:56 Test directory:
08:09:56 compile: MergeTest
08:09:56 elapsed time (seconds): 0.119
08:09:56
08:09:56 ACTION: compile -- Passed. Compilation successful
08:09:56 REASON: .class file out of date or does not exist
08:09:56 TIME: 0.119 seconds
08:09:56 messages:
08:09:56 command: compile /home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/openjdk/openjdk-jdk/test/jdk/java/util/StringJoiner/MergeTest.java
08:09:56 reason: .class file out of date or does not exist
08:09:56 Additional options from @modules: --add-modules java.base --add-exports java.base/jdk.internal.util=ALL-UNNAMED
08:09:56 Mode: agentvm
08:09:56 Agent id: 1
08:09:56 elapsed time (seconds): 0.119
08:09:56 configuration:
08:09:56 Boot Layer (javac runtime environment)
08:09:56 class path: /home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/jvmtest/openjdk/jtreg/lib/javatest.jar
08:09:56 /home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/jvmtest/openjdk/jtreg/lib/jtreg.jar
08:09:56 patch: java.base /home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/TKG/output_16181185675838/jdk_util_0/work/patches/java.base
08:09:56
08:09:56 javac compilation environment
08:09:56 add modules: java.base
08:09:56 add exports: java.base/jdk.internal.util ALL-UNNAMED
08:09:56 source path: /home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/openjdk/openjdk-jdk/test/jdk/java/util/StringJoiner
08:09:56 class path: /home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/openjdk/openjdk-jdk/test/jdk/java/util/StringJoiner
08:09:56 /home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/TKG/output_16181185675838/jdk_util_0/work/classes/0/java/util/StringJoiner/MergeTest.d
08:09:56 /home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/jvmtest/openjdk/jtreg/lib/testng.jar
08:09:56 /home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/jvmtest/openjdk/jtreg/lib/jcommander.jar
08:09:56
08:09:56 rerun:
08:09:56 cd /home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/TKG/output_16181185675838/jdk_util_0/work/scratch/0 && \
08:09:56 DISPLAY=:0 \
08:09:56 HOME=/home/jenkins \
08:09:56 LANG=en_US.UTF-8 \
08:09:56 PATH=/bin:/usr/bin:/usr/sbin \
08:09:56 /home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdkbinary/j2sdk-image/bin/javac \
08:09:56 -J-ea \
08:09:56 -J-esa \
08:09:56 -J-Xmx1540m \
08:09:56 -J-Xdump:system:none \
08:09:56 -J-Xdump:heap:none \
08:09:56 -J-Xdump:system:events=gpf+abort+traceassert+corruptcache \
08:09:56 -J-XX:+UseCompressedOops \
08:09:56 -J-Djava.library.path=/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdkbinary/openjdk-test-image/jdk/jtreg/native \
08:09:56 -J-Dtest.vm.opts='-ea -esa -Xmx1540m -Xdump:system:none -Xdump:heap:none -Xdump:system:events=gpf+abort+traceassert+corruptcache -XX:+UseCompressedOops' \
08:09:56 -J-Dtest.tool.vm.opts='-J-ea -J-esa -J-Xmx1540m -J-Xdump:system:none -J-Xdump:heap:none -J-Xdump:system:events=gpf+abort+traceassert+corruptcache -J-XX:+UseCompressedOops' \
08:09:56 -J-Dtest.compiler.opts= \
08:09:56 -J-Dtest.java.opts= \
08:09:56 -J-Dtest.jdk=/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdkbinary/j2sdk-image \
08:09:56 -J-Dcompile.jdk=/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdkbinary/j2sdk-image \
08:09:56 -J-Dtest.timeout.factor=8.0 \
08:09:56 -J-Dtest.nativepath=/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdkbinary/openjdk-test-image/jdk/jtreg/native \
08:09:56 -J-Dtest.root=/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/openjdk/openjdk-jdk/test/jdk \
08:09:56 -J-Dtest.name=java/util/StringJoiner/MergeTest.java \
08:09:56 -J-Dtest.file=/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/openjdk/openjdk-jdk/test/jdk/java/util/StringJoiner/MergeTest.java \
08:09:56 -J-Dtest.src=/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/openjdk/openjdk-jdk/test/jdk/java/util/StringJoiner \
08:09:56 -J-Dtest.src.path=/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/openjdk/openjdk-jdk/test/jdk/java/util/StringJoiner \
08:09:56 -J-Dtest.classes=/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/TKG/output_16181185675838/jdk_util_0/work/classes/0/java/util/StringJoiner/MergeTest.d \
08:09:56 -J-Dtest.class.path=/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/TKG/output_16181185675838/jdk_util_0/work/classes/0/java/util/StringJoiner/MergeTest.d \
08:09:56 -J-Dtest.class.path.prefix=/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/TKG/output_16181185675838/jdk_util_0/work/classes/0/java/util/StringJoiner/MergeTest.d:/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/openjdk/openjdk-jdk/test/jdk/java/util/StringJoiner \
08:09:56 -J-Dtest.modules=java.base/jdk.internal.util \
08:09:56 --add-modules java.base \
08:09:56 --add-exports java.base/jdk.internal.util=ALL-UNNAMED \
08:09:56 -d /home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/TKG/output_16181185675838/jdk_util_0/work/classes/0/java/util/StringJoiner/MergeTest.d \
08:09:56 -sourcepath /home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/openjdk/openjdk-jdk/test/jdk/java/util/StringJoiner \
08:09:56 -classpath /home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/openjdk/openjdk-jdk/test/jdk/java/util/StringJoiner:/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/TKG/output_16181185675838/jdk_util_0/work/classes/0/java/util/StringJoiner/MergeTest.d:/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/jvmtest/openjdk/jtreg/lib/testng.jar:/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/jvmtest/openjdk/jtreg/lib/jcommander.jar /home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/openjdk/openjdk-jdk/test/jdk/java/util/StringJoiner/MergeTest.java
08:09:56
08:09:56 ACTION: testng -- Failed. Unexpected exit from test [exit code: 137]
08:09:56 REASON: User specified action: run testng/othervm -Xmx4g -XX:+CompactStrings MergeTest
08:09:56 TIME: 42.245 seconds
08:09:56 messages:
08:09:56 command: testng -Xmx4g -XX:+CompactStrings MergeTest
08:09:56 reason: User specified action: run testng/othervm -Xmx4g -XX:+CompactStrings MergeTest
08:09:56 Mode: othervm [/othervm specified]
08:09:56 Additional options from @modules: --add-modules java.base --add-exports java.base/jdk.internal.util=ALL-UNNAMED
08:09:56 elapsed time (seconds): 42.245
08:09:56 configuration:
08:09:56 Boot Layer
08:09:56 add modules: java.base
08:09:56 add exports: java.base/jdk.internal.util ALL-UNNAMED
08:09:56
08:09:56 STDOUT:
08:09:56 [TestNG] Running:
08:09:56 java/util/StringJoiner/MergeTest.java
08:09:56
08:09:56 STDERR:
08:09:56 rerun:
08:09:56 cd /home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/TKG/output_16181185675838/jdk_util_0/work/scratch/0 && \
08:09:56 DISPLAY=:0 \
08:09:56 HOME=/home/jenkins \
08:09:56 LANG=en_US.UTF-8 \
08:09:56 PATH=/bin:/usr/bin:/usr/sbin \
08:09:56 CLASSPATH=/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/TKG/output_16181185675838/jdk_util_0/work/classes/0/java/util/StringJoiner/MergeTest.d:/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/openjdk/openjdk-jdk/test/jdk/java/util/StringJoiner:/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/jvmtest/openjdk/jtreg/lib/testng.jar:/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/jvmtest/openjdk/jtreg/lib/jcommander.jar:/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/jvmtest/openjdk/jtreg/lib/javatest.jar:/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/jvmtest/openjdk/jtreg/lib/jtreg.jar \
08:09:56 /home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdkbinary/j2sdk-image/bin/java \
08:09:56 -Dtest.vm.opts='-ea -esa -Xmx1540m -Xdump:system:none -Xdump:heap:none -Xdump:system:events=gpf+abort+traceassert+corruptcache -XX:+UseCompressedOops' \
08:09:56 -Dtest.tool.vm.opts='-J-ea -J-esa -J-Xmx1540m -J-Xdump:system:none -J-Xdump:heap:none -J-Xdump:system:events=gpf+abort+traceassert+corruptcache -J-XX:+UseCompressedOops' \
08:09:56 -Dtest.compiler.opts= \
08:09:56 -Dtest.java.opts= \
08:09:56 -Dtest.jdk=/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdkbinary/j2sdk-image \
08:09:56 -Dcompile.jdk=/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdkbinary/j2sdk-image \
08:09:56 -Dtest.timeout.factor=8.0 \
08:09:56 -Dtest.nativepath=/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdkbinary/openjdk-test-image/jdk/jtreg/native \
08:09:56 -Dtest.root=/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/openjdk/openjdk-jdk/test/jdk \
08:09:56 -Dtest.name=java/util/StringJoiner/MergeTest.java \
08:09:56 -Dtest.file=/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/openjdk/openjdk-jdk/test/jdk/java/util/StringJoiner/MergeTest.java \
08:09:56 -Dtest.src=/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/openjdk/openjdk-jdk/test/jdk/java/util/StringJoiner \
08:09:56 -Dtest.src.path=/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/openjdk/openjdk-jdk/test/jdk/java/util/StringJoiner \
08:09:56 -Dtest.classes=/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/TKG/output_16181185675838/jdk_util_0/work/classes/0/java/util/StringJoiner/MergeTest.d \
08:09:56 -Dtest.class.path=/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/TKG/output_16181185675838/jdk_util_0/work/classes/0/java/util/StringJoiner/MergeTest.d \
08:09:56 -Dtest.class.path.prefix=/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/TKG/output_16181185675838/jdk_util_0/work/classes/0/java/util/StringJoiner/MergeTest.d:/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/openjdk/openjdk-jdk/test/jdk/java/util/StringJoiner \
08:09:56 -Dtest.modules=java.base/jdk.internal.util \
08:09:56 --add-modules java.base \
08:09:56 --add-exports java.base/jdk.internal.util=ALL-UNNAMED \
08:09:56 -ea \
08:09:56 -esa \
08:09:56 -Xmx1540m \
08:09:56 -Xdump:system:none \
08:09:56 -Xdump:heap:none \
08:09:56 -Xdump:system:events=gpf+abort+traceassert+corruptcache \
08:09:56 -XX:+UseCompressedOops \
08:09:56 -Djava.library.path=/home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdkbinary/openjdk-test-image/jdk/jtreg/native \
08:09:56 -Xmx4g \
08:09:56 -XX:+CompactStrings \
08:09:56 com.sun.javatest.regtest.agent.MainWrapper /home/jenkins/workspace/Test_openjdk16_j9_sanity.openjdk_x86-64_linux/openjdk-tests/TKG/output_16181185675838/jdk_util_0/work/java/util/StringJoiner/MergeTest.d/testng.0.jta java/util/StringJoiner/MergeTest.java false MergeTest
08:09:56
08:09:56 TEST RESULT: Failed. Unexpected exit from test [exit code: 137]
08:09:56 --------------------------------------------------
08:14:51 Test results: passed: 869; failed: 1
``
Is the problem re-creatable?
https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_sanity.openjdk_s390x_linux_Release_testList_0/25 - ub20-390-5 jdk_util_1 java/util/StringJoiner/MergeTest.java
05:36:22 -Xmx4g \
05:36:22 -XX:+CompactStrings \
05:36:22 com.sun.javatest.regtest.agent.MainWrapper /home/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_s390x_linux_Release_testList_0/aqa-tests/TKG/output_17052254036257/jdk_util_1/work/java/util/StringJoiner/MergeTest.d/testng.0.jta java/util/StringJoiner/MergeTest.java false MergeTest
05:36:22
05:36:22 TEST RESULT: Failed. Unexpected exit from test [exit code: 137]
I changed the title by removing "aarch64" because the recent two failures were from zlinux.
https://ci.adoptopenjdk.net/job/Test_openjdk15_j9_sanity.openjdk_aarch64_linux/67 (0.23.0 M2 build) java/util/StringJoiner/MergeTest.java test-aws-rhel76-armv8-3