search

eclipse-openj9 / openj9

Eclipse OpenJ9: A Java Virtual Machine for OpenJDK that's optimized for small footprint, fast start-up, and high throughput. Builds on Eclipse OMR (https://github.com/eclipse/omr) and combines with the Extensions for OpenJDK for OpenJ9 repo.
Other
3.29k stars 722 forks source link

OpenJDK java/util/concurrent/tck/JSR166TestCase.java junit test failed, unknown test #17135

Open pshipton opened 1 year ago

pshipton commented 1 year ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk20_j9_sanity.openjdk_x86-64_windows_Nightly/31 jdk_util_0 java/util/concurrent/tck/JSR166TestCase.java

02:55:51  Output overflow:
02:55:51  JT Harness has limited the test output to the text
02:55:51  at the beginning and the end, so that you can see how the
02:55:51  test began, and how it completed.
02:55:51  
02:55:51  If you need to see more of the output from the test,
02:55:51  set the system property javatest.maxOutputSize to a higher
02:55:51  value. The current value is 100000

02:55:51  [ JUnit Containers: found 221, started 221, succeeded 185, failed 0, aborted 0, skipped 0]
02:55:51  [ JUnit Tests: found 4084, started 4063, succeeded 4062, failed 1, aborted 0, skipped 0]
02:55:51  
02:55:51  java.lang.Exception: JUnit test failure
02:55:51    at com.sun.javatest.regtest.agent.JUnitRunner.runWithJUnitPlatform(JUnitRunner.java:150)
02:55:51    at com.sun.javatest.regtest.agent.JUnitRunner.main(JUnitRunner.java:96)
02:55:51    at com.sun.javatest.regtest.agent.JUnitRunner.main(JUnitRunner.java:62)
02:55:51    at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104)
02:55:51    at java.base/java.lang.reflect.Method.invoke(Method.java:578)
02:55:51    at com.sun.javatest.regtest.agent.MainWrapper$MainThread.run(MainWrapper.java:125)
02:55:51    at java.base/java.lang.Thread.run(Thread.java:1639)
pshipton commented 11 months ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk21_j9_sanity.openjdk_s390x_linux_OMR_testList_1/57/ jdk_util_0 java/util/concurrent/tck/JSR166TestCase.java

06:34:11  [ JUnit Containers: found 222, started 222, succeeded 186, failed 0, aborted 0, skipped 0]
06:34:11  [ JUnit Tests: found 4087, started 4066, succeeded 4065, failed 1, aborted 0, skipped 0]
pshipton commented 10 months ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk21_j9_sanity.openjdk_x86-64_linux_OMR_testList_0/35

JasonFengJ9 commented 8 months ago

JDK17 ppc64le_linux(sles12le-svl-rt7-1)

[2024-04-02T01:28:26.379Z] variation: -Xdump:system:none -Xdump:heap:none -Xdump:system:events=gpf+abort+traceassert+corruptcache Mode650
[2024-04-02T01:28:26.379Z] JVM_OPTIONS:  -Xdump:system:none -Xdump:heap:none -Xdump:system:events=gpf+abort+traceassert+corruptcache -XX:-UseCompressedOops -Xverbosegclog 

[2024-04-02T01:37:10.156Z] TEST: java/util/concurrent/tck/JSR166TestCase.java#others

[2024-04-02T01:37:10.167Z] ...
[2024-04-02T01:37:10.167Z] Output overflow:
[2024-04-02T01:37:10.167Z] JT Harness has limited the test output to the text
[2024-04-02T01:37:10.167Z] at the beginning and the end, so that you can see how the
[2024-04-02T01:37:10.167Z] test began, and how it completed.
[2024-04-02T01:37:10.167Z] 
[2024-04-02T01:37:10.167Z] If you need to see more of the output from the test,
[2024-04-02T01:37:10.167Z] set the system property javatest.maxOutputSize to a higher
[2024-04-02T01:37:10.167Z] value. The current value is 100000
[2024-04-02T01:37:10.167Z] ...

[2024-04-02T01:37:10.170Z] JavaTest Message: JUnit Platform Failure(s): 1
[2024-04-02T01:37:10.170Z] 
[2024-04-02T01:37:10.170Z] [ JUnit Containers: found 218, started 218, succeeded 182, failed 0, aborted 0, skipped 0]
[2024-04-02T01:37:10.170Z] [ JUnit Tests: found 4061, started 4040, succeeded 4039, failed 1, aborted 0, skipped 0]
[2024-04-02T01:37:10.170Z] 
[2024-04-02T01:37:10.170Z] java.lang.Exception: JUnit test failure
[2024-04-02T01:37:10.170Z]  at com.sun.javatest.regtest.agent.JUnitRunner.runWithJUnitPlatform(JUnitRunner.java:149)
[2024-04-02T01:37:10.170Z]  at com.sun.javatest.regtest.agent.JUnitRunner.main(JUnitRunner.java:95)
[2024-04-02T01:37:10.170Z]  at com.sun.javatest.regtest.agent.JUnitRunner.main(JUnitRunner.java:61)
[2024-04-02T01:37:10.170Z]  at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[2024-04-02T01:37:10.170Z]  at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
[2024-04-02T01:37:10.170Z]  at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[2024-04-02T01:37:10.170Z]  at java.base/java.lang.reflect.Method.invoke(Method.java:574)
[2024-04-02T01:37:10.170Z]  at com.sun.javatest.regtest.agent.MainWrapper$MainTask.run(MainWrapper.java:138)
[2024-04-02T01:37:10.170Z]  at java.base/java.lang.Thread.run(Thread.java:857)
[2024-04-02T01:37:10.170Z] 
[2024-04-02T01:37:10.170Z] JavaTest Message: Test threw exception: java.lang.Exception: JUnit test failure

[2024-04-02T01:58:40.079Z] jdk_util_1_FAILED
pshipton commented 7 months ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk21_j9_sanity.openjdk_aarch64_linux_Release_testList_0/21 jdk_util_0 java/util/concurrent/tck/JSR166TestCase.java#forkjoinpool-common-parallelism

08:17:40  [ JUnit Containers: found 222, started 222, succeeded 186, failed 0, aborted 0, skipped 0]
08:17:40  [ JUnit Tests: found 4087, started 4066, succeeded 4065, failed 1, aborted 0, skipped 0]
pshipton commented 5 months ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk21_j9_sanity.openjdk_s390x_linux_Release_testList_1/26 jdk_util_0 java/util/concurrent/tck/JSR166TestCase.java#default

https://openj9-jenkins.osuosl.org/job/Test_openjdk21_j9_sanity.openjdk_x86-64_linux_OpenJDK21_testList_1/19 - ub16x64j96 jdk_util_0 java/util/concurrent/tck/JSR166TestCase.java#default

pshipton commented 3 months ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk11_j9_sanity.openjdk_x86-64_linux_OpenJDK11_testList_0/18/ - ub20-x86-1 jdk_util_0 java/util/concurrent/tck/JSR166TestCase.java#others

cjjdespres commented 3 months ago

https://hyc-runtimes-jenkins.swg-devops.com/job/Test_openjdk11_j9_sanity.openjdk_ppc64le_linux_jit_Personal_testList_1/398/ - sles15le-rtp-rt3-1.fyre.ibm.com jdk_util_0 java/util/concurrent/tck/JSR166TestCase.java#default

pshipton commented 1 month ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk21_j9_sanity.openjdk_aarch64_linux_Nightly_testList_0/318 - cent9-aarch64-5 jdk_util_1 java/util/concurrent/tck/JSR166TestCase.java#security-manager

pshipton commented 1 month ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_sanity.openjdk_aarch64_linux_Nightly_testList_1/307 jdk_util_0 java/util/concurrent/tck/JSR166TestCase.java#security-manager

pshipton commented 1 month ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk11_j9_sanity.openjdk_ppc64le_linux_Nightly_testList_0/83 jdk_util_0 java/util/concurrent/tck/JSR166TestCase.java#forkjoinpool-common-parallelism

pshipton commented 1 month ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk21_j9_sanity.openjdk_x86-64_linux_Nightly_testList_0/236 jdk_util_1 java/util/concurrent/tck/JSR166TestCase.java#others

pshipton commented 1 month ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_sanity.openjdk_aarch64_linux_Nightly_testList_1/321 jdk_util_0 java/util/concurrent/tck/JSR166TestCase.java#security-manager

pshipton commented 1 month ago

@tajila @hzongaro this started failing every day.

tajila commented 4 weeks ago

@theresa-m Please take a look at this

pshipton commented 3 weeks ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk11_j9_sanity.openjdk_x86-64_mac_OMR_testList_2/149

pshipton commented 3 weeks ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk21_j9_sanity.openjdk_x86-64_windows_Nightly_testList_2/270

theresa-m commented 2 weeks ago

I haven't been able to reproduce this running jdk_util in a grinder and the exception does not give any clues about the failure. I'm adding xdump options to the test commands to try to catch the next one and get more information. These should be reverted when this is resolved. https://github.com/ibmruntimes/openj9-openjdk-jdk/pull/881 https://github.com/ibmruntimes/openj9-openjdk-jdk23/pull/76 https://github.com/ibmruntimes/openj9-openjdk-jdk21/pull/226 https://github.com/ibmruntimes/openj9-openjdk-jdk17/pull/414 https://github.com/ibmruntimes/openj9-openjdk-jdk11/pull/846

pshipton commented 2 days ago

@theresa-m A new failure but I don't see any dumps, the only file collected is verbosegc. The -Xdump option is there but looking again systhrow should likely be throw.

Some other thoughts:

https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_sanity.openjdk_x86-64_linux_OMR_testList_0/131/ jdk_util_1 java/util/concurrent/tck/JSR166TestCase.java#others

    /home/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_x86-64_linux_OMR_testList_0/jdkbinary/j2sdk-image/bin/java \\
        -Dtest.vm.opts='-ea -esa -Xmx1540m -Xdump:system:none -Xdump:heap:none -Xdump:system:events=gpf+abort+traceassert+corruptcache -XX:-UseCompressedOops -Xverbosegclog' \\
        -Dtest.tool.vm.opts='-J-ea -J-esa -J-Xmx1540m -J-Xdump:system:none -J-Xdump:heap:none -J-Xdump:system:events=gpf+abort+traceassert+corruptcache -J-XX:-UseCompressedOops -J-Xverbosegclog' \\
        -Dtest.compiler.opts= \\
        -Dtest.java.opts= \\
        -Dtest.jdk=/home/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_x86-64_linux_OMR_testList_0/jdkbinary/j2sdk-image \\
        -Dcompile.jdk=/home/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_x86-64_linux_OMR_testList_0/jdkbinary/j2sdk-image \\
        -Dtest.timeout.factor=8.0 \\
        -Dtest.nativepath=/home/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_x86-64_linux_OMR_testList_0/jdkbinary/openjdk-test-image/jdk/jtreg/native \\
        -Dtest.root=/home/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_x86-64_linux_OMR_testList_0/aqa-tests/openjdk/openjdk-jdk/test/jdk \\
        -Dtest.name=java/util/concurrent/tck/JSR166TestCase.java#others \\
        -Dtest.file=/home/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_x86-64_linux_OMR_testList_0/aqa-tests/openjdk/openjdk-jdk/test/jdk/java/util/concurrent/tck/JSR166TestCase.java \\
        -Dtest.src=/home/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_x86-64_linux_OMR_testList_0/aqa-tests/openjdk/openjdk-jdk/test/jdk/java/util/concurrent/tck \\
        -Dtest.src.path=/home/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_x86-64_linux_OMR_testList_0/aqa-tests/openjdk/openjdk-jdk/test/jdk/java/util/concurrent/tck \\
        -Dtest.classes=/home/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_x86-64_linux_OMR_testList_0/aqa-tests/TKG/output_17327075386992/jdk_util_1/work/classes/0/java/util/concurrent/tck/JSR166TestCase_others.d \\
        -Dtest.class.path=/home/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_x86-64_linux_OMR_testList_0/aqa-tests/TKG/output_17327075386992/jdk_util_1/work/classes/0/java/util/concurrent/tck/JSR166TestCase_others.d \\
        -Dtest.class.path.prefix=/home/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_x86-64_linux_OMR_testList_0/aqa-tests/TKG/output_17327075386992/jdk_util_1/work/classes/0/java/util/concurrent/tck/JSR166TestCase_others.d:/home/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_x86-64_linux_OMR_testList_0/aqa-tests/openjdk/openjdk-jdk/test/jdk/java/util/concurrent/tck \\
        -Dtest.modules=java.management \\
        --add-modules java.management \\
        -ea \\
        -esa \\
        -Xmx1540m \\
        -Xdump:system:none \\
        -Xdump:heap:none \\
        -Xdump:system:events=gpf+abort+traceassert+corruptcache \\
        -XX:-UseCompressedOops \\
        -Xverbosegclog \\
        -Djava.library.path=/home/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_x86-64_linux_OMR_testList_0/jdkbinary/openjdk-test-image/jdk/jtreg/native \\
        --add-opens java.base/java.util.concurrent=ALL-UNNAMED \\
        --add-opens java.base/java.lang=ALL-UNNAMED \\
        -Djsr166.testImplementationDetails=true \\
        -Xdump:system+java+snap:events=systhrow,filter=java/lang/Exception,msg_filter=*JUnit* \\
        com.sun.javatest.regtest.agent.MainWrapper /home/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_x86-64_linux_OMR_testList_0/aqa-tests/TKG/output_17327075386992/jdk_util_1/work/java/util/concurrent/tck/JSR166TestCase_others.d/junit.0.jta java/util/concurrent/tck/JSR166TestCase.java#others JSR166TestCase
result: Failed. Execution failed: `main' threw exception: java.lang.Exception: JUnit test failure
theresa-m commented 1 day ago

Thanks @pshipton, I created a new pr to correct my xdump method and catch AssertionFailedError as well. I modified the TestRunner to make the output more verbose, hopefully this will help give a better idea of which test within Jsr166TestCase is failing. https://github.com/ibmruntimes/openj9-openjdk-jdk/pull/898

perhaps there is an option to override the default behavior where output is removed due to "Output overflow"

I believe this change would need to be made in https://github.com/adoptium/aqa-tests or EXTRA_OPTIONS in a grinder. I can try a grinder run again and see if anything turns up.