eclipse-openj9 / openj9

Eclipse OpenJ9: A Java Virtual Machine for OpenJDK that's optimized for small footprint, fast start-up, and high throughput. Builds on Eclipse OMR (https://github.com/eclipse/omr) and combines with the Extensions for OpenJDK for OpenJ9 repo.
Other
3.29k stars 722 forks source link

Timeouts on alinux #20463

Open pshipton opened 3 weeks ago

pshipton commented 3 weeks ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_sanity.openjdk_aarch64_linux_Nightly_testList_1/324/ java/util/stream/boottest/java.base/java/util/stream/DoubleNodeTest.java.DoubleNodeTest java/util/stream/boottest/java.base/java/util/stream/FlagOpTest.java.FlagOpTest

github-actions[bot] commented 3 weeks ago

Issue Number: 20463 Status: Open Recommended Components: comp:vm, comp:test, comp:gc Recommended Assignees: jasonfengj9, pshipton, keithc-ca

pshipton commented 3 weeks ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk23_j9_sanity.openjdk_aarch64_linux_Nightly_testList_0/96 java/lang/Class/forName/ForNameNames.java.ForNameNames java/lang/Class/forName/NonLinking/NonLinking.java.NonLinking

https://openj9-artifactory.osuosl.org/artifactory/ci-openj9/Test/Test_openjdk23_j9_sanity.openjdk_aarch64_linux_Nightly_testList_0/96/openjdk_test_output.tar.gz

ForNameNames

    name:          main
    id:            4147606
    Thread object: java/lang/Thread @ 0xe004f008
    ID:            2 (0x2)
    Priority:      -1
    Thread.State:  WAITING
    JVMTI state:   ALIVE WAITING WAITING_INDEFINITELY IN_OBJECT_WAIT
      waiting to be notified on: "Thread public flags mutex" with ID 0xffff98078f40 owner name: <unowned>
    Java stack frames:
     bp: 0x00000000006b7890  method: java.util.concurrent.ConcurrentHashMap$Node[] java/util/concurrent/ConcurrentHashMap.initTable()  source: ConcurrentHashMap.java:2309
      objects: 0xffeaf1c8 0xffeaf1c8
     bp: 0x00000000006b7988  method: Object java/util/concurrent/ConcurrentHashMap.putVal(Object, Object, boolean)  source: ConcurrentHashMap.java:1025
      objects: 0xe006b780 0xe006b768 0xffeaf1c8 0xe006b780 0xe006b768
     bp: 0x00000000006b79c8  method: void java/util/concurrent/ConcurrentHashMap.putAll(java.util.Map)  source: ConcurrentHashMap.java:1099
      objects: 0xffeaf1c8 0xffeaf208
     bp: 0x00000000006b79f8  method: void java/util/Properties.putAll(java.util.Map)  source: Properties.java:1357
      objects: 0xffeaf198
     bp: 0x00000000006b7a20  method: java.util.Properties com/sun/javatest/regtest/agent/ActionHelper.newProperties(java.util.Map)  source: ActionHelper.java:199
      objects: 0xffeaf198
     bp: 0x00000000006b7a40  method: java.util.Properties com/sun/javatest/regtest/agent/ActionHelper.access$200(java.util.Map)  source: ActionHelper.java:45
      objects: <no objects in this frame>
     bp: 0x00000000006b7b00  method: com.sun.javatest.regtest.agent.AStatus com/sun/javatest/regtest/agent/ActionHelper$SaveState.restore(String, com.sun.javatest.regtest.agent.AStatus)  source: ActionHelper.java:137
      objects: 0xffb9a3f8 0xe01caa78
     bp: 0x00000000006b7c10  method: com.sun.javatest.regtest.agent.AStatus com/sun/javatest/regtest/agent/CompileActionHelper.runCompile(String, java.util.Map, java.util.List, int, com.sun.javatest.regtest.agent.ActionHelper$OutputHandler)  source: CompileActionHelper.java:102
      objects: 0xe01ce0c8 0xffb9a390 0xffb9a3a8 0xffb9a3d0 0xffb90038 0xffb9a340 0xffb9a368 0xe01caa78 0xffb90000 0xffb9a3f8
     bp: 0x00000000006b7c60  method: void com/sun/javatest/regtest/agent/AgentServer.doCompile()  source: AgentServer.java:272
      objects: 0xe01ce0c8 0xffb9a3d0
     bp: 0x00000000006b7c90  method: void com/sun/javatest/regtest/agent/AgentServer.run()  source: AgentServer.java:239
      objects: 0xe01ce0c8
     bp: 0x00000000006b7cb8  method: void com/sun/javatest/regtest/agent/AgentServer.main(String[])  source: AgentServer.java:71
      objects: <no objects in this frame>

NonLinking

    name:          main
    id:            4147575
    Thread object: java/lang/Thread @ 0xe006a4d0
    ID:            2 (0x2)
    Priority:      -1
    Thread.State:  WAITING
    JVMTI state:   ALIVE WAITING WAITING_INDEFINITELY IN_OBJECT_WAIT
      waiting to be notified on: "Thread public flags mutex" with ID 0xffff9c078f40 owner name: <unowned>
    Java stack frames:
     bp: 0x00000000006bc5d0  method: boolean java/lang/String.isLatin1()  source: String.java:<data unavailable>
      objects: 0xff04d378 0xff04d378 0xff04d3a0
     bp: 0x00000000006bc658  method: void sun/nio/cs/StreamEncoder.write(String, int, int)  source: StreamEncoder.java:160
      objects: 0xe01f6588 0xff04d3a0
     bp: 0x00000000006bc690  method: void java/io/OutputStreamWriter.write(String, int, int)  source: OutputStreamWriter.java:239
      objects: <no objects in this frame>
     bp: 0x00000000006bc6d0  method: void java/io/PrintWriter.implWrite(String, int, int)  source: PrintWriter.java:621
      objects: 0xe0130a90
     bp: 0x00000000006bc728  method: void java/io/PrintWriter.write(String, int, int)  source: PrintWriter.java:613
      objects: 0xe013a120
     bp: 0x00000000006bc750  method: void java/io/PrintWriter.write(String)  source: PrintWriter.java:635
      objects: <no objects in this frame>
     bp: 0x00000000006bc778  method: java.io.PrintWriter java/io/PrintWriter.append(CharSequence)  source: PrintWriter.java:1313
      objects: 0xe0130a90
     bp: 0x00000000006bc7b0  method: java.io.PrintWriter java/io/PrintWriter.append(CharSequence, int, int)  source: PrintWriter.java:1353
      objects: <no objects in this frame>
     bp: 0x00000000006bc7e8  method: Appendable java/io/PrintWriter.append(CharSequence, int, int)  source: PrintWriter.java:64
      objects: <no objects in this frame>
     bp: 0x00000000006bc820  method: void java/util/Formatter$FixedString.print(java.util.Formatter, Object, java.util.Locale)  source: Formatter.java:3035
      objects: <no objects in this frame>
     bp: 0x00000000006bc890  method: java.util.Formatter java/util/Formatter.format(java.util.Locale, String, Object[])  source: Formatter.java:2790
      objects: 0xe013a138 0xe00d2348 0xff04d018 0xff04d360
     bp: 0x00000000006bc8c8  method: void java/io/PrintWriter.implFormat(String, Object[])  source: PrintWriter.java:1203
      objects: 0xe0130a90
     bp: 0x00000000006bc918  method: java.io.PrintWriter java/io/PrintWriter.format(String, Object[])  source: PrintWriter.java:1191
      objects: 0xe0130a90 0xe013a120
     bp: 0x00000000006bc948  method: java.io.PrintWriter java/io/PrintWriter.printf(String, Object[])  source: PrintWriter.java:1084
      objects: <no objects in this frame>
     bp: 0x00000000006bc970  method: void com/sun/javatest/regtest/agent/AgentServer.log(String)  source: AgentServer.java:375
      objects: 0xe012e308
     bp: 0x00000000006bc9a0  method: void com/sun/javatest/regtest/agent/AgentServer.run()  source: AgentServer.java:256
      objects: 0xe012e308
     bp: 0x00000000006bc9c8  method: void com/sun/javatest/regtest/agent/AgentServer.main(String[])  source: AgentServer.java:71
      objects: <no objects in this frame>
pshipton commented 3 weeks ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk21_j9_sanity.openjdk_aarch64_linux_Nightly_testList_1/338 jdk_foreign_0 java/foreign/TestByteBuffer.java

https://openj9-artifactory.osuosl.org/artifactory/ci-openj9/Test/Test_openjdk21_j9_sanity.openjdk_aarch64_linux_Nightly_testList_1/338/openjdk_test_output.tar.gz

20:05:47  Total tests run: 300, Passes: 300, Failures: 0, Skips: 0
20:05:47  ===============================================
20:05:47  
20:05:47  STDERR:
20:05:47  JVMDUMP034I User requested System dump using '/home/jenkins/workspace/Test_openjdk21_j9_sanity.openjdk_aarch64_linux_Nightly_testList_1/aqa-tests/TKG/output_17304143225733/jdk_foreign_0/work/scratch/1/core.20241101.000248.4030304.0001.dmp' through com.ibm.jvm.Dump.systemDumpToFile
20:05:47  JVMDUMP010I System dump written to /home/jenkins/workspace/Test_openjdk21_j9_sanity.openjdk_aarch64_linux_Nightly_testList_1/aqa-tests/TKG/output_17304143225733/jdk_foreign_0/work/scratch/1/core.20241101.000248.4030304.0001.dmp
20:05:47  STATUS:Passed.
    name:          MainThread
    id:            4030332
    Thread object: java/lang/Thread @ 0xe00d95f0
    ID:            23 (0x17)
    Priority:      -1
    Thread.State:  WAITING
    JVMTI state:   ALIVE WAITING WAITING_INDEFINITELY IN_OBJECT_WAIT
      waiting to be notified on: "Thread public flags mutex" with ID 0xf6a430186ab0 owner name: <unowned>
    Java stack frames:
     bp: 0x000000000022bbc0  method: Class java/lang/reflect/Method.getReturnType()  source: Method.java:<data unavailable>
      objects: 0xe027a6c0 0xe027a6c0 0xe027a6c0
     bp: 0x000000000022bc50  method: jdk.internal.reflect.MethodAccessorImpl jdk/internal/reflect/MethodHandleAccessorFactory.newMethodAccessor(reflect.Method, boolean)  source: MethodHandleAccessorFactory.java:80
      objects: 0xe027a6c0
     bp: 0x000000000022bc90  method: jdk.internal.reflect.MethodAccessor jdk/internal/reflect/ReflectionFactory.newMethodAccessor(reflect.Method, boolean)  source: ReflectionFactory.java:159
      objects: <no objects in this frame>
     bp: 0x000000000022bd30  method: jdk.internal.reflect.MethodAccessor java/lang/reflect/Method.acquireMethodAccessor()  source: Method.java:732
      objects: 0xffda88e8
     bp: 0x000000000022bdf0  method: Object java/lang/reflect/Method.invoke(Object, Object[])  source: Method.java:583
      objects: 0xffda88e8 0xffdcdf28 0xffda8940 0xe0040898
     bp: 0x000000000022be48  method: void TestByteBuffer.testScopedBuffer(java.util.function.Function, reflect.Method, Object[])  source: TestByteBuffer.java:397
      objects: <no objects in this frame>
pshipton commented 3 weeks ago

@tajila can someone take a look pls.

pshipton commented 3 weeks ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk21_j9_sanity.openjdk_aarch64_linux_Nightly_testList_2/337/ jdk_foreign_1 java/foreign/TestByteBuffer.java

https://openj9-artifactory.osuosl.org/artifactory/ci-openj9/Test/Test_openjdk21_j9_sanity.openjdk_aarch64_linux_Nightly_testList_2/337/openjdk_test_output.tar.gz

tajila commented 3 weeks ago

@babsingh Please take a look

babsingh commented 3 weeks ago

The two previous timeouts have occurred at different points, suggesting that it is not a hang.

https://github.com/eclipse-openj9/openj9/issues/20463#issuecomment-2452063279:

<1d3200>    !j9method 0x000000000014CE48   jdk/internal/reflect/MethodHandleAccessorFactory.getDirectMethod(Ljava/lang/reflect/Method;Z)Ljava/lang/invoke/MethodHandle;
<1d3200>    !j9method 0x000000000014CDE8   jdk/internal/reflect/MethodHandleAccessorFactory.newMethodAccessor(Ljava/lang/reflect/Method;Z)Ljdk/internal/reflect/MethodAccessorImpl;
<1d3200>    !j9method 0x00000000000711B8   jdk/internal/reflect/ReflectionFactory.newMethodAccessor(Ljava/lang/reflect/Method;Z)Ljdk/internal/reflect/MethodAccessor;
<1d3200>    !j9method 0x0000000000055858   java/lang/reflect/Method.acquireMethodAccessor()Ljdk/internal/reflect/MethodAccessor;
<1d3200>    !j9method 0x0000000000055778   java/lang/reflect/Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;

https://github.com/eclipse-openj9/openj9/issues/20463#issuecomment-2452077703.

<ffffac2cf100>  !j9method 0x0000FFFF10323FC8   java/nio/MappedMemoryUtils.force0(Ljava/io/FileDescriptor;JJ)V
<ffffac2cf100>  !j9method 0x0000FFFF10323FC8   java/nio/MappedMemoryUtils.force0(Ljava/io/FileDescriptor;JJ)V
<ffffac2cf100>  !j9method 0x0000FFFF10323F48   java/nio/MappedMemoryUtils.force(Ljava/io/FileDescriptor;JZJJ)V
<ffffac2cf100>  !j9method 0x0000FFFFAC239908   java/nio/Buffer$2.force(Ljava/io/FileDescriptor;JZJJ)V
<ffffac2cf100>  !j9method 0x0000FFFFAC233400   jdk/internal/misc/ScopedMemoryAccess.forceInternal(Ljdk/internal/foreign/MemorySessionImpl;Ljava/io/FileDescriptor;JZJJ)V
<ffffac2cf100>  !j9method 0x0000FFFFAC2333E0   jdk/internal/misc/ScopedMemoryAccess.force(Ljdk/internal/foreign/MemorySessionImpl;Ljava/io/FileDescriptor;JZJJ)V
<ffffac2cf100>  !j9method 0x0000FFFF10309680   jdk/internal/foreign/MappedMemorySegmentImpl.force()V
<ffffac2cf100>  !j9method 0x0000FFFFAC49F010   TestByteBuffer.testMappedSegmentOffset()V

No timeouts are seen in a 100x grinder of TestByteBuffer: https://openj9-jenkins.osuosl.org/job/Grinder/3945. This reconfirms that TestByteBuffer doesn't hang.

The test suite needs longer to run on alinux, so the test suite's timeout should be increased. @llxia Can you help with increasing the timeout?

pshipton commented 2 weeks ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk21_j9_sanity.openjdk_aarch64_linux_OMR_testList_1/182 jdk_foreign_0 java/foreign/TestByteBuffer.java.TestByteBuffer java/foreign/TestLayouts.java.TestLayouts

llxia commented 14 hours ago

Currently, the default is -timeoutFactor:8. We can try to increase the timeout factor on alinux to 12. https://github.com/adoptium/aqa-tests/blob/a2f96a0fc17d206c45eeade3fbea7395dcb13d36/openjdk/openjdk.mk#L120

@LongyuZhang could you take care of this one? Thanks