eclipse-openj9 / openj9

Eclipse OpenJ9: A Java Virtual Machine for OpenJDK that's optimized for small footprint, fast start-up, and high throughput. Builds on Eclipse OMR (https://github.com/eclipse/omr) and combines with the Extensions for OpenJDK for OpenJ9 repo.
Other
3.28k stars 721 forks source link

jdk_rmi_0_FAILED java/rmi/reliability/benchmark/bench/rmi/Main.java - Segmentation error vmState=0x0005ff04 #15220

Closed JasonFengJ9 closed 2 years ago

JasonFengJ9 commented 2 years ago

Failure link

From an internal build job/Test_openjdk8_j9_extended.openjdk_s390x_linux/66/(ub18s390xrt-1-6):

openjdk version "1.8.0_342"
IBM Semeru Runtime Open Edition (build 1.8.0_342-b03)
Eclipse OpenJ9 VM (build v0.33.0-release-bf978d503, JRE 1.8.0 Linux s390x-64-Bit Compressed References 20220602_370 (JIT enabled, AOT enabled)
OpenJ9   - bf978d503
OMR      - e7d85499b
JCL      - b43a04972a based on jdk8u342-b03)

Rerun in Grinder - Change TARGET to run only the failed test targets.

Optional info

Failure output (captured from console output)

[2022-06-02T22:50:14.507Z] Running test jdk_rmi_0 ...
[2022-06-02T22:50:14.507Z] ===============================================
[2022-06-02T22:50:14.507Z] jdk_rmi_0 Start Time: Thu Jun  2 15:50:14 2022 Epoch Time (ms): 1654210214470
[2022-06-02T22:50:14.507Z] "/home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/bin/java" -Xshareclasses:destroyAll; "/home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/bin/java" -Xshareclasses:groupAccess,destroyAll; echo "cache cleanup done";
[2022-06-02T22:50:14.953Z] JVMSHRC005I No shared class caches available
[2022-06-02T22:50:14.953Z] JVMSHRC005I No shared class caches available
[2022-06-02T22:50:14.953Z] cache cleanup done
[2022-06-02T22:50:14.953Z] variation: Mode150
[2022-06-02T22:50:14.953Z] JVM_OPTIONS:  -XX:+UseCompressedOops 

[2022-06-02T22:56:00.795Z] TEST: java/rmi/reliability/benchmark/bench/rmi/Main.java

[2022-06-02T22:56:00.797Z] STDERR:
[2022-06-02T22:56:00.797Z] #0: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x90ca56) [0x3ff99f8ca56]
[2022-06-02T22:56:00.797Z] #1: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x919be8) [0x3ff99f99be8]
[2022-06-02T22:56:00.797Z] #2: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x1490ca) [0x3ff997c90ca]
[2022-06-02T22:56:00.797Z] #3: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9prt29.so(+0x33094) [0x3ff9aa33094]
[2022-06-02T22:56:00.797Z] #4: [0x3ff983f55c0]
[2022-06-02T22:56:00.797Z] #5: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x195cfa) [0x3ff99815cfa]
[2022-06-02T22:56:00.797Z] #6: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x198008) [0x3ff99818008]
[2022-06-02T22:56:00.797Z] #7: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x4c07ee) [0x3ff99b407ee]
[2022-06-02T22:56:00.797Z] #8: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x4b81ec) [0x3ff99b381ec]
[2022-06-02T22:56:00.797Z] #9: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x9dde1c) [0x3ff9a05de1c]
[2022-06-02T22:56:00.797Z] #10: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x4e6fa4) [0x3ff99b66fa4]
[2022-06-02T22:56:00.797Z] #11: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x9ddef4) [0x3ff9a05def4]
[2022-06-02T22:56:00.797Z] #12: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x4e6fa4) [0x3ff99b66fa4]
[2022-06-02T22:56:00.797Z] #13: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x11b35a) [0x3ff9979b35a]
[2022-06-02T22:56:00.797Z] #14: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x4f5a8c) [0x3ff99b75a8c]
[2022-06-02T22:56:00.797Z] #15: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x4f68be) [0x3ff99b768be]
[2022-06-02T22:56:00.797Z] #16: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x4f2a28) [0x3ff99b72a28]
[2022-06-02T22:56:00.797Z] #17: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x525d70) [0x3ff99ba5d70]
[2022-06-02T22:56:00.797Z] #18: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x15acbc) [0x3ff997dacbc]
[2022-06-02T22:56:00.797Z] #19: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x15bb94) [0x3ff997dbb94]
[2022-06-02T22:56:00.797Z] #20: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9prt29.so(+0x33f7e) [0x3ff9aa33f7e]
[2022-06-02T22:56:00.797Z] #21: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x1597e2) [0x3ff997d97e2]
[2022-06-02T22:56:00.797Z] #22: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x159ee6) [0x3ff997d9ee6]
[2022-06-02T22:56:00.797Z] #23: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x158ae8) [0x3ff997d8ae8]
[2022-06-02T22:56:00.797Z] #24: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x158d88) [0x3ff997d8d88]
[2022-06-02T22:56:00.797Z] #25: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x158e6a) [0x3ff997d8e6a]
[2022-06-02T22:56:00.797Z] #26: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9prt29.so(+0x33f7e) [0x3ff9aa33f7e]
[2022-06-02T22:56:00.797Z] #27: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x159312) [0x3ff997d9312]
[2022-06-02T22:56:00.797Z] #28: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9thr29.so(+0x5a14) [0x3ff9a985a14]
[2022-06-02T22:56:00.797Z] #29: /lib/s390x-linux-gnu/libpthread.so.0(+0x7aa8) [0x3ff9b587aa8]
[2022-06-02T22:56:00.797Z] Unhandled exception
[2022-06-02T22:56:00.797Z] Type=Segmentation error vmState=0x0005ff04
[2022-06-02T22:56:00.797Z] J9Generic_Signal_Number=00000018 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
[2022-06-02T22:56:00.797Z] Handler1=000003FF9AB46940 Handler2=000003FF9AA32E10 InaccessibleAddress=0000000000000000
[2022-06-02T22:56:00.797Z] gpr0=0000000000000000 gpr1=000003FF940C0DF0 gpr2=0000000000000004 gpr3=0000000000000098
[2022-06-02T22:56:00.797Z] gpr4=000003FF99815CE2 gpr5=0000000000000001 gpr6=0000000000000001 gpr7=000003FEF6009380
[2022-06-02T22:56:00.797Z] gpr8=0000000000000098 gpr9=0000000000000001 gpr10=00000000020D2600 gpr11=000003FF9414F8E0
[2022-06-02T22:56:00.797Z] gpr12=000003FF9B6A6000 gpr13=000003FF9A17E838 gpr14=000003FF99815CE2 gpr15=000003FF983F5A48
[2022-06-02T22:56:00.797Z] psw=000003FF99815CFA mask=0705000180000000 fpc=00880000 bea=000003FF9982BCEE
[2022-06-02T22:56:00.797Z] fpr0 3f80000000000014 (f: 20.000000, d: 7.812500e-03)
[2022-06-02T22:56:00.797Z] fpr1 0000000000000006 (f: 6.000000, d: 2.964394e-323)
[2022-06-02T22:56:00.797Z] fpr2 457a0000983f5f9c (f: 2554290176.000000, d: 5.029133e+26)
[2022-06-02T22:56:00.797Z] fpr3 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2022-06-02T22:56:00.797Z] fpr4 000003ff983f5fac (f: 2554290176.000000, d: 2.172064e-311)
[2022-06-02T22:56:00.797Z] fpr5 3fcc720a74b7854b (f: 1958184320.000000, d: 2.222303e-01)
[2022-06-02T22:56:00.797Z] fpr6 000003ff983f5fb0 (f: 2554290176.000000, d: 2.172064e-311)
[2022-06-02T22:56:00.797Z] fpr7 3f7e17d2dc43b59b (f: 3695425024.000000, d: 7.346939e-03)
[2022-06-02T22:56:00.797Z] fpr8 0000000000101000 (f: 1052672.000000, d: 5.200891e-318)
[2022-06-02T22:56:00.797Z] fpr9 000003ffc08fab50 (f: 3230640896.000000, d: 2.172398e-311)
[2022-06-02T22:56:00.797Z] fpr10 000003ff982fd000 (f: 2553270272.000000, d: 2.172063e-311)
[2022-06-02T22:56:00.797Z] fpr11 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2022-06-02T22:56:00.797Z] fpr12 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2022-06-02T22:56:00.797Z] fpr13 000002aa2135d160 (f: 557175168.000000, d: 1.447476e-311)
[2022-06-02T22:56:00.797Z] fpr14 000003ffce5fa1ec (f: 3462373888.000000, d: 2.172512e-311)
[2022-06-02T22:56:00.797Z] fpr15 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2022-06-02T22:56:00.797Z] Module=/home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so
[2022-06-02T22:56:00.797Z] Module_base_address=000003FF99680000
[2022-06-02T22:56:00.797Z] 
[2022-06-02T22:56:00.797Z] Method_being_compiled=sun/reflect/GeneratedMethodAccessor21.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;
[2022-06-02T22:56:00.797Z] Target=2_90_20220602_370 (Linux 4.15.0-180-generic)
[2022-06-02T22:56:00.797Z] CPU=s390x (4 logical CPUs) (0xeecfe000 RAM)
[2022-06-02T22:56:00.797Z] ----------- Stack Backtrace -----------
[2022-06-02T22:56:00.797Z] _ZN11TR_J9VMBase24getResolvedVirtualMethodEP19TR_OpaqueClassBlockib+0x82 (0x000003FF99815CFA [libj9jit29.so+0x195cfa])
[2022-06-02T22:56:00.797Z] _ZN19TR_ResolvedJ9Method24getResolvedVirtualMethodEPN2TR11CompilationEP19TR_OpaqueClassBlockib+0x38 (0x000003FF99818008 [libj9jit29.so+0x198008])
[2022-06-02T22:56:00.797Z] _ZN2J91Z14PrivateLinkage20buildVirtualDispatchEPN2TR4NodeEPNS2_28RegisterDependencyConditionsEPNS2_8RegisterEj+0x365e (0x000003FF99B407EE [libj9jit29.so+0x4c07ee])
[2022-06-02T22:56:00.797Z] _ZN2J91Z14PrivateLinkage21buildIndirectDispatchEPN2TR4NodeE+0x11c (0x000003FF99B381EC [libj9jit29.so+0x4b81ec])
[2022-06-02T22:56:00.797Z] _ZN3OMR1Z13TreeEvaluator21indirectCallEvaluatorEPN2TR4NodeEPNS2_13CodeGeneratorE+0x4c (0x000003FF9A05DE1C [libj9jit29.so+0x9dde1c])
[2022-06-02T22:56:00.797Z] _ZN3OMR13CodeGenerator8evaluateEPN2TR4NodeE+0x64 (0x000003FF99B66FA4 [libj9jit29.so+0x4e6fa4])
[2022-06-02T22:56:00.797Z] _ZN3OMR1Z13TreeEvaluator16treetopEvaluatorEPN2TR4NodeEPNS2_13CodeGeneratorE+0x4c (0x000003FF9A05DEF4 [libj9jit29.so+0x9ddef4])
[2022-06-02T22:56:00.797Z] _ZN3OMR13CodeGenerator8evaluateEPN2TR4NodeE+0x64 (0x000003FF99B66FA4 [libj9jit29.so+0x4e6fa4])
[2022-06-02T22:56:00.797Z] _ZN2J913CodeGenerator22doInstructionSelectionEv+0xd0a (0x000003FF9979B35A [libj9jit29.so+0x11b35a])
[2022-06-02T22:56:00.797Z] _ZN3OMR12CodeGenPhase32performInstructionSelectionPhaseEPN2TR13CodeGeneratorEPNS1_12CodeGenPhaseE+0x7c (0x000003FF99B75A8C [libj9jit29.so+0x4f5a8c])
[2022-06-02T22:56:00.797Z] _ZN3OMR12CodeGenPhase10performAllEv+0x10e (0x000003FF99B768BE [libj9jit29.so+0x4f68be])
[2022-06-02T22:56:00.797Z] _ZN3OMR13CodeGenerator12generateCodeEv+0x60 (0x000003FF99B72A28 [libj9jit29.so+0x4f2a28])
[2022-06-02T22:56:00.797Z] _ZN3OMR11Compilation7compileEv+0xe28 (0x000003FF99BA5D70 [libj9jit29.so+0x525d70])
[2022-06-02T22:56:00.797Z] _ZN2TR28CompilationInfoPerThreadBase7compileEP10J9VMThreadPNS_11CompilationEP17TR_ResolvedMethodR11TR_J9VMBaseP19TR_OptimizationPlanRKNS_16SegmentAllocatorE+0x51c (0x000003FF997DACBC [libj9jit29.so+0x15acbc])
[2022-06-02T22:56:00.797Z] _ZN2TR28CompilationInfoPerThreadBase14wrappedCompileEP13J9PortLibraryPv+0x38c (0x000003FF997DBB94 [libj9jit29.so+0x15bb94])
[2022-06-02T22:56:00.797Z] omrsig_protect+0x366 (0x000003FF9AA33F7E [libj9prt29.so+0x33f7e])
[2022-06-02T22:56:00.797Z] _ZN2TR28CompilationInfoPerThreadBase7compileEP10J9VMThreadP21TR_MethodToBeCompiledRN2J917J9SegmentProviderE+0x332 (0x000003FF997D97E2 [libj9jit29.so+0x1597e2])
[2022-06-02T22:56:00.797Z] _ZN2TR24CompilationInfoPerThread12processEntryER21TR_MethodToBeCompiledRN2J917J9SegmentProviderE+0x246 (0x000003FF997D9EE6 [libj9jit29.so+0x159ee6])
[2022-06-02T22:56:00.797Z] _ZN2TR24CompilationInfoPerThread14processEntriesEv+0x3a0 (0x000003FF997D8AE8 [libj9jit29.so+0x158ae8])
[2022-06-02T22:56:00.797Z] _ZN2TR24CompilationInfoPerThread3runEv+0x38 (0x000003FF997D8D88 [libj9jit29.so+0x158d88])
[2022-06-02T22:56:00.797Z] _Z30protectedCompilationThreadProcP13J9PortLibraryPN2TR24CompilationInfoPerThreadE+0x9a (0x000003FF997D8E6A [libj9jit29.so+0x158e6a])
[2022-06-02T22:56:00.797Z] omrsig_protect+0x366 (0x000003FF9AA33F7E [libj9prt29.so+0x33f7e])
[2022-06-02T22:56:00.797Z] _Z21compilationThreadProcPv+0x20a (0x000003FF997D9312 [libj9jit29.so+0x159312])
[2022-06-02T22:56:00.797Z] thread_wrapper+0x114 (0x000003FF9A985A14 [libj9thr29.so+0x5a14])
[2022-06-02T22:56:00.797Z] start_thread+0xd0 (0x000003FF9B587AA8 [libpthread.so.0+0x7aa8])
[2022-06-02T22:56:00.797Z]  (0x000003FF9B37A11E [libc.so.6+0xfa11e])
[2022-06-02T22:56:00.797Z]  (0x0000000000000000 [<unknown>+0x0])
[2022-06-02T22:56:00.797Z] ---------------------------------------
[2022-06-02T22:56:00.797Z] JVMDUMP039I Processing dump event "gpf", detail "" at 2022/06/02 15:55:36 - please wait.
[2022-06-02T22:56:00.797Z] JVMDUMP032I JVM requested System dump using '/home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/aqa-tests/TKG/output_16541972686168/jdk_rmi_0/work/java/rmi/reliability/benchmark/bench/rmi/Main/core.20220602.155536.32170.0001.dmp' in response to an event
[2022-06-02T22:56:00.797Z] JVMDUMP010I System dump written to /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/aqa-tests/TKG/output_16541972686168/jdk_rmi_0/work/java/rmi/reliability/benchmark/bench/rmi/Main/core.20220602.155536.32170.0001.dmp
[2022-06-02T22:56:00.797Z] JVMDUMP032I JVM requested Java dump using '/home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/aqa-tests/TKG/output_16541972686168/jdk_rmi_0/work/java/rmi/reliability/benchmark/bench/rmi/Main/javacore.20220602.155536.32170.0002.txt' in response to an event
[2022-06-02T22:56:00.797Z] JVMDUMP010I Java dump written to /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/aqa-tests/TKG/output_16541972686168/jdk_rmi_0/work/java/rmi/reliability/benchmark/bench/rmi/Main/javacore.20220602.155536.32170.0002.txt
[2022-06-02T22:56:00.797Z] JVMDUMP032I JVM requested Snap dump using '/home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/aqa-tests/TKG/output_16541972686168/jdk_rmi_0/work/java/rmi/reliability/benchmark/bench/rmi/Main/Snap.20220602.155536.32170.0003.trc' in response to an event
[2022-06-02T22:56:00.797Z] JVMDUMP010I Snap dump written to /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/aqa-tests/TKG/output_16541972686168/jdk_rmi_0/work/java/rmi/reliability/benchmark/bench/rmi/Main/Snap.20220602.155536.32170.0003.trc
[2022-06-02T22:56:00.797Z] JVMDUMP032I JVM requested JIT dump using '/home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/aqa-tests/TKG/output_16541972686168/jdk_rmi_0/work/java/rmi/reliability/benchmark/bench/rmi/Main/jitdump.20220602.155536.32170.0004.dmp' in response to an event
[2022-06-02T22:56:00.797Z] JVMDUMP051I JIT dump occurred in 'JIT Compilation Thread-001' thread 0x0000000001F56300
[2022-06-02T22:56:00.797Z] JVMDUMP049I JIT dump notified all waiting threads of the current method to be compiled
[2022-06-02T22:56:00.797Z] JVMDUMP054I JIT dump is tracing the IL of the method on the crashed compilation thread
[2022-06-02T22:56:00.797Z] JVMDUMP052I JIT dump recursive crash occurred on diagnostic thread
[2022-06-02T22:56:00.797Z] JVMDUMP048I JIT dump method being compiled is an ordinary method
[2022-06-02T22:56:00.797Z] JVMDUMP053I JIT dump is recompiling sun/reflect/GeneratedMethodAccessor21.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;
[2022-06-02T22:56:00.797Z] #0: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x90ca56) [0x3ff8678ca56]
[2022-06-02T22:56:00.797Z] #1: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x919be8) [0x3ff86799be8]
[2022-06-02T22:56:00.797Z] #2: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x1490ca) [0x3ff85fc90ca]
[2022-06-02T22:56:00.797Z] #3: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9prt29.so(+0x33094) [0x3ff87233094]
[2022-06-02T22:56:00.797Z] #4: [0x3ff844755c0]
[2022-06-02T22:56:00.797Z] #5: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x195cfa) [0x3ff86015cfa]
[2022-06-02T22:56:00.798Z] #6: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x198008) [0x3ff86018008]
[2022-06-02T22:56:00.798Z] #7: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x4c07ee) [0x3ff863407ee]
[2022-06-02T22:56:00.798Z] #8: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x4b81ec) [0x3ff863381ec]
[2022-06-02T22:56:00.798Z] #9: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x9dde1c) [0x3ff8685de1c]
[2022-06-02T22:56:00.798Z] #10: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x4e6fa4) [0x3ff86366fa4]
[2022-06-02T22:56:00.798Z] #11: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x9ddef4) [0x3ff8685def4]
[2022-06-02T22:56:00.798Z] #12: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x4e6fa4) [0x3ff86366fa4]
[2022-06-02T22:56:00.798Z] #13: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x11b35a) [0x3ff85f9b35a]
[2022-06-02T22:56:00.798Z] #14: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x4f5a8c) [0x3ff86375a8c]
[2022-06-02T22:56:00.798Z] #15: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x4f68be) [0x3ff863768be]
[2022-06-02T22:56:00.798Z] #16: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x4f2a28) [0x3ff86372a28]
[2022-06-02T22:56:00.798Z] #17: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x525d70) [0x3ff863a5d70]
[2022-06-02T22:56:00.798Z] #18: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x15acbc) [0x3ff85fdacbc]
[2022-06-02T22:56:00.798Z] #19: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x15bb94) [0x3ff85fdbb94]
[2022-06-02T22:56:00.798Z] #20: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9prt29.so(+0x33f7e) [0x3ff87233f7e]
[2022-06-02T22:56:00.798Z] #21: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x1597e2) [0x3ff85fd97e2]
[2022-06-02T22:56:00.798Z] #22: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x159ee6) [0x3ff85fd9ee6]
[2022-06-02T22:56:00.798Z] #23: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x158ae8) [0x3ff85fd8ae8]
[2022-06-02T22:56:00.798Z] #24: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x158d88) [0x3ff85fd8d88]
[2022-06-02T22:56:00.798Z] #25: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x158e6a) [0x3ff85fd8e6a]
[2022-06-02T22:56:00.798Z] #26: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9prt29.so(+0x33f7e) [0x3ff87233f7e]
[2022-06-02T22:56:00.798Z] #27: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so(+0x159312) [0x3ff85fd9312]
[2022-06-02T22:56:00.798Z] #28: /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9thr29.so(+0x5a14) [0x3ff87185a14]
[2022-06-02T22:56:00.798Z] #29: /lib/s390x-linux-gnu/libpthread.so.0(+0x7aa8) [0x3ff87d87aa8]
[2022-06-02T22:56:00.798Z] Unhandled exception
[2022-06-02T22:56:00.798Z] Type=Segmentation error vmState=0x0005ff04
[2022-06-02T22:56:00.798Z] J9Generic_Signal_Number=00000018 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
[2022-06-02T22:56:00.798Z] Handler1=000003FF87346940 Handler2=000003FF87232E10 InaccessibleAddress=0000000000000000
[2022-06-02T22:56:00.798Z] gpr0=0000000000000000 gpr1=000003FF800BC500 gpr2=0000000000000004 gpr3=0000000000000098
[2022-06-02T22:56:00.798Z] gpr4=000003FF86015CE2 gpr5=0000000000000001 gpr6=0000000000000001 gpr7=000003FF6C09B380
[2022-06-02T22:56:00.798Z] gpr8=0000000000000098 gpr9=0000000000000001 gpr10=0000000000B8E800 gpr11=000003FF8014AB80
[2022-06-02T22:56:00.798Z] gpr12=000003FF87EA6000 gpr13=000003FF8697E838 gpr14=000003FF86015CE2 gpr15=000003FF84475A48
[2022-06-02T22:56:00.798Z] psw=000003FF86015CFA mask=0705000180000000 fpc=00880000 bea=000003FF8602BCEE
[2022-06-02T22:56:00.798Z] fpr0 3f80000000000014 (f: 20.000000, d: 7.812500e-03)
[2022-06-02T22:56:00.798Z] fpr1 0000000000000006 (f: 6.000000, d: 2.964394e-323)
[2022-06-02T22:56:00.798Z] fpr2 44fa200084475f9c (f: 2219270144.000000, d: 1.973950e+24)
[2022-06-02T22:56:00.798Z] fpr3 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2022-06-02T22:56:00.798Z] fpr4 000003ff84475fac (f: 2219270144.000000, d: 2.171898e-311)
[2022-06-02T22:56:00.798Z] fpr5 3fcc720a74b7854b (f: 1958184320.000000, d: 2.222303e-01)
[2022-06-02T22:56:00.798Z] fpr6 000003ff84475fb0 (f: 2219270144.000000, d: 2.171898e-311)
[2022-06-02T22:56:00.798Z] fpr7 3f7e17d2dc43b59b (f: 3695425024.000000, d: 7.346939e-03)
[2022-06-02T22:56:00.798Z] fpr8 0000000000101000 (f: 1052672.000000, d: 5.200891e-318)
[2022-06-02T22:56:00.798Z] fpr9 000003ffc08fab50 (f: 3230640896.000000, d: 2.172398e-311)
[2022-06-02T22:56:00.798Z] fpr10 000003ff8437d000 (f: 2218250240.000000, d: 2.171898e-311)
[2022-06-02T22:56:00.798Z] fpr11 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2022-06-02T22:56:00.798Z] fpr12 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2022-06-02T22:56:00.798Z] fpr13 000002aa2135d160 (f: 557175168.000000, d: 1.447476e-311)
[2022-06-02T22:56:00.798Z] fpr14 000003ffce5fa1ec (f: 3462373888.000000, d: 2.172512e-311)
[2022-06-02T22:56:00.798Z] fpr15 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2022-06-02T22:56:00.798Z] Module=/home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/openjdkbinary/j2sdk-image/jre/lib/s390x/default/libj9jit29.so
[2022-06-02T22:56:00.798Z] Module_base_address=000003FF85E80000
[2022-06-02T22:56:00.798Z] 
[2022-06-02T22:56:00.798Z] Method_being_compiled=sun/reflect/GeneratedMethodAccessor4.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;
[2022-06-02T22:56:00.798Z] Target=2_90_20220602_370 (Linux 4.15.0-180-generic)
[2022-06-02T22:56:00.798Z] CPU=s390x (4 logical CPUs) (0xeecfe000 RAM)
[2022-06-02T22:56:00.798Z] ----------- Stack Backtrace -----------
[2022-06-02T22:56:00.798Z] _ZN11TR_J9VMBase24getResolvedVirtualMethodEP19TR_OpaqueClassBlockib+0x82 (0x000003FF86015CFA [libj9jit29.so+0x195cfa])
[2022-06-02T22:56:00.798Z] _ZN19TR_ResolvedJ9Method24getResolvedVirtualMethodEPN2TR11CompilationEP19TR_OpaqueClassBlockib+0x38 (0x000003FF86018008 [libj9jit29.so+0x198008])
[2022-06-02T22:56:00.798Z] _ZN2J91Z14PrivateLinkage20buildVirtualDispatchEPN2TR4NodeEPNS2_28RegisterDependencyConditionsEPNS2_8RegisterEj+0x365e (0x000003FF863407EE [libj9jit29.so+0x4c07ee])
[2022-06-02T22:56:00.798Z] _ZN2J91Z14PrivateLinkage21buildIndirectDispatchEPN2TR4NodeE+0x11c (0x000003FF863381EC [libj9jit29.so+0x4b81ec])
[2022-06-02T22:56:00.798Z] _ZN3OMR1Z13TreeEvaluator21indirectCallEvaluatorEPN2TR4NodeEPNS2_13CodeGeneratorE+0x4c (0x000003FF8685DE1C [libj9jit29.so+0x9dde1c])
[2022-06-02T22:56:00.798Z] _ZN3OMR13CodeGenerator8evaluateEPN2TR4NodeE+0x64 (0x000003FF86366FA4 [libj9jit29.so+0x4e6fa4])
[2022-06-02T22:56:00.798Z] _ZN3OMR1Z13TreeEvaluator16treetopEvaluatorEPN2TR4NodeEPNS2_13CodeGeneratorE+0x4c (0x000003FF8685DEF4 [libj9jit29.so+0x9ddef4])
[2022-06-02T22:56:00.798Z] _ZN3OMR13CodeGenerator8evaluateEPN2TR4NodeE+0x64 (0x000003FF86366FA4 [libj9jit29.so+0x4e6fa4])
[2022-06-02T22:56:00.798Z] _ZN2J913CodeGenerator22doInstructionSelectionEv+0xd0a (0x000003FF85F9B35A [libj9jit29.so+0x11b35a])
[2022-06-02T22:56:00.798Z] _ZN3OMR12CodeGenPhase32performInstructionSelectionPhaseEPN2TR13CodeGeneratorEPNS1_12CodeGenPhaseE+0x7c (0x000003FF86375A8C [libj9jit29.so+0x4f5a8c])
[2022-06-02T22:56:00.798Z] _ZN3OMR12CodeGenPhase10performAllEv+0x10e (0x000003FF863768BE [libj9jit29.so+0x4f68be])
[2022-06-02T22:56:00.798Z] _ZN3OMR13CodeGenerator12generateCodeEv+0x60 (0x000003FF86372A28 [libj9jit29.so+0x4f2a28])
[2022-06-02T22:56:00.798Z] _ZN3OMR11Compilation7compileEv+0xe28 (0x000003FF863A5D70 [libj9jit29.so+0x525d70])
[2022-06-02T22:56:00.798Z] _ZN2TR28CompilationInfoPerThreadBase7compileEP10J9VMThreadPNS_11CompilationEP17TR_ResolvedMethodR11TR_J9VMBaseP19TR_OptimizationPlanRKNS_16SegmentAllocatorE+0x51c (0x000003FF85FDACBC [libj9jit29.so+0x15acbc])
[2022-06-02T22:56:00.798Z] _ZN2TR28CompilationInfoPerThreadBase14wrappedCompileEP13J9PortLibraryPv+0x38c (0x000003FF85FDBB94 [libj9jit29.so+0x15bb94])
[2022-06-02T22:56:00.798Z] omrsig_protect+0x366 (0x000003FF87233F7E [libj9prt29.so+0x33f7e])
[2022-06-02T22:56:00.798Z] _ZN2TR28CompilationInfoPerThreadBase7compileEP10J9VMThreadP21TR_MethodToBeCompiledRN2J917J9SegmentProviderE+0x332 (0x000003FF85FD97E2 [libj9jit29.so+0x1597e2])
[2022-06-02T22:56:00.798Z] _ZN2TR24CompilationInfoPerThread12processEntryER21TR_MethodToBeCompiledRN2J917J9SegmentProviderE+0x246 (0x000003FF85FD9EE6 [libj9jit29.so+0x159ee6])
[2022-06-02T22:56:00.798Z] _ZN2TR24CompilationInfoPerThread14processEntriesEv+0x3a0 (0x000003FF85FD8AE8 [libj9jit29.so+0x158ae8])
[2022-06-02T22:56:00.798Z] _ZN2TR24CompilationInfoPerThread3runEv+0x38 (0x000003FF85FD8D88 [libj9jit29.so+0x158d88])
[2022-06-02T22:56:00.798Z] _Z30protectedCompilationThreadProcP13J9PortLibraryPN2TR24CompilationInfoPerThreadE+0x9a (0x000003FF85FD8E6A [libj9jit29.so+0x158e6a])
[2022-06-02T22:56:00.798Z] omrsig_protect+0x366 (0x000003FF87233F7E [libj9prt29.so+0x33f7e])
[2022-06-02T22:56:00.798Z] _Z21compilationThreadProcPv+0x20a (0x000003FF85FD9312 [libj9jit29.so+0x159312])
[2022-06-02T22:56:00.798Z] thread_wrapper+0x114 (0x000003FF87185A14 [libj9thr29.so+0x5a14])
[2022-06-02T22:56:00.798Z] start_thread+0xd0 (0x000003FF87D87AA8 [libpthread.so.0+0x7aa8])
[2022-06-02T22:56:00.798Z]  (0x000003FF87B7A11E [libc.so.6+0xfa11e])
[2022-06-02T22:56:00.798Z]  (0x0000000000000000 [<unknown>+0x0])
[2022-06-02T22:56:00.798Z] ---------------------------------------
[2022-06-02T22:56:00.798Z] JVMDUMP039I Processing dump event "gpf", detail "" at 2022/06/02 15:55:39 - please wait.
[2022-06-02T22:56:00.798Z] JVMDUMP032I JVM requested System dump using '/home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/aqa-tests/TKG/output_16541972686168/jdk_rmi_0/work/java/rmi/reliability/benchmark/bench/rmi/Main/core.20220602.155539.32198.0001.dmp' in response to an event
[2022-06-02T22:56:00.798Z] JVMDUMP010I System dump written to /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/aqa-tests/TKG/output_16541972686168/jdk_rmi_0/work/java/rmi/reliability/benchmark/bench/rmi/Main/core.20220602.155539.32198.0001.dmp
[2022-06-02T22:56:00.798Z] JVMDUMP032I JVM requested Java dump using '/home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/aqa-tests/TKG/output_16541972686168/jdk_rmi_0/work/java/rmi/reliability/benchmark/bench/rmi/Main/javacore.20220602.155539.32198.0002.txt' in response to an event
[2022-06-02T22:56:00.798Z] JVMDUMP010I Java dump written to /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/aqa-tests/TKG/output_16541972686168/jdk_rmi_0/work/java/rmi/reliability/benchmark/bench/rmi/Main/javacore.20220602.155539.32198.0002.txt
[2022-06-02T22:56:00.798Z] JVMDUMP032I JVM requested Snap dump using '/home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/aqa-tests/TKG/output_16541972686168/jdk_rmi_0/work/java/rmi/reliability/benchmark/bench/rmi/Main/Snap.20220602.155539.32198.0003.trc' in response to an event
[2022-06-02T22:56:00.798Z] JVMDUMP010I Snap dump written to /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/aqa-tests/TKG/output_16541972686168/jdk_rmi_0/work/java/rmi/reliability/benchmark/bench/rmi/Main/Snap.20220602.155539.32198.0003.trc
[2022-06-02T22:56:00.798Z] JVMDUMP032I JVM requested JIT dump using '/home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/aqa-tests/TKG/output_16541972686168/jdk_rmi_0/work/java/rmi/reliability/benchmark/bench/rmi/Main/jitdump.20220602.155539.32198.0004.dmp' in response to an event
[2022-06-02T22:56:00.798Z] JVMDUMP051I JIT dump occurred in 'JIT Compilation Thread-001' thread 0x00000000009CA300
[2022-06-02T22:56:00.798Z] JVMDUMP049I JIT dump notified all waiting threads of the current method to be compiled
[2022-06-02T22:56:00.798Z] JVMDUMP054I JIT dump is tracing the IL of the method on the crashed compilation thread
[2022-06-02T22:56:00.798Z] JVMDUMP052I JIT dump recursive crash occurred on diagnostic thread
[2022-06-02T22:56:00.798Z] JVMDUMP048I JIT dump method being compiled is an ordinary method
[2022-06-02T22:56:00.798Z] JVMDUMP053I JIT dump is recompiling sun/reflect/GeneratedMethodAccessor4.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;
[2022-06-02T22:56:00.798Z] JVMDUMP052I JIT dump recursive crash occurred on diagnostic thread
[2022-06-02T22:56:00.798Z] JVMDUMP010I JIT dump written to /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/aqa-tests/TKG/output_16541972686168/jdk_rmi_0/work/java/rmi/reliability/benchmark/bench/rmi/Main/jitdump.20220602.155536.32170.0004.dmp
[2022-06-02T22:56:00.798Z] JVMDUMP013I Processed dump event "gpf", detail "".
[2022-06-02T22:56:00.798Z] Error: benchmark 21 failed: java.rmi.UnmarshalException: Error unmarshaling return header; nested exception is: 
[2022-06-02T22:56:00.798Z]  java.io.EOFException
[2022-06-02T22:56:00.798Z] java.rmi.UnmarshalException: Error unmarshaling return header; nested exception is: 
[2022-06-02T22:56:00.798Z]  java.io.EOFException
[2022-06-02T22:56:00.798Z]  at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:254)
[2022-06-02T22:56:00.798Z]  at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:164)
[2022-06-02T22:56:00.798Z]  at java.rmi.server.RemoteObjectInvocationHandler.invokeRemoteMethod(RemoteObjectInvocationHandler.java:235)
[2022-06-02T22:56:00.798Z]  at java.rmi.server.RemoteObjectInvocationHandler.invoke(RemoteObjectInvocationHandler.java:180)
[2022-06-02T22:56:00.798Z]  at bench.rmi.$Proxy21.call(Unknown Source)
[2022-06-02T22:56:00.798Z]  at bench.rmi.RemoteObjArrayCalls.run(RemoteObjArrayCalls.java:80)
[2022-06-02T22:56:00.798Z]  at bench.BenchInfo.runBenchmark(BenchInfo.java:57)
[2022-06-02T22:56:00.798Z]  at bench.Harness.runBenchmarks(Harness.java:213)
[2022-06-02T22:56:00.798Z]  at bench.rmi.Main.runBenchmarks(Main.java:543)
[2022-06-02T22:56:00.798Z]  at bench.rmi.Main.main(Main.java:225)
[2022-06-02T22:56:00.798Z] Caused by: java.io.EOFException
[2022-06-02T22:56:00.798Z]  at java.io.DataInputStream.readByte(DataInputStream.java:267)
[2022-06-02T22:56:00.798Z]  at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:240)
[2022-06-02T22:56:00.798Z]  ... 9 more
[2022-06-02T22:56:00.798Z] Warning: server gc failed: java.rmi.ConnectException: Connection refused to host: 9.30.180.68; nested exception is: 
[2022-06-02T22:56:00.798Z]  java.net.ConnectException: Connection refused (Connection refused)
[2022-06-02T22:56:00.798Z] Error: benchmark 22 failed: java.rmi.ConnectException: Connection refused to host: 9.30.180.68; nested exception is: 
[2022-06-02T22:56:00.798Z]  java.net.ConnectException: Connection refused (Connection refused)
[2022-06-02T22:56:00.798Z] java.rmi.ConnectException: Connection refused to host: 9.30.180.68; nested exception is: 
[2022-06-02T22:56:00.799Z]  java.net.ConnectException: Connection refused (Connection refused)
[2022-06-02T22:56:00.799Z]  at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:623)
[2022-06-02T22:56:00.799Z]  at sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:216)
[2022-06-02T22:56:00.799Z]  at sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:202)
[2022-06-02T22:56:00.799Z]  at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:132)
[2022-06-02T22:56:00.799Z]  at java.rmi.server.RemoteObjectInvocationHandler.invokeRemoteMethod(RemoteObjectInvocationHandler.java:235)
[2022-06-02T22:56:00.799Z]  at java.rmi.server.RemoteObjectInvocationHandler.invoke(RemoteObjectInvocationHandler.java:180)
[2022-06-02T22:56:00.799Z]  at com.sun.proxy.$Proxy0.create(Unknown Source)
[2022-06-02T22:56:00.799Z]  at bench.rmi.ExceptionCalls.run(ExceptionCalls.java:69)
[2022-06-02T22:56:00.799Z]  at bench.BenchInfo.runBenchmark(BenchInfo.java:57)
[2022-06-02T22:56:00.799Z]  at bench.Harness.runBenchmarks(Harness.java:213)
[2022-06-02T22:56:00.799Z]  at bench.rmi.Main.runBenchmarks(Main.java:543)
[2022-06-02T22:56:00.799Z]  at bench.rmi.Main.main(Main.java:225)
[2022-06-02T22:56:00.799Z] Caused by: java.net.ConnectException: Connection refused (Connection refused)
[2022-06-02T22:56:00.799Z]  at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
[2022-06-02T22:56:00.799Z]  at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
[2022-06-02T22:56:00.799Z]  at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
[2022-06-02T22:56:00.799Z]  at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
[2022-06-02T22:56:00.799Z]  at java.net.Socket.connect(Socket.java:607)
[2022-06-02T22:56:00.799Z]  at java.net.Socket.connect(Socket.java:556)
[2022-06-02T22:56:00.799Z]  at java.net.Socket.<init>(Socket.java:452)
[2022-06-02T22:56:00.799Z]  at java.net.Socket.<init>(Socket.java:229)
[2022-06-02T22:56:00.799Z]  at sun.rmi.transport.proxy.RMIDirectSocketFactory.createSocket(RMIDirectSocketFactory.java:40)
[2022-06-02T22:56:00.799Z]  at sun.rmi.transport.proxy.RMIMasterSocketFactory.createSocket(RMIMasterSocketFactory.java:148)
[2022-06-02T22:56:00.799Z]  at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:617)
[2022-06-02T22:56:00.799Z]  ... 11 more
[2022-06-02T22:56:00.799Z] Warning: server gc failed: java.rmi.ConnectException: Connection refused to host: 9.30.180.68; nested exception is: 
[2022-06-02T22:56:00.799Z]  java.net.ConnectException: Connection refused (Connection refused)
[2022-06-02T22:56:00.799Z] JVMDUMP052I JIT dump recursive crash occurred on diagnostic thread
[2022-06-02T22:56:00.799Z] JVMDUMP010I JIT dump written to /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/aqa-tests/TKG/output_16541972686168/jdk_rmi_0/work/java/rmi/reliability/benchmark/bench/rmi/Main/jitdump.20220602.155539.32198.0004.dmp
[2022-06-02T22:56:00.799Z] JVMDUMP013I Processed dump event "gpf", detail "".

[2022-06-02T22:56:00.799Z] TEST RESULT: Failed. Unexpected exit from test [exit code: 255]
[2022-06-02T22:56:00.799Z] --------------------------------------------------
[2022-06-02T23:00:59.793Z] Test results: passed: 121; failed: 1
[2022-06-02T23:01:00.742Z] Report written to /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/jvmtest/openjdk/report/html/report.html
[2022-06-02T23:01:00.742Z] Results written to /home/jenkins/workspace/Test_openjdk8_j9_extended.openjdk_s390x_linux/aqa-tests/TKG/output_16541972686168/jdk_rmi_0/work
[2022-06-02T23:01:00.742Z] Error: Some tests failed or other problems occurred.
[2022-06-02T23:01:00.742Z] 
[2022-06-02T23:01:00.742Z] jdk_rmi_0_FAILED

50x grinder - job/Grinder/24535/

pshipton commented 2 years ago

The grinder failed 100%. vmState [0x5ff04]: {J9VMSTATE_JIT} {InstructionSelection}

0xdaryl commented 2 years ago

@r30shah : please assign for investigation

r30shah commented 2 years ago

I sniffed at the core-dump from the internal jenkins build that @JasonFengJ9 has mentioned in the description. Looking at the function where it fails with the segmentation fault [1] printing the disassembly of the failing function here,

(gdb) disassemble 0x000003FF86015CFA
Dump of assembler code for function TR_J9VMBase::getResolvedVirtualMethod(TR_OpaqueClassBlock*, int, bool):
   0x000003ff86015c78 <+0>: stmg    %r8,%r15,64(%r15)
   0x000003ff86015c7e <+6>: lg  %r1,0(%r2)
   0x000003ff86015c84 <+12>:    lay %r15,-160(%r15)
   0x000003ff86015c8a <+18>:    lgr %r11,%r2
   0x000003ff86015c8e <+22>:    lgr %r8,%r4
   0x000003ff86015c92 <+26>:    lgr %r9,%r5
   0x000003ff86015c96 <+30>:    lgr %r10,%r3
   0x000003ff86015c9a <+34>:    lg  %r1,464(%r1)
   0x000003ff86015ca0 <+40>:    basr    %r14,%r1
   0x000003ff86015ca2 <+42>:    ltr %r2,%r2
   0x000003ff86015ca4 <+44>:    jne 0x3ff86015d1a <TR_J9VMBase::getResolvedVirtualMethod(TR_OpaqueClassBlock*, int, bool)+162>
   0x000003ff86015ca8 <+48>:    larl    %r1,0x3ff86b58d60
   0x000003ff86015cae <+54>:    lgr %r3,%r10
   0x000003ff86015cb2 <+58>:    lg  %r1,0(%r1)
   0x000003ff86015cb8 <+64>:    lg  %r2,0(%r1)
   0x000003ff86015cbe <+70>:    aghi    %r2,236
   0x000003ff86015cc2 <+74>:    brasl   %r14,0x3ff860016f0 <J9::ClassEnv::convertClassOffsetToClassPtr(TR_OpaqueClassBlock*)>
   0x000003ff86015cc8 <+80>:    lg  %r1,0(%r11)
   0x000003ff86015cce <+86>:    lgr %r10,%r2
   0x000003ff86015cd2 <+90>:    llgfr   %r3,%r8
   0x000003ff86015cd6 <+94>:    lgr %r2,%r11
   0x000003ff86015cda <+98>:    lg  %r1,2288(%r1)
   0x000003ff86015ce0 <+104>:   basr    %r14,%r1
   0x000003ff86015ce2 <+106>:   ltg %r2,0(%r2,%r10) // R2 = callOffsetFromVTable R10 = J9Class.
   0x000003ff86015ce8 <+112>:   je  0x3ff86015d1a <TR_J9VMBase::getResolvedVirtualMethod(TR_OpaqueClassBlock*, int, bool)+162>
   0x000003ff86015cec <+116>:   lg  %r1,24(%r11)
   0x000003ff86015cf2 <+122>:   tm  1309(%r1),8
   0x000003ff86015cf6 <+126>:   jne 0x3ff86015d12 <TR_J9VMBase::getResolvedVirtualMethod(TR_OpaqueClassBlock*, int, bool)+154>
   0x000003ff86015cfa <+130>:   ltg %r1,0(%r2)             // IT FAILS HERE TRYING TO DEREFERENCE R2 

It fails trying to get the J9Method of the virtual method from the J9Class* at virtual call offset from VTable. Call chain that ends up calling this getResolvedVirtualMethod is as following.

TR_J9VMBase::getResolvedVirtualMethod(TR_OpaqueClassBlock*, int, bool)
TR_ResolvedJ9Method::getResolvedVirtualMethod(TR::Compilation*, TR_OpaqueClassBlock*, int, bool)
J9::Z::PrivateLinkage::buildVirtualDispatch(TR::Node*, TR::RegisterDependencyConditions*, TR::Register*, unsigned int)

Looking at the point where we call getResolvedVirtualMethod in `buildVirtualDispatch)

0x3ff8634079e +13838 ~    c0e5ffe296bd brasl     %r14, 0x3ff85f93518 ^{libj9jit29.so}{_ZN2J913CodeGenerator36isProfiledClassAndCallSiteCompatibleEP19TR_OpaqueClassBlockS2_} +0
0x3ff863407a4 +13844 ~    4220f14f     stc       %r2, 0x14f(%r15)
0x3ff863407a8 +13848 ~    1222         ltr       %r2, %r2
0x3ff863407aa +13850 ~    a784f19d     je        0x3ff8633eae4 C>> ^+6484
0x3ff863407ae +13854 ~    e31070080004 lg        %r1, 8(%r7)
0x3ff863407b4 +13860 ~    b9040028     lgr       %r2, %r8
0x3ff863407b8 +13864 ~    a7690001     lghi      %r6, 1
0x3ff863407bc +13868 ~    e33010080004 lg        %r3, 8(%r1)
0x3ff863407c2 +13874 ~    c0e500058c6f brasl     %r14, 0x3ff863f20a0 {libj9jit29.so}{_ZN3OMR15SymbolReference15getOwningMethodEPN2TR11CompilationE} +0
0x3ff863407c8 +13880 ~    e31020000004 lg        %r1, 0(%r2)
0x3ff863407ce +13886 ~    e33070080004 lg        %r3, 8(%r7)
0x3ff863407d4 +13892 ~    e350801c0014 lgf       %r5, 0x1c(%r8)
0x3ff863407da +13898 ~    e340f1400004 lg        %r4, 0x140(%r15)
0x3ff863407e0 +13904 ~    e31014000004 lg        %r1, 0x400(%r1)
0x3ff863407e6 +13910 ~    e33030080004 lg        %r3, 8(%r3)
0x3ff863407ec +13916 ~    0de1         basr      %r14, %r1
0x3ff863407ee +13918 ~    b9020012     ltgr      %r1, %r2

It seems like the call is coming from [2] where it is trying to get the virtual method from the profiled class. We did recently made a change in this area [3], where profiled directed devirtualization was enable on Z. So this seems to be new failure caused by [3]. @Spencer-Comin let's take a look at this failure and see if there is an issue with profiled class or something else.

[1]. https://github.com/eclipse-openj9/openj9/blob/4b548aa58c694b4b103c7e8cefcc6782f4e34b7d/runtime/compiler/env/j9method.cpp#L7183-L7205 [2]. https://github.com/eclipse-openj9/openj9/blob/4b548aa58c694b4b103c7e8cefcc6782f4e34b7d/runtime/compiler/z/codegen/S390PrivateLinkage.cpp#L1832 [3]. https://github.com/eclipse-openj9/openj9/commit/6e05d8c18463f07d928883218b97103e272fcc44

Spencer-Comin commented 2 years ago

Comparing the profile-directed devirtualization in J9::Z::PrivateLinkage::buildVirtualDispatch [1] with the equivalent codegen code for X [2], X has a check for (callNode->getSymbolReference() != comp()->getSymRefTab()->findObjectNewInstanceImplSymbol()) that is not found in Z. I'm not exactly sure why that check is there in X, but inserting it into the Z code [3] fixes this failure.

[1]. https://github.com/eclipse-openj9/openj9/blob/d4df04f898bf16503d0e404e3b11acb9ff893dd8/runtime/compiler/z/codegen/S390PrivateLinkage.cpp#L1801-L1805 [2]. https://github.com/eclipse-openj9/openj9/blob/d4df04f898bf16503d0e404e3b11acb9ff893dd8/runtime/compiler/x/codegen/X86PrivateLinkage.cpp#L1320-L1323 [3]. https://github.com/Spencer-Comin/openj9/commit/2e6f21645f84a21b58b0272905e2dc6d59e32072#diff-ad78dee10efc18355c205b7949223951d627fe5d678979e0bd25b1eb32d3c2de

diff --git a/runtime/compiler/z/codegen/S390PrivateLinkage.cpp b/runtime/compiler/z/codegen/S390PrivateLinkage.cpp
index ff2af31bc29..9ed597e3e11 100644
--- a/runtime/compiler/z/codegen/S390PrivateLinkage.cpp
+++ b/runtime/compiler/z/codegen/S390PrivateLinkage.cpp
@@ -1800,6 +1800,7 @@ J9::Z::PrivateLinkage::buildVirtualDispatch(TR::Node * callNode, TR::RegisterDep

          if (!performGuardedDevirtualization &&
              !comp()->getOption(TR_DisableInterpreterProfiling) &&
+             (callNode->getSymbolReference() != comp()->getSymRefTab()->findObjectNewInstanceImplSymbol()) &&
              TR_ValueProfileInfoManager::get(comp()) && resolvedMethod
              )
             {
r30shah commented 2 years ago

@Spencer-Comin Looking at the code that we generate for Class.newInstance [1] and other places in codegen, I do see that this method is specially treated by JIT. Looking at newInstanceImpl call in that method[2] , it is actually a static call to native method. We do have to treat this call specially and it will be incorrect to find this method in the vtable of the class. If grinders and builds are working, I would say let's go ahead with the fix with the commit documenting this.

[1]. https://github.com/eclipse-openj9/openj9/blob/d2e1f22d76429d35ef3420c200a36eb87a977b9a/runtime/compiler/ilgen/Walker.cpp#L4305-L4323 [2]. https://github.com/eclipse-openj9/openj9/blob/d2e1f22d76429d35ef3420c200a36eb87a977b9a/jcl/src/java.base/share/classes/java/lang/Class.java#L2672

pshipton commented 2 years ago

Re-opening until the fix is added to the 0.33 release.