search

eclipse-openj9 / openj9

Eclipse OpenJ9: A Java Virtual Machine for OpenJDK that's optimized for small footprint, fast start-up, and high throughput. Builds on Eclipse OMR (https://github.com/eclipse/omr) and combines with the Extensions for OpenJDK for OpenJ9 repo.
Other
3.24k stars 714 forks source link

Crash when allocating memory #12766

Closed pwagland closed 3 years ago

pwagland commented 3 years ago

Java -version output

Output from java -version.

# java -version
openjdk version "11.0.10" 2021-01-19
OpenJDK Runtime Environment AdoptOpenJDK (build 11.0.10+9)
Eclipse OpenJ9 VM AdoptOpenJDK (build openj9-0.24.0, JRE 11 Linux amd64-64-Bit Compressed References 20210120_910 (JIT enabled, AOT enabled)
OpenJ9   - 345e1b09e
OMR      - 741e94ea8
JCL      - 0a86953833 based on jdk-11.0.10+9)

Summary of problem

We have seen an issue where relatively unused, but not totally idle, systems are crashing after about two weeks when running using Java 11.0.10. This cannot be reproduced at will, it seems that about 5% of our containers will die after about two weeks.

Diagnostic files

We have the following printed to stdout:

Unhandled exception
Type=Segmentation error vmState=0x00020019
J9Generic_Signal_Number=00000018 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
Handler1=00007FEC4293DCB0 Handler2=00007FEC426A49C0 InaccessibleAddress=0000000000000000
RDI=00007FEC22921E40 RSI=00007FEC22922008 RAX=0000000000000000 RBX=00007FEC22921E40
RCX=0000000000000000 RDX=0000000000000000 R8=0000000000000059 R9=0000000000000000
R10=0000000000000001 R11=00000000000001B0 R12=FFFFFFFFFFFFFFFF R13=FFFFFFFFFFFFFFFF
R14=0000000000000000 R15=0000000000000000
RIP=00007FEC426A9E2C GS=0000 FS=0000 RSP=00007FEC22921DC0
EFlags=0000000000010206 CS=0033 RBP=0000000000000F39 ERR=0000000000000004
TRAPNO=000000000000000E OLDMASK=0000000000000000 CR2=0000000000000000
xmm0 0000003000000018 (f: 24.000000, d: 1.018558e-312)
xmm1 255b73250909000a (f: 151584784.000000, d: 9.900128e-129)
xmm2 09000a7025203d20 (f: 622869760.000000, d: 2.487363e-265)
xmm3 616e696c61746163 (f: 1635017088.000000, d: 2.137814e+161)
xmm4 736e6f697461746f (f: 1952543872.000000, d: 1.064003e+248)
xmm5 74706f2f3a72616a (f: 980574592.000000, d: 7.530572e+252)
xmm6 6c632f6565326a2f (f: 1697802752.000000, d: 1.291731e+214)
xmm7 000a3e2f20222e2e (f: 539110976.000000, d: 1.424451e-308)
xmm8 6332313578766100 (f: 2021024000.000000, d: 6.865676e+169)
xmm9 0000000000000000 (f: 0.000000, d: 0.000000e+00)
xmm10 0000000000000000 (f: 0.000000, d: 0.000000e+00)
xmm11 ca62c1d6ca62c1d6 (f: 3395469824.000000, d: -2.193092e+50)
xmm12 0000000000000000 (f: 0.000000, d: 0.000000e+00)
xmm13 0000000000000000 (f: 0.000000, d: 0.000000e+00)
xmm14 0000000000000000 (f: 0.000000, d: 0.000000e+00)
xmm15 0000000000000000 (f: 0.000000, d: 0.000000e+00)
Module=/opt/java/openjdk/lib/compressedrefs/libj9prt29.so
Module_base_address=00007FEC4267B000
Target=2_90_20210120_910 (Linux 5.4.0-1041-aws)
CPU=amd64 (8 logical CPUs) (0x7d73be000 RAM)
----------- Stack Backtrace -----------
(0x00007FEC426A9E2C [libj9prt29.so+0x2ee2c])
(0x00007FEC426ABF73 [libj9prt29.so+0x30f73])
(0x00007FEC426982A0 [libj9prt29.so+0x1d2a0])
(0x00007FEC4269846F [libj9prt29.so+0x1d46f])
(0x00007FEC4057FC98 [libj9vrb29.so+0x58c98])
(0x00007FEC4057F604 [libj9vrb29.so+0x58604])
(0x00007FEC4057C2B2 [libj9vrb29.so+0x552b2])
(0x00007FEC4225B3BE [libj9hookable29.so+0x13be])
(0x00007FEC408E996C [libj9gc29.so+0x11096c])
(0x00007FEC408EA67C [libj9gc29.so+0x11167c])
(0x00007FEC409103C2 [libj9gc29.so+0x1373c2])
(0x00007FEC4081F43F [libj9gc29.so+0x4643f])
(0x00007FEC415F679A [libj9jit29.so+0x94b79a])
(0x00007FEC41609091 [libj9jit29.so+0x95e091])
---------------------------------------
JVMDUMP039I Processing dump event "gpf", detail "" at 2021/04/05 20:32:18 - please wait.
JVMDUMP032I JVM requested System dump using '/opt/redwood/j2ee/cluster/server1/logs/core.20210405.203218.6.0001.dmp' in response to an event
JVMPORT030W /proc/sys/kernel/core_pattern setting "|/usr/share/apport/apport %p %s %c %d %P %E" specifies that the core dump is to be piped to an external program.  Attempting to rename either core or core.13709.

JVMDUMP012E Error in System dump: The core file created by child process with pid = 13709 was not found. Expected to find core file with name "/opt/redwood/j2ee/cluster/server1/logs/core"
JVMDUMP032I JVM requested Java dump using '/opt/redwood/j2ee/cluster/server1/logs/javacore.20210405.203218.6.0002.txt' in response to an event
JVMDUMP010I Java dump written to /opt/redwood/j2ee/cluster/server1/logs/javacore.20210405.203218.6.0002.txt
JVMDUMP032I JVM requested Snap dump using '/opt/redwood/j2ee/cluster/server1/logs/Snap.20210405.203218.6.0003.trc' in response to an event
JVMDUMP010I Snap dump written to /opt/redwood/j2ee/cluster/server1/logs/Snap.20210405.203218.6.0003.trc
JVMDUMP032I JVM requested JIT dump using '/opt/redwood/j2ee/cluster/server1/logs/jitdump.20210405.203218.6.0004.dmp' in response to an event

For each crash, it appears to be crashing while allocating a byte array. Five thread dumps from the thread that is running at the points of the crashes:

1XMCURTHDINFO  Current thread
3XMTHREADINFO      "prometheus-http-1-5" J9VMThread:0x0000000001C86600, omrthread_t:0x00007FDD2A091E48, java/lang/Thread:0x000000003E037B08, state:R, prio=5
3XMJAVALTHREAD            (java/lang/Thread getId:0x60, isDaemon:true)
3XMTHREADINFO1            (native thread ID:0x23A, native priority:0x5, native policy:UNKNOWN, vmstate:R, vm thread flags:0x00001020)
3XMTHREADINFO2            (native stack address range from:0x00007FDD801B3000, to:0x00007FDD801F3000, size:0x40000)
3XMCPUTIME               CPU usage total: 673.448960685 secs, current category="Application"
3XMHEAPALLOC             Heap bytes allocated since last GC cycle=48 (0x30)
3XMTHREADINFO3           Java callstack:
4XESTACKTRACE                at java/lang/StringUTF16.newBytesFor(StringUTF16.java:52(Compiled Code))
4XESTACKTRACE                at java/lang/String.<init>(String.java:873(Compiled Code))
4XESTACKTRACE                at java/lang/String.substring(String.java:2684(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/jmx/JmxCollector$Receiver.angleBrackets(JmxCollector.java:327(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/jmx/JmxCollector$Receiver.recordBean(JmxCollector.java:407(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/jmx/JmxScraper.processBeanValue(JmxScraper.java:202(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/jmx/JmxScraper.processBeanValue(JmxScraper.java:219(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/jmx/JmxScraper.scrapeBean(JmxScraper.java:165(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/jmx/JmxScraper.doScrape(JmxScraper.java:117(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/jmx/JmxCollector.collect(JmxCollector.java:547(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/client/CollectorRegistry$MetricFamilySamplesEnumeration.findNextElement(CollectorRegistry.java:207(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/client/CollectorRegistry$MetricFamilySamplesEnumeration.nextElement(CollectorRegistry.java:240(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/client/CollectorRegistry$MetricFamilySamplesEnumeration.nextElement(CollectorRegistry.java:161(Compiled Code))
--
1XMCURTHDINFO  Current thread
3XMTHREADINFO      "Redwood SAPService Job Worker (PW2) worker 5: 37641776/2373815559" J9VMThread:0x0000000003633000, omrthread_t:0x00007F678023F6F8, java/lang/Thread:0x00000000CEED8788, state:R, prio=5
3XMJAVALTHREAD            (java/lang/Thread getId:0x1438FB, isDaemon:true)
3XMTHREADINFO1            (native thread ID:0x15E, native priority:0x5, native policy:UNKNOWN, vmstate:R, vm thread flags:0x00001020)
3XMTHREADINFO2            (native stack address range from:0x00007F66E5077000, to:0x00007F66E50B7000, size:0x40000)
3XMCPUTIME               CPU usage total: 0.284293639 secs, current category="Application"
3XMHEAPALLOC             Heap bytes allocated since last GC cycle=120 (0x78)
3XMTHREADINFO3           Java callstack:
4XESTACKTRACE                at java/io/ObjectInputStream.readClassDescriptor(ObjectInputStream.java:1086(Compiled Code))
4XESTACKTRACE                at java/io/ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:2106(Compiled Code))
4XESTACKTRACE                at java/io/ObjectInputStream.readClassDesc(ObjectInputStream.java:1984(Compiled Code))
4XESTACKTRACE                at java/io/ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:2134(Compiled Code))
4XESTACKTRACE                at java/io/ObjectInputStream.readClassDesc(ObjectInputStream.java:1984(Compiled Code))
4XESTACKTRACE                at java/io/ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2291(Compiled Code))
4XESTACKTRACE                at java/io/ObjectInputStream.readObject0(ObjectInputStream.java:1801(Compiled Code))
4XESTACKTRACE                at java/io/ObjectInputStream.defaultReadFields(ObjectInputStream.java:2593(Compiled Code))
4XESTACKTRACE                at java/io/ObjectInputStream.readSerialData(ObjectInputStream.java:2485(Compiled Code))
4XESTACKTRACE                at java/io/ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2318(Compiled Code))
4XESTACKTRACE                at java/io/ObjectInputStream.readObject0(ObjectInputStream.java:1801(Compiled Code))
4XESTACKTRACE                at java/io/ObjectInputStream.readObject(ObjectInputStream.java:577(Compiled Code))
4XESTACKTRACE                at java/io/ObjectInputStream.readObject(ObjectInputStream.java:487(Compiled Code))
--
1XMCURTHDINFO  Current thread
3XMTHREADINFO      "prometheus-http-1-1" J9VMThread:0x0000000000848300, omrthread_t:0x00007FEBC804E280, java/lang/Thread:0x00000000B5BCE5B8, state:R, prio=5
3XMJAVALTHREAD            (java/lang/Thread getId:0x1D, isDaemon:true)
3XMTHREADINFO1            (native thread ID:0x1A0, native priority:0x5, native policy:UNKNOWN, vmstate:R, vm thread flags:0x00001020)
3XMTHREADINFO2            (native stack address range from:0x00007FEC228E6000, to:0x00007FEC22926000, size:0x40000)
3XMCPUTIME               CPU usage total: 458.608757753 secs, current category="Application"
3XMHEAPALLOC             Heap bytes allocated since last GC cycle=168 (0xA8)
3XMTHREADINFO3           Java callstack:
4XESTACKTRACE                at java/util/Arrays.copyOf(Arrays.java:3776(Compiled Code))
4XESTACKTRACE                at java/lang/AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:172(Compiled Code))
4XESTACKTRACE                at java/lang/AbstractStringBuilder.append(AbstractStringBuilder.java:538(Compiled Code))
4XESTACKTRACE                at java/lang/StringBuilder.append(StringBuilder.java:174(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/jmx/JmxCollector$Receiver.recordBean(JmxCollector.java:419(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/jmx/JmxScraper.processBeanValue(JmxScraper.java:202(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/jmx/JmxScraper.scrapeBean(JmxScraper.java:165(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/jmx/JmxScraper.doScrape(JmxScraper.java:117(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/jmx/JmxCollector.collect(JmxCollector.java:547(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/client/CollectorRegistry$MetricFamilySamplesEnumeration.findNextElement(CollectorRegistry.java:207(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/client/CollectorRegistry$MetricFamilySamplesEnumeration.<init>(CollectorRegistry.java:171(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/client/CollectorRegistry.filteredMetricFamilySamples(CollectorRegistry.java:158(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/client/exporter/HTTPServer$HTTPMetricHandler.handle(HTTPServer.java:73(Compiled Code))
--
1XMCURTHDINFO  Current thread
3XMTHREADINFO      "prometheus-http-1-1" J9VMThread:0x000000000089CD00, omrthread_t:0x00007FBD90023700, java/lang/Thread:0x00000000B5BF9E18, state:R, prio=5
3XMJAVALTHREAD            (java/lang/Thread getId:0x1D, isDaemon:true)
3XMTHREADINFO1            (native thread ID:0x176, native priority:0x5, native policy:UNKNOWN, vmstate:R, vm thread flags:0x00001020)
3XMTHREADINFO2            (native stack address range from:0x00007FBDEC990000, to:0x00007FBDEC9D0000, size:0x40000)
3XMCPUTIME               CPU usage total: 531.160072914 secs, current category="Application"
3XMHEAPALLOC             Heap bytes allocated since last GC cycle=48 (0x30)
3XMTHREADINFO3           Java callstack:
4XESTACKTRACE                at java/nio/CharBuffer.wrap(CharBuffer.java:393(Compiled Code))
4XESTACKTRACE                at sun/nio/cs/StreamEncoder.implWrite(StreamEncoder.java:280(Compiled Code))
4XESTACKTRACE                at sun/nio/cs/StreamEncoder.write(StreamEncoder.java:125(Compiled Code))
5XESTACKTRACE                   (entered lock: java/io/OutputStreamWriter@0x00000000FD700100, entry count: 1)
4XESTACKTRACE                at sun/nio/cs/StreamEncoder.write(StreamEncoder.java:113(Compiled Code))
4XESTACKTRACE                at java/io/OutputStreamWriter.write(OutputStreamWriter.java:190(Compiled Code))
4XESTACKTRACE                at java/io/Writer.append(Writer.java:389(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/client/exporter/common/TextFormat.writeEscapedLabelValue(TextFormat.java:163(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/client/exporter/common/TextFormat.writeOpenMetrics100(TextFormat.java:227(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/client/exporter/common/TextFormat.writeFormat(TextFormat.java:51(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/client/exporter/HTTPServer$HTTPMetricHandler.handle(HTTPServer.java:72(Compiled Code))
4XESTACKTRACE                at com/sun/net/httpserver/Filter$Chain.doFilter(Filter.java:77(Compiled Code))
4XESTACKTRACE                at sun/net/httpserver/AuthFilter.doFilter(AuthFilter.java:82(Compiled Code))
--
1XMCURTHDINFO  Current thread
3XMTHREADINFO      "prometheus-http-1-5" J9VMThread:0x0000000001B09000, omrthread_t:0x00007F85BE234E98, java/lang/Thread:0x00000000B7918D80, state:R, prio=5
3XMJAVALTHREAD            (java/lang/Thread getId:0x59, isDaemon:true)
3XMTHREADINFO1            (native thread ID:0x1E9, native priority:0x5, native policy:UNKNOWN, vmstate:R, vm thread flags:0x00001020)
3XMTHREADINFO2            (native stack address range from:0x00007F85D5F47000, to:0x00007F85D5F87000, size:0x40000)
3XMCPUTIME               CPU usage total: 437.638728897 secs, current category="Application"
3XMHEAPALLOC             Heap bytes allocated since last GC cycle=16 (0x10)
3XMTHREADINFO3           Java callstack:
4XESTACKTRACE                at java/lang/StringUTF16.newString(StringUTF16.java:1025(Compiled Code))
4XESTACKTRACE                at java/lang/StringBuilder.toString(StringBuilder.java:449(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/jmx/JmxCollector$Receiver.recordBean(JmxCollector.java:419(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/jmx/JmxScraper.processBeanValue(JmxScraper.java:202(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/jmx/JmxScraper.scrapeBean(JmxScraper.java:165(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/jmx/JmxScraper.doScrape(JmxScraper.java:117(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/jmx/JmxCollector.collect(JmxCollector.java:547(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/client/CollectorRegistry$MetricFamilySamplesEnumeration.findNextElement(CollectorRegistry.java:207(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/client/CollectorRegistry$MetricFamilySamplesEnumeration.<init>(CollectorRegistry.java:171(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/client/CollectorRegistry.filteredMetricFamilySamples(CollectorRegistry.java:158(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/client/exporter/HTTPServer$HTTPMetricHandler.handle(HTTPServer.java:73(Compiled Code))
4XESTACKTRACE                at com/sun/net/httpserver/Filter$Chain.doFilter(Filter.java:77(Compiled Code))
4XESTACKTRACE                at sun/net/httpserver/AuthFilter.doFilter(AuthFilter.java:82(Compiled Code))
--
1XMCURTHDINFO  Current thread
3XMTHREADINFO      "prometheus-http-1-4" J9VMThread:0x0000000001BBA000, omrthread_t:0x00007F74DC03A198, java/lang/Thread:0x00000000B78C8400, state:R, prio=5
3XMJAVALTHREAD            (java/lang/Thread getId:0x59, isDaemon:true)
3XMTHREADINFO1            (native thread ID:0x1D0, native priority:0x5, native policy:UNKNOWN, vmstate:R, vm thread flags:0x00001020)
3XMTHREADINFO2            (native stack address range from:0x00007F75B64FC000, to:0x00007F75B653C000, size:0x40000)
3XMCPUTIME               CPU usage total: 481.542926489 secs, current category="Application"
3XMHEAPALLOC             Heap bytes allocated since last GC cycle=23816 (0x5D08)
3XMTHREADINFO3           Java callstack:
4XESTACKTRACE                at java/util/Arrays.copyOf(Arrays.java:3776(Compiled Code))
4XESTACKTRACE                at java/lang/AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:172(Compiled Code))
4XESTACKTRACE                at java/lang/AbstractStringBuilder.append(AbstractStringBuilder.java:538(Compiled Code))
4XESTACKTRACE                at java/lang/StringBuilder.append(StringBuilder.java:174(Compiled Code))
4XESTACKTRACE                at org/apache/catalina/loader/WebappLoader.getLoaderRepositoriesString(WebappLoader.java:339(Compiled Code))
4XESTACKTRACE                at jdk/internal/reflect/GeneratedMethodAccessor324.invoke(Bytecode PC:36(Compiled Code))
4XESTACKTRACE                at jdk/internal/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43(Compiled Code))
4XESTACKTRACE                at java/lang/reflect/Method.invoke(Method.java:566(Compiled Code))
4XESTACKTRACE                at org/apache/tomcat/util/modeler/BaseModelMBean.getAttribute(BaseModelMBean.java:177(Compiled Code))
4XESTACKTRACE                at org/apache/tomcat/util/modeler/BaseModelMBean.getAttributes(BaseModelMBean.java:221(Compiled Code))
4XESTACKTRACE                at com/sun/jmx/interceptor/DefaultMBeanServerInterceptor.getAttributes(DefaultMBeanServerInterceptor.java:701(Compiled Code))
4XESTACKTRACE                at com/sun/jmx/mbeanserver/JmxMBeanServer.getAttributes(JmxMBeanServer.java:705(Compiled Code))
4XESTACKTRACE                at io/prometheus/jmx/shaded/io/prometheus/jmx/JmxScraper.scrapeBean(JmxScraper.java:151(Compiled Code))

We do have Snap, javacore, and verbosegc files for each crash. I can share these directly with someone investigating this issue further.

What can we do to help diagnose this further?

pshipton commented 3 years ago

@dmitripivkine fyi @manqingl can you help decode the stack trace pls.

@pwagland is there any system core file? It's unlikely we can do much without one.

manqingl commented 3 years ago

Looks like IJ30975

https://www.ibm.com/support/pages/apar/IJ30975

(0x00007FEC426A9E2C [libj9prt29.so+0x2ee2c]) : 0x2ee2c <writeSpec+44> [../../../../../../omr/port/common/omrstr.c:727]
(0x00007FEC426ABF73 [libj9prt29.so+0x30f73]) : 0x30f73 <omrstr_vprintf+1859> [../../../../../../omr/port/common/omrstr.c:1020]
(0x00007FEC426982A0 [libj9prt29.so+0x1d2a0]) : 0x1d2a0 <omrfile_vprintf+64> [../../../../../../omr/port/unix/omrfile.c:939]
(0x00007FEC4269846F [libj9prt29.so+0x1d46f]) : 0x1d46f <omrfile_printf+207> [../../../../../../omr/port/unix/omrfile.c:984]
(0x00007FEC4057FC98 [libj9vrb29.so+0x58c98]) : 0x58c98 <MM_VerboseWriterFileLoggingSynchronous [../../../../../../omr/gc/verbose/VerboseWriterFileLoggingSynchronous.cpp:129]
(0x00007FEC4057F604 [libj9vrb29.so+0x58604]) : 0x58604 <MM_VerboseWriterChain [../../../../../../omr/gc/verbose/VerboseWriterChain.cpp:126]
(0x00007FEC4057C2B2 [libj9vrb29.so+0x552b2]) : 0x552b2 <MM_VerboseHandlerOutput [../../../../../../omr/gc/verbose/VerboseHandlerOutput.cpp:547]
(0x00007FEC4225B3BE [libj9hookable29.so+0x13be]) : 0x13be <J9HookDispatch(J9HookInterface**, uintptr_t, void*)+302> [../../../../../../../omr/util/hookable/hookable.cpp:238]
(0x00007FEC408E996C [libj9gc29.so+0x11096c]) : 0x11096c <MM_EnvironmentBase [../../../../../../omr/gc/base/EnvironmentBase.cpp:233]
(0x00007FEC408EA67C [libj9gc29.so+0x11167c]) : 0x11167c <MM_EnvironmentBase [../../../../../../omr/gc/base/EnvironmentBase.cpp:496]
(0x00007FEC409103C2 [libj9gc29.so+0x1373c2]) : 0x1373c2 <OMR_GC_AllocateObject(OMR_VMThread*, MM_AllocateInitialization*)+482> [../../../../../../omr/gc/base/AllocateInitialization.hpp:243]
(0x00007FEC4081F43F [libj9gc29.so+0x4643f]) : 0x4643f <J9AllocateIndexableObject(J9VMThread*, J9Class*, uint32_t, uintptr_t)+1759> [../../../../../openj9/runtime/gc_modron_startup/mgcalloc.cpp:550]
(0x00007FEC415F679A [libj9jit29.so+0x94b79a]) : 0x94b79a <old_slow_jitNewArray(J9VMThread*)+186> [../../../../../openj9/runtime/codert_vm/cnathelp.cpp:1182]
(0x00007FEC41609091 [libj9jit29.so+0x95e091]) : 0x95e091 <jitNewArray+97> [/home/adoptopenjdk/workspace/build-scripts/jobs/jdk11u/jdk11u-linux-x64-openj9/workspace/build/src/build/linux-x86_64-normal-server-release/vm/runtime/codert_vm/xnathelp.s:595]
pshipton commented 3 years ago

@pwagland this is a known problem which has since been fixed (https://github.com/eclipse/omr/pull/5806), please use a newer build.

pwagland commented 3 years ago

Thank you for the prompt reply! We will try the 11.0.11 release.