search

eclipse-openj9 / openj9

Eclipse OpenJ9: A Java Virtual Machine for OpenJDK that's optimized for small footprint, fast start-up, and high throughput. Builds on Eclipse OMR (https://github.com/eclipse/omr) and combines with the Extensions for OpenJDK for OpenJ9 repo.
Other
3.28k stars 722 forks source link

JVM crash during build on jdk15u/next-linux-aarch64-openj9-linuxXL #10527

Closed austin0 closed 4 years ago

austin0 commented 4 years ago

Failure link

Issue has been seen on on jdk15u-aarch64-linuxXL and jdk-aarch64.

Crash seems to have occurred four times over the weekend.

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-linux-aarch64-openj9-linuxXL/28/console

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-linux-aarch64-openj9-linuxXL/26/console

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-aarch64-openj9/106/console

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-aarch64-openj9/105/console

Doesn't seem to be an issue with extensions repo and last commits differ greatly https://github.com/ibmruntimes/openj9-openjdk-jdk15/compare/19a2c9b2d...ad829e12c https://github.com/ibmruntimes/openj9-openjdk-jdk/compare/fcdb916f3...9c2ab6c26

Failure output

22:06:43  Creating jdk image
22:06:47  WARNING: Using incubator modules: jdk.incubator.jpackage, jdk.incubator.foreign
22:07:03  #0: /home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/build/linux-aarch64-server-release/jdk/lib/default/libj9jit29.so(+0x6f0354) [0x4000206f0354]
22:07:03  #1: /home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/build/linux-aarch64-server-release/jdk/lib/default/libj9jit29.so(+0x6fb3b8) [0x4000206fb3b8]
22:07:03  #2: /home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/build/linux-aarch64-server-release/jdk/lib/default/libj9jit29.so(+0x1106ac) [0x4000201106ac]
22:07:03  #3: /home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/build/linux-aarch64-server-release/jdk/lib/default/libj9prt29.so(+0x240f0) [0x40001ba010f0]
22:07:03  Unhandled exception
22:07:03  Type=Segmentation error vmState=0x0005ff09
22:07:03  J9Generic_Signal_Number=00000018 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
22:07:03  Handler1=000040001B8A252C Handler2=000040001BA00F78 InaccessibleAddress=000000000000006C
22:07:03  R0=00000000000000E1 R1=00000000F9400000 R2=000040009BEBFF4C R3=00004000DC0068A0
22:07:03  R4=000040002097D000 R5=00004000DC0068A0 R6=0000000038000000 R7=0000000000000004
22:07:03  R8=0000000000000000 R9=0000000000000024 R10=0000000000000006 R11=0000000000000007
22:07:03  R12=0000400105456510 R13=0000000000000007 R14=0000000000000001 R15=0000000000000005
22:07:03  R16=000040001B9BB328 R17=000040001B2F5E1C R18=0000000000000002 R19=000040009BEBFF4C
22:07:03  R20=000040010558BE50 R21=0000000000000000 R22=0000000000000000 R23=00004000ABB3D4A8
22:07:03  R24=0000000000000000 R25=000040010558BEA0 R26=00004000DC0068A0 R27=00004000DC0068A0
22:07:03  R28=00004000ABB403D8 R29=00004000ABB3FF60 R30=00004000207429E8 R31=00004000ABB3D300
22:07:03  PC=0000400020742B9C SP=00004000ABB3D300 PSTATE=0000000080000000
22:07:03  V0 0000004004000303 (f: 67109632.000000, d: 1.358409e-312)
22:07:03  V1 0000004004000000 (f: 67108864.000000, d: 1.358409e-312)
22:07:03  V2 000040001b7f99f0 (f: 461347328.000000, d: 3.476701e-310)
22:07:03  V3 0000000200000001 (f: 1.000000, d: 4.243992e-314)
22:07:03  V4 0000004000000040 (f: 64.000000, d: 1.358077e-312)
22:07:03  V5 0000000400000004 (f: 4.000000, d: 8.487983e-314)
22:07:03  V6 0000000000000000 (f: 0.000000, d: 0.000000e+00)
22:07:03  V7 0000000000000000 (f: 0.000000, d: 0.000000e+00)
22:07:03  V8 0000000000000000 (f: 0.000000, d: 0.000000e+00)
22:07:03  V9 0000000000000000 (f: 0.000000, d: 0.000000e+00)
22:07:03  V10 0000000000000000 (f: 0.000000, d: 0.000000e+00)
22:07:03  V11 0000000000000000 (f: 0.000000, d: 0.000000e+00)
22:07:03  V12 0000000000000000 (f: 0.000000, d: 0.000000e+00)
22:07:03  V13 0000000000000000 (f: 0.000000, d: 0.000000e+00)
22:07:03  V14 0000000000000000 (f: 0.000000, d: 0.000000e+00)
22:07:03  V15 0000000000000000 (f: 0.000000, d: 0.000000e+00)
22:07:03  V16 0000000000000001 (f: 1.000000, d: 4.940656e-324)
22:07:03  V17 0f0f0f0f0f0f0f0f (f: 252645136.000000, d: 3.815737e-236)
22:07:03  V18 5555555555555555 (f: 1431655808.000000, d: 1.194531e+103)
22:07:03  V19 0000000000000000 (f: 0.000000, d: 0.000000e+00)
22:07:03  V20 0000000000000000 (f: 0.000000, d: 0.000000e+00)
22:07:03  V21 0000000000000000 (f: 0.000000, d: 0.000000e+00)
22:07:03  V22 0000000000000000 (f: 0.000000, d: 0.000000e+00)
22:07:03  V23 0000000000000000 (f: 0.000000, d: 0.000000e+00)
22:07:03  V24 0000000000000000 (f: 0.000000, d: 0.000000e+00)
22:07:03  V25 0000000000000000 (f: 0.000000, d: 0.000000e+00)
22:07:03  V26 0000000000000000 (f: 0.000000, d: 0.000000e+00)
22:07:03  V27 0000000000000000 (f: 0.000000, d: 0.000000e+00)
22:07:03  V28 0000000000000000 (f: 0.000000, d: 0.000000e+00)
22:07:03  V29 0000000000000000 (f: 0.000000, d: 0.000000e+00)
22:07:03  V30 0000000000000000 (f: 0.000000, d: 0.000000e+00)
22:07:03  V31 0000000000000000 (f: 0.000000, d: 0.000000e+00)
22:07:03  Module=/home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/build/linux-aarch64-server-release/jdk/lib/default/libj9jit29.so
22:07:03  Module_base_address=0000400020000000
22:07:03  
22:07:03  Method_being_compiled=jdk/tools/jlink/internal/ImageResourcesTree$Tree.buildTree()V
22:07:03  Target=2_90_20200906_28 (Linux 4.15.0-1054-aws)
22:07:03  CPU=aarch64 (4 logical CPUs) (0x1e1a07000 RAM)
22:07:03  ----------- Stack Backtrace -----------
22:07:03  (0x000040001BA21D20 [libj9prt29.so+0x44d20])
22:07:03  ---------------------------------------
22:07:03  JVMDUMP039I Processing dump event "gpf", detail "" at 2020/09/06 21:07:01 - please wait.
22:07:03  JVMDUMP032I JVM requested System dump using '/home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/make/core.20200906.210701.12072.0001.dmp' in response to an event
22:07:03  JVMPORT030W /proc/sys/kernel/core_pattern setting "|/usr/share/apport/apport %p %s %c %d %P %E" specifies that the core dump is to be piped to an external program.  Attempting to rename either core or core.12313.
22:07:03  
22:07:08  JVMDUMP012E Error in System dump: The core file created by child process with pid = 12313 was not found. Expected to find core file with name "/home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/make/core"
22:07:08  JVMDUMP032I JVM requested Java dump using '/home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/make/javacore.20200906.210701.12072.0002.txt' in response to an event
22:07:08  JVMDUMP010I Java dump written to /home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/make/javacore.20200906.210701.12072.0002.txt
22:07:08  JVMDUMP032I JVM requested Snap dump using '/home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/make/Snap.20200906.210701.12072.0003.trc' in response to an event
22:07:08  JVMDUMP010I Snap dump written to /home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/make/Snap.20200906.210701.12072.0003.trc
22:07:08  JVMDUMP032I JVM requested JIT dump using '/home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/make/jitdump.20200906.210701.12072.0004.dmp' in response to an event
22:07:08  terminate called after throwing an instance of 'J9::JITShutdown'
22:07:08    what():  JIT Shutdown
22:07:08  JVMDUMP039I Processing dump event "abort", detail "" at 2020/09/06 21:07:08 - please wait.
22:07:08  JVMDUMP032I JVM requested System dump using '/home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/make/core.20200906.210708.12072.0005.dmp' in response to an event
22:07:08  JVMPORT030W /proc/sys/kernel/core_pattern setting "|/usr/share/apport/apport %p %s %c %d %P %E" specifies that the core dump is to be piped to an external program.  Attempting to rename either core or core.12393.
22:07:08  
22:07:15  JVMDUMP012E Error in System dump: The core file created by child process with pid = 12393 was not found. Expected to find core file with name "/home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/make/core"
22:07:15  JVMDUMP032I JVM requested Java dump using '/home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/make/javacore.20200906.210708.12072.0006.txt' in response to an event
22:07:15  JVMDUMP010I Java dump written to /home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/make/javacore.20200906.210708.12072.0006.txt
22:07:15  JVMDUMP032I JVM requested Snap dump using '/home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/make/Snap.20200906.210708.12072.0007.trc' in response to an event
22:07:15  JVMDUMP010I Snap dump written to /home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/make/Snap.20200906.210708.12072.0007.trc
22:07:15  JVMDUMP032I JVM requested JIT dump using '/home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/make/jitdump.20200906.210708.12072.0008.dmp' in response to an event
22:07:15  terminate called recursively
22:07:15  /usr/bin/bash: line 1: 12072 Aborted                 (core dumped) /home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/build/linux-aarch64-server-release/jdk/bin/jlink -J-Djlink.debug=true --module-path /home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/build/linux-aarch64-server-release/images/jmods --endian little --release-info /home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/build/linux-aarch64-server-release/jdk/release --order-resources=**module-info.class,/java.base/java/**,/java.base/jdk/**,/java.base/sun/**,/java.base/com/**,/jdk.localedata/** --dedup-legal-notices=error-if-not-same-content --add-modules java.base,java.compiler,java.datatransfer,java.desktop,java.instrument,java.logging,java.management,java.management.rmi,java.naming,java.net.http,java.prefs,java.rmi,java.scripting,java.se,java.security.jgss,java.security.sasl,java.smartcardio,java.sql,java.sql.rowset,java.transaction.xa,java.xml,java.xml.crypto,jdk.accessibility,jdk.attach,jdk.charsets,jdk.compiler,jdk.crypto.cryptoki,jdk.crypto.ec,jdk.dynalink,jdk.editpad,jdk.httpserver,jdk.incubator.foreign,jdk.incubator.jpackage,jdk.internal.ed,jdk.internal.jvmstat,jdk.internal.le,jdk.internal.opt,jdk.jartool,jdk.javadoc,jdk.jcmd,jdk.jconsole,jdk.jdeps,jdk.jdi,jdk.jdwp.agent,jdk.jlink,jdk.jshell,jdk.jsobject,jdk.localedata,jdk.management,jdk.management.agent,jdk.naming.dns,jdk.naming.rmi,jdk.net,jdk.nio.mapmode,jdk.sctp,jdk.security.auth,jdk.security.jgss,jdk.unsupported,jdk.unsupported.desktop,jdk.xml.dom,jdk.zipfs,openj9.cuda,openj9.dataaccess,openj9.dtfj,openj9.dtfjview,openj9.gpu,openj9.jvm,openj9.sharedclasses,openj9.traceformat,openj9.zosconditionhandling --keep-packaged-modules /home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/build/linux-aarch64-server-release/images/jdk/jmods --output /home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/build/linux-aarch64-server-release/images/jdk
22:07:15       12073 Done                    | ( /usr/bin/grep -v -e "WARNING: Using incubator module" || test "$?" = "1" ) > >(/usr/bin/tee -a /home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/build/linux-aarch64-server-release/support/images/jdk/_jlink_jdk_exec.log) 2> >(/usr/bin/tee -a /home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/build/linux-aarch64-server-release/support/images/jdk/_jlink_jdk_exec.log >&2)
22:07:15  Images.gmk:90: recipe for target '/home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/build/linux-aarch64-server-release/support/images/jdk/_jlink_jdk_exec.marker' failed
22:07:15  gmake[3]: *** [/home/ubuntu/workspace/build-scripts/jobs/jdk15u/jdk15u-linux-aarch64-openj9-linuxXL/workspace/build/src/build/linux-aarch64-server-release/support/images/jdk/_jlink_jdk_exec.marker] Error 1
22:07:15  make/Main.gmk:410: recipe for target 'jdk-image' failed
22:07:15  gmake[2]: *** [jdk-image] Error 1
austin0 commented 4 years ago

Same issue again today on jdk16, jdk15 hasn't kicked off yet.

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-aarch64-openj9/108/console

gacholio commented 4 years ago

@knn-k

knn-k commented 4 years ago

A similar crash was found in a JDK11 build yesterday: https://ci.eclipse.org/openj9/job/Pipeline_Build_Test_JDK11_aarch64_linux/221/

knn-k commented 4 years ago

eclipse/omr#5532 should have fixed it. Waiting for the fix to promote.

austin0 commented 4 years ago

Seems to be fixed, thanks @knn-k.