Intermittent build failures list

Me, @adam-thorpe and @andrew-m-leonard have been tracking sporadic build failures at ci.adoptopenjdk for triage purposes. This list should now be made public so it can be contributed to by anyone observing the nightly builds.

Intermittent Nightly test list: https://github.com/AdoptOpenJDK/openjdk-tests/issues/1511

~jdk11-openj9/hotspot-mac 09-12-2019~ FIXED ~jdk11-openj9/hotspot-macXL 12-12-2019~ FIXED

jdk11-openj9/hotspot-windowsXL 13-12-2019

jdk11-windows-x32-hotspot 23-1-2020

jdk14-windows-x64-openj9 28-1-2020

jdk11u-windows-x64-hotspot 29-1-2020, 31-1-2020

jdk8u-windows-ALL-openj9 29-1-2020, 30-1-2020

jdk11u-windows-x64-openj9-windowsXL 30-1-2020, 31-1-2020

Scheduling project: build-scripts » release » sign_build
Starting building: build-scripts » release » sign_build #6387
build-scripts » release » sign_build #6387 completed with status FAILURE (propagate: false to ignore)

~https://github.com/AdoptOpenJDK/openjdk-build/issues/1428~ ~https://github.com/AdoptOpenJDK/openjdk-build/issues/1429~ Fix in progress: https://github.com/AdoptOpenJDK/openjdk-installer/pull/178

[EDIT by @sxa555: This is now resolved - also it's a test failure, not a build one ;-) ]

~jdk11-openj9/hotspot-windows 09-12-2019~

21:14:15  + ./openjdk-tests/get.sh -s /cygdrive/c/Users/jenkins/workspace/Test_openjdk11_hs_sanity.openjdk_x86-64_windows -t /cygdrive/c/Users/jenkins/workspace/Test_openjdk11_hs_sanity.openjdk_x86-64_windows/openjdk-tests -p x64_windows -r upstream -j 11 -i hotspot --openj9_repo https://github.com/eclipse/openj9.git --openj9_branch master --tkg_repo https://github.com/AdoptOpenJDK/TKG.git --tkg_branch master
21:14:15  ./openjdk-tests/get.sh: line 14: $'\r': command not found
21:14:15  ./openjdk-tests/get.sh: line 15: set: -
: invalid option
21:14:15  set: usage: set [-abefhkmnptuvxBCHP] [-o option-name] [--] [arg ...]
21:14:15  ./openjdk-tests/get.sh: line 16: $'\r': command not found
21:14:15  ./openjdk-tests/get.sh: line 39: $'\r': command not found
21:14:15  ./openjdk-tests/get.sh: line 40: $'\r': command not found
21:14:15  ./openjdk-tests/get.sh: line 41: syntax error near unexpected token `$'\r''
21:14:15  ./openjdk-tests/get.sh: line 41: `usage ()`

~https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1023~

jdk11u-aix-ppc64-openj9 run 429 on build box 2

Compiling 25 files for jdk.sctp
1586-495 (U) SYSTEM LIMIT EXCEEDED: Too many processes are active.
1586-495 (U)1586-495 (U)  SYSTEM LIMIT EXCEEDED: Too many processes are active.SYSTEM LIMIT EXCEEDED: Too many processes are active.

1586-495 (U) SYSTEM LIMIT EXCEEDED: Too many processes are active.
1586-495 (U) SYSTEM LIMIT EXCEEDED: Too many processes are active.
../../omrmakefiles/rules.mk:379: recipe for target 'main.o' failed
gmake[6]: *** [main.o] Error 1

jdk13u/s390x/J9 - don't believe we've seen this on the older Marist systems

Cannot contact build-marist-rhel77-s390x-2: java.lang.InterruptedException
wrapper script does not seem to be touching the log file in /home/jenkins/workspace/build-scripts/jobs/jdk13u/jdk13u-linux-s390x-openj9-linuxXL@tmp/durable-ac43ec50
(JENKINS-48300: if on an extremely laggy filesystem, consider -Dorg.jenkinsci.plugins.durabletask.BourneShellScript.HEARTBEAT_CHECK_INTERVAL=86400)

@lumpfish - got this today - 2020/01/22

[EDIT 2020/02/25 - This is https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1154]

Windows JDK8u failure on JDK8/HotSpot builds as per #1236 (Recurred recently)

Resetting the git openjdk source repository at /tmp/openjdk-jdk8u-windows-x86-32-hotspot/workspace/build/src in 10 seconds...
Pulling latest changes from git openjdk source repository
error: RPC failed; curl 18 transfer closed with outstanding read data remaining
fatal: The remote end hung up unexpectedly
fatal: early EOF
fatal: index-pack failed

Got this today on build-osuosl-ppc64-aix-71-2

xlC_r  -I.  -I../../../include -I../../include_core -I../../nls -DPPC64 -D_XOPEN_SOURCE_EXTENDED=1 -D_ALL_SOURCE -DRS6000 -DAIXPPC -D_LARGE_FILES -c  -s -q64 -qlanglvl=extended0x -qarch=ppc -qalias=noansi -qxflag=LTOL:LTOL0 -qsuppress=1506-1108 -q mbcs -qinfo=pro -O3 -qhalt=w -g   -o StringUtils.o StringUtils.cpp
/opt/IBM/xlC/13.1.3/bin/.orig/xlC_r: 1501-222 (S) cannot fork process - Resource temporarily unavailable
../../omrmakefiles/rules.mk:379: recipe for target 'StringUtils.o' failed
xlC_r  -I../../tools/tracegen  -I../../../include -I../../include_core -I../../nls -DPPC64 -D_XOPEN_SOURCE_EXTENDED=1 -D_ALL_SOURCE -DRS6000 -DAIXPPC -D_LARGE_FILES -c  -s -q64 -qlanglvl=extended0x -qarch=ppc -qalias=noansi -qxflag=LTOL:LTOL0 -qsuppress=1506-1108 -q mbcs -qinfo=pro -O3 -qhalt=w -g   -o Port.o ../../tools/tracegen/Port.cpp
gmake[6]: *** [StringUtils.o] Error 254
gmake[6]: *** Waiting for unfinished jobs....
/opt/freeware/bin/bash: fork: retry: Resource temporarily unavailable
/opt/IBM/xlC/13.1.3/bin/.orig/xlC_r: 1501-222 (S) cannot fork process - Resource temporarily unavailable
../../omrmakefiles/rules.mk:379: recipe for target 'Port.o' failed
gmake[6]: *** [Port.o] Error 254

~https://github.com/AdoptOpenJDK/openjdk-build/issues/1450#issuecomment-567997988~

jdk11u-aix-ppc64-openj9 run 429 on build box 2

Compiling 25 files for jdk.sctp
1586-495 (U) SYSTEM LIMIT EXCEEDED: Too many processes are active.
1586-495 (U)1586-495 (U)  SYSTEM LIMIT EXCEEDED: Too many processes are active.SYSTEM LIMIT EXCEEDED: Too many processes are active.

1586-495 (U) SYSTEM LIMIT EXCEEDED: Too many processes are active.
1586-495 (U) SYSTEM LIMIT EXCEEDED: Too many processes are active.
../../omrmakefiles/rules.mk:379: recipe for target 'main.o' failed
gmake[6]: *** [main.o] Error 1

~Occurred again on the same box and job.~

xlC_r  -I../../tools/tracegen  -I../../../include -I../../include_core -I../../nls -DPPC64 -D_XOPEN_SOURCE_EXTENDED=1 -D_ALL_SOURCE -DRS6000 -DAIXPPC -D_LARGE_FILES -c  -s -q64 -qlanglvl=extended0x -qarch=ppc -qalias=noansi -qxflag=LTOL:LTOL0 -qsuppress=1506-1108 -q mbcs -qinfo=pro -O3 -qhalt=w -g   -o Port.o ../../tools/tracegen/Port.cpp
1586-495 (U) SYSTEM LIMIT EXCEEDED: Too many processes are active.
1586-495 (U) SYSTEM LIMIT EXCEEDED: Too many processes are active.
1586-495 (U) SYSTEM LIMIT EXCEEDED: Too many processes are active.

~Count = 2 NOT SEEN SINCE 28th JAN~ RESOLVED (maxuproc set too low)

#1450 (comment)

jdk11u-aix-ppc64-openj9 run 429 on build box 2

Compiling 25 files for jdk.sctp
1586-495 (U) SYSTEM LIMIT EXCEEDED: Too many processes are active.
1586-495 (U)1586-495 (U)  SYSTEM LIMIT EXCEEDED: Too many processes are active.SYSTEM LIMIT EXCEEDED: Too many processes are active.

1586-495 (U) SYSTEM LIMIT EXCEEDED: Too many processes are active.
1586-495 (U) SYSTEM LIMIT EXCEEDED: Too many processes are active.
../../omrmakefiles/rules.mk:379: recipe for target 'main.o' failed
gmake[6]: *** [main.o] Error 1

Occurred again on the same box and job.

xlC_r  -I../../tools/tracegen  -I../../../include -I../../include_core -I../../nls -DPPC64 -D_XOPEN_SOURCE_EXTENDED=1 -D_ALL_SOURCE -DRS6000 -DAIXPPC -D_LARGE_FILES -c  -s -q64 -qlanglvl=extended0x -qarch=ppc -qalias=noansi -qxflag=LTOL:LTOL0 -qsuppress=1506-1108 -q mbcs -qinfo=pro -O3 -qhalt=w -g   -o Port.o ../../tools/tracegen/Port.cpp
1586-495 (U) SYSTEM LIMIT EXCEEDED: Too many processes are active.
1586-495 (U) SYSTEM LIMIT EXCEEDED: Too many processes are active.
1586-495 (U) SYSTEM LIMIT EXCEEDED: Too many processes are active.

Count = 2

~Occurred again on same box and job. @sxa555 Could this be due to the ulimit settings on the machine?~

xlC_r  -I../../tools/tracegen  -I../../../include -I../../include_core -I../../nls -DPPC64 -D_XOPEN_SOURCE_EXTENDED=1 -D_ALL_SOURCE -DRS6000 -DAIXPPC -D_LARGE_FILES -c  -s -q64 -qlanglvl=extended0x -qarch=ppc -qalias=noansi -qxflag=LTOL:LTOL0 -qsuppress=1506-1108 -q mbcs -qinfo=pro -O3 -qhalt=w -g   -o FileReader.o ../../tools/tracegen/FileReader.cpp
xlC_r  -I.  -I../../../include -I../../include_core -I../../nls -DPPC64 -D_XOPEN_SOURCE_EXTENDED=1 -D_ALL_SOURCE -DRS6000 -DAIXPPC -D_LARGE_FILES -c  -s -q64 -qlanglvl=extended0x -qarch=ppc -qalias=noansi -qxflag=LTOL:LTOL0 -qsuppress=1506-1108 -q mbcs -qinfo=pro -O3 -qhalt=w -g   -o TraceGen.o TraceGen.cpp
1586-495 (U) SYSTEM LIMIT EXCEEDED: Too many processes are active.
xlC_r  -I../../tools/tracegen  -I../../../include -I../../include_core -I../../nls -DPPC64 -D_XOPEN_SOURCE_EXTENDED=1 -D_ALL_SOURCE -DRS6000 -DAIXPPC -D_LARGE_FILES -c  -s -q64 -qlanglvl=extended0x -qarch=ppc -qalias=noansi -qxflag=LTOL:LTOL0 -qsuppress=1506-1108 -q mbcs -qinfo=pro -O3 -qhalt=w -g   -o DATMerge.o DATMerge.cpp
1586-495 (U) SYSTEM LIMIT EXCEEDED: Too many processes are active.

~Count = 3~ NOT SEEN SINCE 28th JAN

~Reoccured on both build boxes. Issue has been raised https://github.com/AdoptOpenJDK/openjdk-build/issues/1559 03/03/2020~ RESOLVED (maxuproc set too low)

https://github.com/AdoptOpenJDK/openjdk-build/issues/1450#issuecomment-569245197

jdk13u/s390x/J9 - don't believe we've seen this on the older Marist systems

Cannot contact build-marist-rhel77-s390x-2: java.lang.InterruptedException
wrapper script does not seem to be touching the log file in /home/jenkins/workspace/build-scripts/jobs/jdk13u/jdk13u-linux-s390x-openj9-linuxXL@tmp/durable-ac43ec50
(JENKINS-48300: if on an extremely laggy filesystem, consider -Dorg.jenkinsci.plugins.durabletask.BourneShellScript.HEARTBEAT_CHECK_INTERVAL=86400)

Occurred again on build-marist-rhel77-s390x-2. jdk14/s390x/HS 19/02/2020

Count = 2

https://github.com/AdoptOpenJDK/openjdk-build/issues/1450#issuecomment-570629416

Windows JDK8u failure on JDK8/HotSpot builds as per #1236 (Recurred recently)

Resetting the git openjdk source repository at /tmp/openjdk-jdk8u-windows-x86-32-hotspot/workspace/build/src in 10 seconds...
Pulling latest changes from git openjdk source repository
error: RPC failed; curl 18 transfer closed with outstanding read data remaining
fatal: The remote end hung up unexpectedly
fatal: early EOF
fatal: index-pack failed

Occurred again on build-azure-win2008r2-x64-2 on job jdk8/windows_x64/HS 20/02/2020

Count = 2 -> RAISED https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1169

aarch_64/aarch_64 java.rmi hash failures. Seen occasionally on j9 builds (first seen on build-packet-centos74-armv8-1)

* For target support_images_jdk:
Error: Hash of java.rmi (2f7df02f6c7f132174b40f919c967141db1cb843451fc05b6913d49d5843fa9f) differs to expected hash (3043f4a33a2d47e36670674890353ed52c954beead5d4b8facd0044663c36faf) recorded in java.base
java.lang.module.FindException: Hash of java.rmi (2f7df02f6c7f132174b40f919c967141db1cb843451fc05b6913d49d5843fa9f) differs to expected hash (3043f4a33a2d47e36670674890353ed52c954beead5d4b8facd0044663c36faf) recorded in java.base
    at java.base/java.lang.module.Resolver.findFail(Resolver.java:877)
    at java.base/java.lang.module.Resolver.checkHashes(Resolver.java:461)
    at java.base/java.lang.module.Resolver.finish(Resolver.java:360)
    at java.base/java.lang.module.Configuration.<init>(Configuration.java:141)
    at java.base/java.lang.module.Configuration.resolve(Configuration.java:424)
    at java.base/java.lang.module.Configuration.resolve(Configuration.java:256)
    at jdk.jlink/jdk.tools.jlink.internal.Jlink$JlinkConfiguration.resolve(Jlink.java:220)
    at jdk.jlink/jdk.tools.jlink.internal.JlinkTask.createImageProvider(JlinkTask.java:486)
    at jdk.jlink/jdk.tools.jlink.internal.JlinkTask.createImage(JlinkTask.java:396)
    at jdk.jlink/jdk.tools.jlink.internal.JlinkTask.run(JlinkTask.java:272)
    at jdk.jlink/jdk.tools.jlink.internal.Main.run(Main.java:54)
    at jdk.jlink/jdk.tools.jlink.internal.Main.main(Main.java:33)
* For target support_images_jre:
Error: Hash of java.rmi (2f7df02f6c7f132174b40f919c967141db1cb843451fc05b6913d49d5843fa9f) differs to expected hash (3043f4a33a2d47e36670674890353ed52c954beead5d4b8facd0044663c36faf) recorded in java.base
java.lang.module.FindException: Hash of java.rmi (2f7df02f6c7f132174b40f919c967141db1cb843451fc05b6913d49d5843fa9f) differs to expected hash (3043f4a33a2d47e36670674890353ed52c954beead5d4b8facd0044663c36faf) recorded in java.base
    at java.base/java.lang.module.Resolver.findFail(Resolver.java:877)
    at java.base/java.lang.module.Resolver.checkHashes(Resolver.java:461)
    at java.base/java.lang.module.Resolver.finish(Resolver.java:360)
    at java.base/java.lang.module.Configuration.<init>(Configuration.java:141)
    at java.base/java.lang.module.Configuration.resolve(Configuration.java:424)
    at java.base/java.lang.module.Configuration.resolve(Configuration.java:256)
    at jdk.jlink/jdk.tools.jlink.internal.Jlink$JlinkConfiguration.resolve(Jlink.java:220)
    at jdk.jlink/jdk.tools.jlink.internal.JlinkTask.createImageProvider(JlinkTask.java:486)
    at jdk.jlink/jdk.tools.jlink.internal.JlinkTask.createImage(JlinkTask.java:396)
    at jdk.jlink/jdk.tools.jlink.internal.JlinkTask.run(JlinkTask.java:272)
    at jdk.jlink/jdk.tools.jlink.internal.Main.run(Main.java:54)
    at jdk.jlink/jdk.tools.jlink.internal.Main.main(Main.java:33)

https://github.com/AdoptOpenJDK/openjdk-build/issues/1450#issuecomment-569245197

jdk13u/s390x/J9 - don't believe we've seen this on the older Marist systems

Cannot contact build-marist-rhel77-s390x-2: java.lang.InterruptedException
wrapper script does not seem to be touching the log file in /home/jenkins/workspace/build-scripts/jobs/jdk13u/jdk13u-linux-s390x-openj9-linuxXL@tmp/durable-ac43ec50
(JENKINS-48300: if on an extremely laggy filesystem, consider -Dorg.jenkinsci.plugins.durabletask.BourneShellScript.HEARTBEAT_CHECK_INTERVAL=86400)

Seen a similar problem on a mac machine

01:00:38  Cannot contact test-macincloud-macos1013-x64-1: java.lang.InterruptedException
01:08:27  wrapper script does not seem to be touching the log file in /Users/jenkins/workspace/Test_openjdk11_hs_sanity.openjdk_x86-64_mac@tmp/durable-32c52dee
01:08:27  (JENKINS-48300: if on an extremely laggy filesystem, consider -Dorg.jenkinsci.plugins.durabletask.BourneShellScript.HEARTBEAT_CHECK_INTERVAL=86400)

~https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x64-hotspot Unknown reason for failure on the build scripts. Potentially related to the sha checksum being wrong https://adoptopenjdk.slack.com/archives/C09NW3L2J/p1587459652122600~

Scheduling project: build-scripts » release » create_installer_windows
Starting building: build-scripts » release » create_installer_windows #3848
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[Pipeline] // node
[Pipeline] echo
Execution error: null
[Pipeline] End of Pipeline
Finished: FAILURE

https://github.com/AdoptOpenJDK/openjdk-build/issues/1450#issuecomment-619895368

@M-Davies The installer job failed on tha last build:

WScript.CreateObject 80020009: Could not locate automation class named "WindowsInstaller.Installer".
wisubstg failed with : 2
Failed to generate setup translation of culture "es-es" with LangID "3082".
failed to build translation es-es 3082
Build step 'Execute Windows batch command' marked build as failure
Archiving artifacts

Got this on https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-aix-ppc64-hotspot

Cannot contact build-osuosl-ppc64-aix-71-2: hudson.remoting.ChannelClosedException: 
Channel "hudson.remoting.Channel@25c96107:build-osuosl-ppc64-aix-71-2": 
Remote call on build-osuosl-ppc64-aix-71-2 failed. The channel is closing down or has closed down

That one's ok - there was some additional maintenance happening at OSUOSL last night so that's not something that should recur

JDK14 xLinux installer glitched last night - conncetion issue:


> Task :rpm:uploadRedHatRpmPackage FAILED

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':rpm:uploadRedHatRpmPackage'.
> org.apache.http.conn.HttpHostConnectException: Connect to adoptopenjdk.jfrog.io:443 [adoptopenjdk.jfrog.io/35.231.52.82] failed: Connection refused (Connection refused)

Hung build job, lost contact, network issue most likely:

22:17:34  Cannot contact build-scaleway-ubuntu1604-armv7-1: java.lang.InterruptedException

jdk11u-aix-ppc64-hotspot https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-aix-ppc64-hotspot/562/console

machine: build-osuosl-aix71-ppc64-2
05:12:26  Execution error: java.io.IOException: Unexpected termination of the channel

jdk8u-aix-ppc64-hotspot https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-aix-ppc64-hotspot/624/console

20:15:27 build-osuosl-aix71-ppc64-2 was marked offline: Connection was broken: java.io.IOException: Unexpected EOF 20:15:27 at hudson.remoting.ChunkedInputStream.readUntilBreak(ChunkedInputStream.java:99) 20:15:27 at hudson.remoting.ChunkedCommandTransport.readBlock(ChunkedCommandTransport.java:39) 20:15:27 at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34) 20:15:27 at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:63)

jdk-aix-ppc64-hotspot https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-aix-ppc64-hotspot/154/

06:45:18 Cannot contact build-osuosl-aix71-ppc64-2: hudson.remoting.ChannelClosedException: Channel "hudson.remoting.Channel@10cbe185:build-osuosl-aix71-ppc64-2": Remote call on build-osuosl-aix71-ppc64-2 failed. The channel is closing down or has closed down

So it sounds like we lost the connection to build-osuosl-aix71-ppc64-2 mid-build again. That's at least four times in the past month (as per nightly triage).

jdk11u-aix-ppc64-hotspot https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-aix-ppc64-hotspot/672/consoleFull

The last passing/first failing builds are both using the same boot JDK and running AIX 7.1.0. Both builds are running on build-osuosl-aix71-ppc64-1.

01:08:31  /opt/IBM/xlC/13.1.3/bin/.orig/xlc_r: 1501-222 (S) cannot fork process - Resource temporarily unavailable

Issue has been discussed previously here: https://github.com/AdoptOpenJDK/openjdk-build/issues/1248.

@austin0 I restarted that machine yesterday and job 673 looks to have ran ok on it last night. Unclear why it occurs though

[EDIT: It may be shared memory which is being held by the jenkins agent process on the machine as there were a few Gb on one of the long running jenkins agents I have on one of the boxes]

jdk11u-aix-ppc64-hotspot https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-aix-ppc64-hotspot/674/console

Machine: build-osuosl-aix71-ppc64-2

@sxa if you want to check your shared memory theory.

01:06:25 /opt/IBM/xlC/13.1.3/bin/.orig/xlc_r: 1501-222 (S) cannot fork process - Resource temporarily unavailable

Issue has been discussed previously here: #1248.

I'm going to close this as it's more of an issue to log stuff rather than an active ticket being worked on. There are links to this in the triage document too incase we lose it

Reopening to track nightly intermittent Build failures...

01:22:57  Running on build-osuosl-centos74-ppc64le-1 in /home/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-linux-ppc64le-openj9
[Pipeline] {
[Pipeline] echo
01:22:57  checking linux
[Pipeline] stage
[Pipeline] { (build)
[Pipeline] checkout
01:22:57  The recommended git tool is: git
01:22:57  No credentials specified
01:49:37   > git rev-parse --is-inside-work-tree # timeout=10
01:22:58  Fetching changes from the remote Git repository
01:22:58  Cleaning workspace
01:49:38   > git config remote.origin.url https://github.com/AdoptOpenJDK/openjdk-build.git # timeout=10
01:49:38   > git rev-parse --verify HEAD # timeout=10
01:49:39  Resetting working tree
01:49:39   > git reset --hard # timeout=10
01:49:50   > git clean -fdx # timeout=10
01:33:11  ERROR: Error fetching remote repo 'origin'
01:33:11  hudson.plugins.git.GitException: Failed to fetch from https://github.com/AdoptOpenJDK/openjdk-build.git
01:33:11    at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:996)
01:33:11    at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1237)
01:33:11    at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1297)
01:33:11    at org.jenkinsci.plugins.workflow.steps.scm.SCMStep.checkout(SCMStep.java:125)
01:33:11    at org.jenkinsci.plugins.workflow.steps.scm.SCMStep$StepExecutionImpl.run(SCMStep.java:93)
01:33:11    at org.jenkinsci.plugins.workflow.steps.scm.SCMStep$StepExecutionImpl.run(SCMStep.java:80)
01:33:11    at org.jenkinsci.plugins.workflow.steps.SynchronousNonBlockingStepExecution.lambda$start$0(SynchronousNonBlockingStepExecution.java:47)
01:33:11    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
01:33:11    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
01:33:11    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
01:33:11    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
01:33:11    at java.lang.Thread.run(Thread.java:748)
01:33:11  Caused by: hudson.plugins.git.GitException: Command "git clean -fdx" returned status code 143:
01:33:11  stdout: 
01:33:11  stderr: 
01:33:11    at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:2450)
01:33:11    at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:2380)
01:33:11    at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:2376)
01:33:11    at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommand(CliGitAPIImpl.java:1923)
01:33:11    at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommand(CliGitAPIImpl.java:1935)
01:33:11    at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.clean(CliGitAPIImpl.java:1017)
01:33:11    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
01:33:11    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
01:33:11    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
01:33:11    at java.lang.reflect.Method.invoke(Method.java:498)
01:33:11    at hudson.remoting.RemoteInvocationHandler$RPCRequest.perform(RemoteInvocationHandler.java:936)
01:33:11    at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:909)
01:33:11    at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:860)
01:33:11    at hudson.remoting.UserRequest.perform(UserRequest.java:211)
01:33:11    at hudson.remoting.UserRequest.perform(UserRequest.java:54)
01:33:11    at hudson.remoting.Request$2.run(Request.java:375)
01:33:11    at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:73)
01:33:11    ... 4 more
01:33:11    Suppressed: hudson.remoting.Channel$CallSiteStackTrace: Remote call to build-osuosl-centos74-ppc64le-1
01:33:11        at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1800)
01:33:11        at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
01:33:11        at hudson.remoting.Channel.call(Channel.java:1001)
01:33:11        at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:286)
01:33:11        at com.sun.proxy.$Proxy406.clean(Unknown Source)
01:33:11        at org.jenkinsci.plugins.gitclient.RemoteGitImpl.clean(RemoteGitImpl.java:459)
01:33:11        at hudson.plugins.git.extensions.impl.CleanBeforeCheckout.decorateFetchCommand(CleanBeforeCheckout.java:45)
01:33:11        at hudson.plugins.git.extensions.GitSCMExtension.decorateFetchCommand(GitSCMExtension.java:295)
01:33:11        at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:992)
01:33:11        at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1237)
01:33:11        at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1297)
01:33:11        at org.jenkinsci.plugins.workflow.steps.scm.SCMStep.checkout(SCMStep.java:125)
01:33:11        at org.jenkinsci.plugins.workflow.steps.scm.SCMStep$StepExecutionImpl.run(SCMStep.java:93)
01:33:11        at org.jenkinsci.plugins.workflow.steps.scm.SCMStep$StepExecutionImpl.run(SCMStep.java:80)
01:33:11        at org.jenkinsci.plugins.workflow.steps.SynchronousNonBlockingStepExecution.lambda$start$0(SynchronousNonBlockingStepExecution.java:47)
01:33:11        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
01:33:11        ... 4 more

(Copy-and-paste from the google doc we used for triage for a few months. Pt 1 of 3.)

Fri 10th July Builds https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-windows-x64-hotspot/192/console Problem: Failed 5 times to query or parse the adopt api. Solution: Unknown. Could just be the api going down again. Will mention on Slack again.

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-aix-ppc64-hotspot/620/consoleText Problem: /opt/freeware/bin/bash: fork: retry: Resource temporarily unavailable /opt/IBM/xlC/13.1.3/bin/.orig/xlc_r: 1501-222 (S) cannot fork process - Resource temporarily unavailable Solution: May be a one-off. Build is re-running.

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot/367 Problem: java.security.cert.CertificateNotYetValidException: NotBefore: Sat Jul 04 19:00:00 CDT 2020 Solution: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1430

Monday 13th July Builds jdk8u-solaris-x64-hotspot/370 Problem: java.security.cert.CertificateNotYetValidException: NotBefore: Sat Jul 04 19:00:00 CDT 2020 Solution:https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1430

jdk15-mac-x64-openj9/40 Problem: libcuda4j29.dylib: A timestamp was expected but was not found. Solution: No existing issue found.

jdk11u-linux-aarch64-openj9-linuxXL/290 Problem: Error: Hash of jdk.jartool (x) differs to expected hash (y) recorded in java.base Solution: Possibly this: https://github.com/AdoptOpenJDK/openjdk-build/issues/1214

Tue 14th July Builds jdk-mac-x64-openj9 [2020-07-14T03:36:45.399Z] Checked out origin/openj9 [2020-07-14T03:36:45.399Z] INFO: Extracting latest tag for the scmref using git describe since no tag is set in the build config... [2020-07-14T03:36:45.399Z] fatal: No annotated tags can describe 'a9464186a5f7ccdcc14e82b68a5fe80ddb2cf19e'. [2020-07-14T03:36:45.399Z] However, there were unannotated tags: try --tags. [2020-07-14T03:36:45.399Z] WARNING: git describe FAILED. There is likely additional error output above (exit code was 128). Trying again using git describe --tags to match a lightweight (non-annotated) tag Raised: https://github.com/AdoptOpenJDK/openjdk-build/issues/1969

jdk15-mac-x64-openj9 [2020-07-14T03:34:24.107Z] Checked out origin/openj9 [2020-07-14T03:34:24.107Z] INFO: Extracting latest tag for the scmref using git describe since no tag is set in the build config... [2020-07-14T03:34:24.107Z] fatal: No annotated tags can describe 'ede7a69a23527c1c65f3e9ceecf0acad29cc40a8'. [2020-07-14T03:34:24.107Z] However, there were unannotated tags: try --tags. [2020-07-14T03:34:24.107Z] WARNING: git describe FAILED. There is likely additional error output above (exit code was 128). Trying again using git describe --tags to match a lightweight (non-annotated) tag Raised: https://github.com/AdoptOpenJDK/openjdk-build/issues/1969

The git describe issues above are not failures please ignore. The program is coded so that if it fails, it won’t abort the pipeline. An issue has been opened to combat the original failure https://github.com/AdoptOpenJDK/openjdk-build/issues/1980

Wed 15th July Builds Jdk15-linux-aarch64-openj9 Problem: OOM on build-packet-centos74-armv8-1 Solution: Possibly a one-off. Here’s an 11 build on the same machine (passed).

jdk15-mac-x64-openj9 Problem: Maybe this: fatal: No annotated tags can describe 'ede7a69a23527c1c65f3e9ceecf0acad29cc40a8'. Solution:

Jdk-mac-x64-openj9 Problem: Maybe this: fatal: No annotated tags can describe 'a9464186a5f7ccdcc14e82b68a5fe80ddb2cf19e'. Solution:

Jdk14u-windows-x64-openj9 (Specifically the installer creation job here) Problem: LIGHT Windows Installer XML Toolset Linker version 3.14.0.3910 Copyright (c) .NET Foundation and contributors. All rights reserved.

light.exe : error LGHT0001 : Catastrophic failure (Exception from HRESULT: 0x8000FFFF (E_UNEXPECTED))

Exception Type: System.Runtime.InteropServices.COMException

Stack Trace: at System.Security.Policy.PEFileEvidenceFactory.GetLocationEvidence(SafePEFileHandle peFile, SecurityZone& zone, StringHandleOnStack retUrl) at System.Security.Policy.PEFileEvidenceFactory.GenerateLocationEvidence() at System.Security.Policy.PEFileEvidenceFactory.GenerateEvidence(Type evidenceType) at System.Security.Policy.AssemblyEvidenceFactory.GenerateEvidence(Type evidenceType) Solution:

Monday 20th July Builds jdk11u-linux-s390x-openj9/687 jdk11u-linux-s390x-openj9-linuxXL/282 jdk-linux-s390x-openj9/61 Problem: Out of space on build-marist-rhel77-s390x-2. Solution: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1453

jdk-windows-x64-hotspot/199 Problem: Failed 5 times to query or parse the adopt api on build-softlayer-win2012r2-x64-1. Solution: Known infrequent issue, no known cause. Re-running.

jdk15-mac-x64-openj9/44 Problem: Build job fails with this error: Execution error: hudson.AbortException: script returned exit code 1 Right after this command is run: git fetch -q --tags --depth=1 Solution: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1455

Tuesday 21st July Builds https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-windows-x64-hotspot/202/console API failure

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk14u/job/jdk14u-windows-x64-hotspot/144/console Concurrent exception, seen this a few times on various machines.

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk14u/job/jdk14u-windows-x86-32-hotspot/145/console Crypto failure

All have been respun as they all seem like intermittents

Wednesday 22nd July Builds https://ci.adoptopenjdk.net/job/build-scripts/job/jobs/job/jdk/job/jdk-windows-x64-openj9/66/console API failure, suspected to be an intermittent issue with build-softlayer-win2012r2-x64-1 on jdk-next due to evidence gained from the following test runs https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-windows-x64-openj9/62/ https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-windows-x64-openj9/66/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-windows-x64-openj9/68/console It does not however appear to affect other jdk distributions as test run https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x64-hotspot/678/console demonstrated. Running with clean workspace might resolve hidden problems but it currently cannot be run due to an issue affecting windows machines cleaning themselves https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-windows-x64-openj9/69/console Reposted all of this info into a new infra issue => https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1459

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk14u/job/jdk14u-linux-s390x-openj9-linuxXL/155/console ConcurrentModificationException - Jenkins error Seen by others here: https://issues.jenkins-ci.org/browse/JENKINS-41037\

Thursday 23rd July Builds https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-mac-x64-openj9/60/console Execution error: hudson.AbortException: script returned exit code 1 Recurring mac failure, 2nd time this week. Issue: https://github.com/AdoptOpenJDK/openjdk-build/issues/1980 Solution: https://github.com/AdoptOpenJDK/openjdk-build/pull/1984

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk14u/job/jdk14u-linux-ppc64le-hotspot/138/console Caused by: hudson.plugins.git.GitException: Command "git clean -fdx" returned status code 143 23:31:08 > git clean -fdx # timeout=10 23:41:08 ERROR: Timeout after 10 minutes 23:19:26 ERROR: Error fetching remote repo 'origin' Rebuild: https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk14u/job/jdk14u-linux-ppc64le-hotspot/141/console Successful

Friday 24th July Builds jdk14u-aix-ppc64-hotspot/141 Problem: build-osuosl-aix71-ppc64-1 was marked offline Update: Machine appears to be back online now. Note: I did notice the ramdisk test keeps failing on that machine though, possibly as a result of the changes referred to here, and also here. The latter implies we’re not using a ramdisk anymore, so I’ll raise an infrastructure issue to stop the test.

jdk11u-mac-x64-openj9/685 Problem: A timestamp was expected but was not found. Issue: https://github.com/AdoptOpenJDK/openjdk-build/issues/1987

jdk11u-linux-aarch64-openj9/428 jdk11u-linux-aarch64-openj9-linuxXL/303 Problem: 00:43:53 checking for cmake... no 00:43:53 configure: error: Could not find required tool for CMAKE 00:43:53 configure exiting with result code 1 Issue: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1462

jdk-mac-x64-openj9/61 Problem: AbortException: script returned exit code 1 (Previous instances of this were determined to be workspace issues, resolved by a fresh workspace.) Issue: https://github.com/AdoptOpenJDK/openjdk-build/pull/1984

Monday 27th July Builds Repeat of Could not find required tool for CMAKE on aarch64 from Friday 24th July. Issue is open and being worked on => https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1462

Build-marist-rhel77-s390x-1 out of space. RAISED => https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1463

Tuesday 28th July Builds https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-mac-x64-openj9/65/console Problem: 04:55:28 Updating support/src.zip 04:55:42 make[3]: *** [/Users/jenkins/workspace/build-scripts/jobs/jdk/jdk-mac-x64-openj9/workspace/build/src/build/macosx-x86_64-server-release/support/modules_libs/java.base/libjncrypto.dylib] Segmentation fault: 11 on build-macstadium-macos1014-x64-2. Will leave this until tomorrow since it’s unseen (could be intermittent), re-run https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-mac-x64-openj9/67/console

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-aarch64-openj9/433/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-aarch64-openj9-linuxXL/308/console Same issue as https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1462

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-ppc64le-openj9/662/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk14u/job/jdk14u-linux-ppc64le-hotspot/146/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk14u/job/jdk14u-linux-ppc64le-openj9-linuxXL/151/console Network glitch when downloading repos on build-osuosl-centos74-ppc64le-1. Reruns: https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-ppc64le-openj9/664/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk14u/job/jdk14u-linux-ppc64le-hotspot/148/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk14u/job/jdk14u-linux-ppc64le-openj9-linuxXL/153/console

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x86-32-openj9/641/console Problem: JRE installer failure 19:37:01 We have a JRE. Running another installer for it... [Pipeline] build (Building build-scripts » release » create_installer_windows) 19:37:01 Scheduling project: build-scripts » release » create_installer_windows 19:37:10 Starting building: build-scripts » release » create_installer_windows #6182 [Pipeline] } [Pipeline] // stage [Pipeline] } [Pipeline] // node [Pipeline] echo 19:38:42 Execution error: org.jenkinsci.plugins.workflow.steps.FlowInterruptedException Rerun https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x86-32-openj9/643/console

Wednesday 29th July Builds

jdk11u-linux-aarch64-openj9-linuxXL/310 jdk11u-linux-aarch64-openj9/435 Problem: Cmake missing from machine. Issue: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1462

jdk15-linux-aarch64-openj9-linuxXL/1 Problem: configure: error: Invalid value for --enable-jvm-feature-dtrace: 'auto' Issue: https://github.com/AdoptOpenJDK/openjdk-build/pull/1996

jdk-linux-ppc64le-openj9/66 jdk15-linux-ppc64le-hotspot/49 jdk15-linux-ppc64le-openj9/50 Problem: GitException: Failed to fetch from https://github.com/AdoptOpenJDK/openjdk-build.git Details: All 3 failures happened on build-osuosl-centos74-ppc64le-2 GitHub status page insists the sites it was trying to access were up. Odd that this would happen repeatedly on just one machine, but over 7+ hours. Retrying the builds on the same machine. Conclusion: Issue does not reoccur, as proven here. Will keep an eye out in the future.

Thursday 30th July Builds https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x64-hotspot/689/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x86-32-hotspot/626/console JDK Installer failure, couldn’t find the jdk. First .\SourceDir\OpenJDK11\hotspot\x86-32\jdk-11.0.9 not exists Second .\SourceDir\OpenJDK11\hotspot\x86-32\jdk-11+9 not exists Third .\SourceDir\OpenJDK11\hotspot\x86-32\jdk-11.0.9+9 not exists OpenJDK-Latest unnumbered .\SourceDir\OpenJDK-Latest\hotspot\x86-32\jdk-11.0.9+9 does not exist SOURCE Dir not found / failed Issue => https://github.com/AdoptOpenJDK/openjdk-installer/issues/240 Rebuilds running https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x64-hotspot/691/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x86-32-hotspot/628/console

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15/job/jdk15-linux-ppc64le-hotspot/52/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15/job/jdk15-linux-ppc64le-openj9/53/console Looks like a network timeout on build-osuosl-centos74-ppc64le-2 21:27:30 Resetting working tree 21:27:30 > git reset --hard # timeout=10 21:27:44 > git clean -fdx # timeout=10 21:37:44 ERROR: Timeout after 10 minutes 21:37:45 ERROR: Error fetching remote repo 'origin' 21:37:45 hudson.plugins.git.GitException: Failed to fetch from https://github.com/AdoptOpenJDK/openjdk-build.git 21:37:45 at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:915) 21:37:45 at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1141) 21:37:45 at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1177) 21:37:45 at org.jenkinsci.plugins.workflow.steps.scm.SCMStep.checkout(SCMStep.java:125) 21:37:45 at org.jenkinsci.plugins.workflow.steps.scm.SCMStep$StepExecutionImpl.run(SCMStep.java:93) 21:37:45 at org.jenkinsci.plugins.workflow.steps.scm.SCMStep$StepExecutionImpl.run(SCMStep.java:80) 21:37:45 at org.jenkinsci.plugins.workflow.steps.SynchronousNonBlockingStepExecution.lambda$start$0(SynchronousNonBlockingStepExecution.java:47) 21:37:45 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 21:37:45 at java.util.concurrent.FutureTask.run(FutureTask.java:266) 21:37:45 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 21:37:45 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 21:37:45 at java.lang.Thread.run(Thread.java:748) 21:37:45 Caused by: hudson.plugins.git.GitException: Command "git clean -fdx" returned status code 143: Rebuilds running https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15/job/jdk15-linux-ppc64le-hotspot/54/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15/job/jdk15-linux-ppc64le-openj9/55/console

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15/job/jdk15-mac-x64-hotspot/53/console Mac installer failure Copied 3 artifacts from "build-scripts » jobs » jdk15 » jdk15-mac-x64-hotspot" build number 53 [create_installer_mac] $ /bin/sh -xe /var/folders/rt/8_by_h8n5g9d5jhp66cf_7d80000gr/T/jenkins5963136066146069329.sh

bash pkgbuild/create-installer-mac.sh Processing: /Users/jenkins/workspace/build-scripts/release/create_installer_mac/workspace/target/OpenJDK15-jdk_x64_mac_hotspot_2020-07-29-20-27.tar.gz running ./pkgbuild.sh --sign Developer ID Installer: London Jamocha Community CIC --major_version 15 --full_version 15+33-202007292104 --input_directory jdk-15+33 --output_directory /Users/jenkins/workspace/build-scripts/release/create_installer_mac/workspace/target/OpenJDK15-jdk_x64_mac_hotspot_2020-07-29-20-27.pkg jdk-15+33: replacing existing signature jdk-15+33: signed bundle with Mach-O thin (x86_64) [net.adoptopenjdk.15.jdk] ./pkgbuild.sh: line 137: 12105 Segmentation fault: 11 /usr/bin/pkgbuild --root ${INPUT_DIRECTORY} --install-location /Library/Java/JavaVirtualMachines/${DIRECTORY} --identifier ${IDENTIFIER} --version ${FULL_VERSION} ${SIGN_CMD} "${SIGN_OPTION}" OpenJDK.pkg Build step 'Execute shell' marked build as failure Archiving artifacts Finished: FAILURE Rebuild https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15/job/jdk15-mac-x64-hotspot/55/console

Monday 3rd August Builds https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-mac-x64-hotspot/199/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-hotspot/652/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-openj9/695/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15/job/jdk15-mac-x64-openj9-macosXL/5/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-hotspot/677/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-openj9-macosXL/475/console Mac installer failures by the looks of it

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-windows-x64-hotspot/215/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x64-openj9/698/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x64-hotspot/696/console Gradle network error on build-azure-win2012r2-x64-2. Rebuilds => https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-windows-x64-hotspot/217/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x64-openj9/700/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x64-hotspot/698/console

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x64-hotspot/694/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x86-32-hotspot/631/console Reoccurances of https://github.com/AdoptOpenJDK/openjdk-installer/issues/240

https://ci.adoptopenjdk.net/job/build-scripts/job/release/job/create_installer_windows/6351/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x64-openj9-windowsXL/442/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x64-openj9-windowsXL/381/console Signing failure. Can’t find windows.p12 Package language = 1033,1031,3082,1036,1041,2052,1028, ProductLanguage = 1033, Database codepage = 1252 MSI validation was skipped by option SKIP_MSI_VALIDATION=true SignTool Error: File not found: C:\Users\jenkins\windows.p12 Failed to sign with SHA1 Opened => https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1484

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15/job/jdk15-mac-x64-openj9/65/console JVM crash on build-macstadium-macos1014-x64-2

22:11:09 Assertion failed at /Users/jenkins/workspace/build-scripts/jobs/jdk15/jdk15-mac-x64-openj9/workspace/build/src/build/macosx-x86_64-server-release/vm/compiler/../compiler/compile/J9SymbolReferenceTable.cpp:823: containingClass != NULL 22:11:09 VMState: 0x00050080 22:11:09 failed to get defining class of field ref cpIndex=23 in owning method J9Method=0x15672548 22:11:09 compiling jdk/internal/org/objectweb/asm/MethodWriter.(Ljdk/internal/org/objectweb/asm/SymbolTable;ILjava/lang/String;Ljava/lang/String;Ljava/lang/String;[Ljava/lang/String;I)V at level: warm 22:11:09 22:11:09 JVMDUMP039I Processing dump event "abort", detail "" at 2020/08/02 22:11:09 - please wait. 22:11:09 JVMDUMP032I JVM requested System dump using '/Users/jenkins/workspace/build-scripts/jobs/jdk15/jdk15-mac-x64-openj9/workspace/build/src/make/core.20200802.221109.68820.0001.dmp' in response to an event 22:11:16 JVMDUMP012E Error in System dump: The core file created by child process with pid = 68886 was not found. Expected to find core file with name "/cores/core.68886" 22:11:16 JVMDUMP032I JVM requested Java dump using '/Users/jenkins/workspace/build-scripts/jobs/jdk15/jdk15-mac-x64-openj9/workspace/build/src/make/javacore.20200802.221109.68820.0002.txt' in response to an event 22:11:16 JVMDUMP010I Java dump written to /Users/jenkins/workspace/build-scripts/jobs/jdk15/jdk15-mac-x64-openj9/workspace/build/src/make/javacore.20200802.221109.68820.0002.txt 22:11:16 JVMDUMP032I JVM requested Snap dump using '/Users/jenkins/workspace/build-scripts/jobs/jdk15/jdk15-mac-x64-openj9/workspace/build/src/make/Snap.20200802.221109.68820.0003.trc' in response to an event 22:11:16 JVMDUMP010I Snap dump written to /Users/jenkins/workspace/build-scripts/jobs/jdk15/jdk15-mac-x64-openj9/workspace/build/src/make/Snap.20200802.221109.68820.0003.trc 22:11:16 JVMDUMP032I JVM requested JIT dump using '/Users/jenkins/workspace/build-scripts/jobs/jdk15/jdk15-mac-x64-openj9/workspace/build/src/make/jitdump.20200802.221109.68820.0004.dmp' in response to an event 22:11:17 Creating java.prefs.jmod 22:11:17 Creating java.net.http.jmod 22:11:17 Creating java.rmi.jmod 22:11:18 Creating java.scripting.jmod 22:11:18 JVMDUMP010I JIT dump written to /Users/jenkins/workspace/build-scripts/jobs/jdk15/jdk15-mac-x64-openj9/workspace/build/src/make/jitdump.20200802.221109.68820.0004.dmp 22:11:18 JVMDUMP013I Processed dump event "abort", detail "". 22:11:19 make[3]: [/Users/jenkins/workspace/build-scripts/jobs/jdk15/jdk15-mac-x64-openj9/workspace/build/src/build/macosx-x86_64-server-release/support/images/jmods/_create_java.logging.jmod_exec.marker] Error 1 22:11:19 make[2]: [java.logging-jmod] Error 2 22:11:19 make[2]: *** Waiting for unfinished jobs.... Opened https://github.com/eclipse/openj9/issues/10313

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-arm-hotspot/345/console Fails to print out the java version. Looking at the job history, it’s been failing since 31st July (doesn’t look machine related as the last passing build was on build-scaleway-ubuntu1604-armv7-1). 13:21:04 =JAVA VERSION OUTPUT= 13:21:04 Error: dl failure on line 893 13:21:04 Error: failed /home/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-linux-arm-hotspot/workspace/build/src/build/linux-aarch32-normal-client-release/images/j2sdk-image/jre/lib/aarch32/client/libjvm.so, because /home/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-linux-arm-hotspot/workspace/build/src/build/linux-aarch32-normal-client-release/images/j2sdk-image/jre/lib/aarch32/client/libjvm.so: undefined symbol: __atomic_load_8

Opened => https://github.com/AdoptOpenJDK/openjdk-build/issues/2014

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x64-openj9/781/console Windows JRE installer failure (unrelated to the ones above). Looks like a dependency problem on build-azure-win2012r2-x64-2

Package language = 1033,1031,3082,1036,1041,2052,1028, ProductLanguage = 1033, Database codepage = 1252 MSI validation was skipped by option SKIP_MSI_VALIDATION=true SignTool Error: File not found: C:\Users\jenkins\windows.p12 Failed to sign with SHA1 Opened => https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1484

Tuesday 4th August Builds https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-aarch64-openj9/72/consoleFull ERROR: Build failed for targets 'product-images legacy-jre-image test-image debug-image' in configuration 'linux-aarch64-server-release' (exit code 2) CompileJavaModules.gmk:595: recipe for target

'/home/ubuntu/workspace/build-scripts/jobs/jdk/jdk-linux-aarch64-openj9/workspace/build/src/build/linux-aarch64-server-release/jdk/modules/java.base/_the.java.base_batch' failed Rerun: https://ci.adoptopenjdk.net/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-aarch64-openj9/73/ - Success

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-mac-x64-hotspot/200/consoleFull https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15/job/jdk15-mac-x64-hotspot/59/console 04:48:36 make[3]: *** [/Users/jenkins/workspace/build-scripts/jobs/jdk/jdk-mac-x64-hotspot/workspace/build/src/build/macosx-x86_64-server-release/support/test/hotspot/jtreg/native/lib/libredefclass031.dylib] Segmentation fault: 11

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-mac-x64-openj9/73/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-hotspot/653/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-openj9-macosXL/646/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15/job/jdk15-mac-x64-openj9/66/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-hotspot/678/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-openj9/652/console Mac installer failure Builds failing since 30th July Raised in slack https://adoptopenjdk.slack.com/archives/C9C272Z1T/p1596551937068800. Looks like a space issue, Harron is going to open an inf issue to clean them down => https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1489

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-windows-x64-hotspot/218/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x64-hotspot/695/consoleFull https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x86-32-hotspot/632/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x64-hotspot/699/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x64-openj9-windowsXL/382/console Windows installer failure Issue: https://github.com/AdoptOpenJDK/openjdk-installer/issues/240

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x64-openj9/702/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15/job/jdk15-windows-x64-openj9-windowsXL/6/console
Gradle network error on build-azure-win2012r2-x64-2.

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15/job/jdk15-linux-ppc64le-openj9/60/console Git error fetching repo on machine: build-osuosl-centos74-ppc64le-1 Caused by: hudson.plugins.git.GitException: Command "git clean -fdx" returned status code 143: Rerun: https://ci.adoptopenjdk.net/job/build-scripts/job/jobs/job/jdk15/job/jdk15-linux-ppc64le-openj9/62/console - Success

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15/job/jdk15-windows-x64-hotspot/58/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15/job/jdk15-windows-x86-32-hotspot/6/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x64-openj9/782/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x86-32-openj9/650/console Windows failed to sign build. - Need to take a closer look

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-arm-hotspot/348/console Repeat of Link Failing to print Java version.

(Copy-and-paste from the google doc we used for triage for a few months. Pt 2 of 3.)

Wednesday 5th August Builds jdk8u-windows-x64-openj9-windowsXL/383 jdk11u-windows-x64-hotspot/696 jdk11u-windows-x64-openj9-windowsXL/446 Problem: Something broke in the sign_build subjob. The specific problem is unknown because I don’t have job access. Issue: Issue raised to give me job access - https://ci.adoptopenjdk.net/job/build-scripts/job/release/job/sign_build/

jdk8u-windows-x64-openj9/783 jdk8u-windows-x64-hotspot/701 jdk-windows-x64-openj9/85 jdk15-windows-x64-openj9-windowsXL/7 Problem: Create_installer_windows subjob failed due to: SignTool Error: File not found: C:\Users\jenkins\windows.p12 Issue: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1484

jdk15-windows-x86-32-hotspot/7 jdk8u-windows-x86-32-hotspot/676 jdk11u-windows-x64-openj9/703 Problem: 21:35:04 Execution failed for task ':compileGroovy'. 21:35:04 > java.lang.StackOverflowError (no error message) Issue: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1494

jdk11u-windows-x86-32-hotspot/634 Problem: First .\SourceDir\OpenJDK11\hotspot\x86-32\jdk-11.0.9 not exists Second .\SourceDir\OpenJDK11\hotspot\x86-32\jdk-11+9 not exists Third .\SourceDir\OpenJDK11\hotspot\x86-32\jdk-11.0.9+9 not exists Issue: https://github.com/AdoptOpenJDK/openjdk-installer/issues/240

Thursday 6th August Builds build-scripts » jobs » jdk11u » jdk11u-mac-x64-hotspot Failed to create legacy jre image 01:27:13 make[3]: *** [/Users/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-mac-x64-hotspot/workspace/build/src/build/macosx-x86_64-normal-server-release/support/test/hotspot/jtreg/native/lib/libma02t001a.dylib] Segmentation fault: 11

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x64-hotspot/697/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x86-32-hotspot/635/console Windows installer failure Problem: Create_installer_windows subjob failed due to: SignTool Error: File not found: C:\Users\jenkins\windows.p12 Issue: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1484

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x64-openj9/ https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x64-openj9-windowsXL/ Stuck on failed build relating to above installer failure and signing failure. Taken offline by “gadams”.

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-aix-ppc64-hotspot/674/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot/394/console 18:29:17 gmake[2]: *** [/home/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-aix-ppc64-hotspot/workspace/build/src/build/aix-ppc64-normal-server-release/jdk/objs/libnet/ExtendedOptionsImpl.o] Error 1 18:29:17 lib/NetworkingLibraries.gmk:61: recipe for target '/home/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-aix-ppc64-hotspot/workspace/build/src/build/aix-ppc64-normal-server-release/jdk/objs/libnet/ExtendedOptionsImpl.o' failed Issues with ExtendedOptionsImpl.c, some networking properties TCP_KEEPCN and SOCK_OPT_LEVEL alongside potential syntax errors. Solaris build provides more error information, Syntax error on or before SOCK_OPT_NAME_KEEPIDLE_STR, Undefined symbols: TCP_KEEPCNT SOCK_OPT_LEVEL SOCK_OPT_NAME_KEEPIDLE TCP_KEEPINTVL Rerun: https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-aix-ppc64-hotspot/675/console - Failure - Same error/point

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-arm-hotspot/354/console Java version failure Repeat of Link Failing to print Java version. gadams rerun: Success https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-arm-hotspot/355/

Monday 10th August Builds https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x64-hotspot/701/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x86-32-hotspot/639/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x64-openj9/783/console Failed Windows Installer Problem: Create_installer_windows subjob failed due to: SignTool Error: File not found: C:\Users\jenkins\windows.p12 Issue: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1484

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-openj9/702/console Mac installer failure Issue: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1489

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-aix-ppc64-hotspot/679/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot/398/console 18:29:17 gmake[2]: *** [/home/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-aix-ppc64-hotspot/workspace/build/src/build/aix-ppc64-normal-server-release/jdk/objs/libnet/ExtendedOptionsImpl.o] Error 1 18:29:17 lib/NetworkingLibraries.gmk:61: recipe for target '/home/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-aix-ppc64-hotspot/workspace/build/src/build/aix-ppc64-normal-server-release/jdk/objs/libnet/ExtendedOptionsImpl.o' failed Issues with ExtendedOptionsImpl.c, some networking properties TCP_KEEPCN and SOCK_OPT_LEVEL alongside potential syntax errors. Solaris build provides more error information, Syntax error on or before SOCK_OPT_NAME_KEEPIDLE_STR, Undefined symbols: TCP_KEEPCNT SOCK_OPT_LEVEL SOCK_OPT_NAME_KEEPIDLE TCP_KEEPINTVL File: https://github.com/AdoptOpenJDK/openjdk-jdk8u/blob/master/jdk/src/solaris/native/java/net/ExtendedOptionsImpl.c Changes made on 4th, failures started on 4th. PR that made changes: http://cr.openjdk.java.net/~sgehwolf/webrevs/JDK-8194298/jdk8/05/webrev/ https://bugs.openjdk.java.net/browse/JDK-8250631 OpenJ9 experiencing too: https://github.com/ibmruntimes/openj9-openjdk-jdk8/issues/438 File causing problems is src/solaris/native/java/net/ExtendedOptionsImpl.c

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/jobjdk8u/job/jdk8u-linux-aarch64-hotspot/607/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-aarch64-openj9/12/console Seems like a network issue. Rerun: https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-aarch64-hotspot/608/console - Failed 14:26:25 mkdir: cannot create directory '//.gnupg': Permission denied https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-aarch64-openj9/13/console - Failed 14:44:02 mkdir: cannot create directory '//.gnupg': Permission denied

Tuesday 11th August Builds All “docker” based builds failed due to merge of: https://github.com/AdoptOpenJDK/openjdk-infrastructure/pull/1497 Re-opened: https://github.com/AdoptOpenJDK/openjdk-build/issues/2005

Windows builds failing due to: https://github.com/AdoptOpenJDK/openjdk-installer/issues/240

Friday 14th August Builds jdk8 openj9 Win64 builds not being building for 10days as build-softlayer-win2012r2-x64-1 was offline, it’s now back, and builds progressing

Monday 17th August Builds zLinux nodes out of disk space, raised: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1511

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-aix-ppc64-hotspot/ https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot/ Broken by OpenJDK change. Fix: https://bugs.openjdk.java.net/browse/JDK-8251546

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-aix-ppc64-hotspot/4/ 22:29:27 build-osuosl-aix71-ppc64-1 was marked offline: Connection was broken Rerun: https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-aix-ppc64-hotspot/5/ - Build passed but data centre issue affecting all AIX machines is preventing it for finishing.

Tuesday 18th August Builds Checkout failed on a large number of jdk8u builds due to an issue with 2FA being enabled. Restarted pipeline as change seems to have been reverted for now: https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/openjdk8-pipeline/ - SUCCESS

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-aix-ppc64-hotspot/6 22:29:27 build-osuosl-aix71-ppc64-1 was marked offline: Connection was broken Rerun: https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-aix-ppc64-hotspot/7 - SUCCESS

Solaris/AIX failed again. Broken by OpenJDK change. Fix: https://bugs.openjdk.java.net/browse/JDK-8251546

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-aarch64-openj9/455 Looks like a network error while pulling repos. Rerun: https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-aarch64-openj9/456 - SUCCESS

Wednesday 19th August Builds https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-aix-ppc64-openj9/202/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-aix-ppc64-openj9/7/console 05:11:12 /home/jenkins/workspace/build-scripts/jobs/jdk/jdk-aix-ppc64-openj9/workspace/build/src/openj9/debugtools/DDR_VM/src/com/ibm/j9ddr/vm29/pointer/helper/J9UTF8Helper.java:38: error: cannot find symbol 05:11:12 utf8pointer.dataEA().getBytesAtOffset(0, buffer); 05:11:12 ^ 05:11:12 symbol: method dataEA() 05:11:12 location: variable utf8pointer of type J9UTF8Pointer

/home/jenkins/workspace/build-scripts/jobs/jdk/jdk-aix-ppc64-openj9/workspace/build/src/openj9/debugtools/DDR_VM/src/com/ibm/j9ddr/vm29/tools/ddrinteractive/commands/VmCheckCommand.java:498: error: cannot find symbol 05:11:12 U8Pointer utf8Data = utf8.dataEA(); 05:11:12 ^ 05:11:12 symbol: method dataEA() 05:11:12 location: variable utf8 of type J9UTF8Pointer Potentially caused by: https://github.com/eclipse/openj9/pull/10404 Issue: https://github.com/eclipse/openj9/issues/10418

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-mac-x64-openj9/88/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-openj9/714/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-openj9-macosXL/661/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-mac-x64-hotspot/6/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-mac-x64-openj9-macosXL/8/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-openj9/669/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-openj9-macosXL/493/console Mac installer failure - below output is from inside build-scripts » release » create_installer_mac Status Code: 2 Message: Package Invalid Logs: https://osxapps-ssl.itunes.apple.com/itunes-assets/Enigma124/v4/f4/a8/e3/f4a8e332-9c38-5639-dfb6-50235b3e7512/developer_log.json?accessKey=1598005122_6742529137074676234_HfmkHwckvB7vpM%2B4ZCtO2GrvK9Ka13XybGNfoU7jlVf1r1fN9t1KSvSL4R4BUV3h3h%2BnR%2FrXP2f4A3qqbNW71XCq4YThBy5%2F7B9uZowqiHvhvJnYKOw9TEHCZoti08d%2F4zjxNMeCdPg45dfK0F1p%2F6nklHSM7D0rjilzUTGdVGA%3D at /Users/jenkins/workspace/build-scripts/release/create_installer_mac/pkgbuild/notarize/node_modules/electron-notarize/lib/index.js:114:19 at Generator.next () at fulfilled (/Users/jenkins/workspace/build-scripts/release/create_installer_mac/pkgbuild/notarize/node_modules/electron-notarize/lib/index.js:4:58) at process._tickCallback (internal/process/next_tick.js:68:7) Build step 'Execute shell' marked build as failure Archiving artifacts ERROR: Step 'Archive the artifacts' aborted due to exception: java.io.IOException: Unexpected EOF at hudson.remoting.ChunkedInputStream.readUntilBreak(ChunkedInputStream.java:99) at hudson.remoting.ChunkedCommandTransport.readBlock(ChunkedCommandTransport.java:39) at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34) at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:63) Caused: java.io.IOException Issue: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1489

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-mac-x64-openj9/8/console OpenJ9 compilation issue. 22:28:59 Creating support/test/jdk/jtreg/native/bin/JliLaunchTest from 1 file(s) 22:28:59 Creating support/test/jdk/jtreg/native/bin/JniInvocationTest from 1 file(s) 22:30:38 Compiling 1 files for java.se 22:30:38 Compiling 18 files for jdk.accessibility 22:30:38 Compiling 8 files for jdk.unsupported.desktop 22:30:38 Compiling 3 files for jdk.editpad 22:30:38 IOException caught during compilation: Resource deadlock avoided 22:30:38 make[3]: [/Users/jenkins/workspace/build-scripts/jobs/jdk15u/jdk15u-mac-x64-openj9/workspace/build/src/build/macosx-x86_64-server-release/jdk/modules/java.se/_the.java.se_batch] Error 1 22:30:38 make[2]: [java.se-java] Error 2 22:30:38 make[2]: *** Waiting for unfinished jobs.... 22:30:38 Creating support/modules_libs/java.desktop/libmlib_image.dylib from 50 file(s)

Solaris/AIX failed again. Broken by OpenJDK change. Fix: https://bugs.openjdk.java.net/browse/JDK-8251546

Thursday 20th August Builds Every failure is OpenJ9 Builds are broken due to some OMR Acceptance issues at OpenJ9, they are actively being worked on.

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-aarch64-openj9-linuxXL/332/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-ppc64le-openj9/687/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-linux-aarch64-openj9-linuxXL/10/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-linux-ppc64le-openj9/9/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-linux-ppc64le-openj9-linuxXL/10/console + many more 00:47:53 J:\jenkins\tmp\workspace\build\src\build\windows-x86_64-normal-server-release\vm\compiler\codegen\CodeGenGPU.cpp(1278): error C2338: Number of elements in nvvmOpCodeNames does not match the value of TR::NumIlOps 00:47:53 J:\jenkins\tmp\workspace\build\src\build\windows-x86_64-normal-server-release\vm\compiler\codegen\CodeGenGPU.cpp(2044): warning C4334: '<<': result of 32-bit shift implicitly converted to 64 bits (was 64-bit shift intended?)

00:45:03 /Users/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-mac-x64-openj9-macosXL/workspace/build/src/openj9/runtime/compiler/codegen/CodeGenGPU.cpp:1278:1: error: static_assert failed "Number of elements in nvvmOpCodeNames does not match the value of TR::NumIlOps" 00:45:03 static_assert(sizeof(nvvmOpCodeNames) == (TR::NumIlOpssizeof(char)), "Number of elements in nvvmOpCodeNames does not match the value of TR::NumIlOps");

Issue: https://github.com/eclipse/openj9/issues/10423

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-openj9/670/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-openj9-macosXL/494/console Mac installer failure Issue: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1489

Monday 24th August Builds https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot/426/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-aix-ppc64-hotspot/703/console OpenJDK issue relating to backport. Fix ready to merge: https://bugs.openjdk.java.net/browse/JDK-8251546

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-aix-ppc64-hotspot/672/console 01:15:17 /opt/IBM/xlC/13.1.3/bin/.orig/xlc_r: 1501-222 (S) cannot fork process - Resource temporarily unavailable Old Issue: https://github.com/AdoptOpenJDK/openjdk-build/issues/1248 Machine: build-osuosl-aix71-ppc64-1 Both passing/failing builds use same boot JDK. Both builds on aix 7.1.0 Issue: https://github.com/AdoptOpenJDK/openjdk-build/issues/1450#issuecomment-679009255

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-riscv64-openj9/100/console 00:48:46 ./unix/omrsharedhelper.c: In function 'omr_unlinkControlFile': 00:48:46 ./unix/omrsharedhelper.c:437:6: error: 'strncpy' output truncated before terminating nul copying as many bytes from a string as its length [-Werror=stringop-truncation] 00:48:46 437 | strncpy(controlFileStatus->errorMsg, unlinkErrMsg, msgLen); 00:48:46 | ^~~~~~~~~~~~~~ 00:48:46 ./unix/omrsharedhelper.c:428:14: note: length computed here 00:48:46 428 | msgLen = strlen(unlinkErrMsg); 00:48:46 | ^~~~~~~~ 00:48:46 cc1: all warnings being treated as errors 00:48:46 gmake[7]: *** [omrsharedhelper.o] Error 1 00:48:46 ../omrmakefiles/rules.mk:372: recipe for target 'omrsharedhelper.o' failed OpenJ9 issue in omrsharedhelper.c Related to: https://github.com/eclipse/openj9-omr/commit/90a894f176acffca70bfa0b251ef74e02a06a7b0 Issue: https://github.com/eclipse/omr/issues/5484

Tuesday 25th August Builds https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-aix-ppc64-hotspot/ https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot/ OpenJDK issue relating to backport. Fix under review: https://bugs.openjdk.java.net/browse/JDK-8251546

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-riscv64-openj9/104/console OpenJ9 issue in omrsharedhelper.c Related to: https://github.com/eclipse/openj9-omr/commit/90a894f176acffca70bfa0b251ef74e02a06a7b0 Issue: https://github.com/eclipse/omr/issues/5484

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x86-32-openj9/665/console Windows build sign failure. Copied 4 artifacts from "build-scripts » jobs » jdk8u » jdk8u-windows-x86-32-openj9" build number 665 [sign_build] $ sh -xe C:\Users\adoptopenjdk\AppData\Local\Temp\jenkins7416879684672703836.sh The system cannot find the file specified FATAL: command execution failed

Wednesday 26th August Builds

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot/ https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-aix-ppc64-hotspot/ OpenJDK issue relating to backport. Fix accepted: https://bugs.openjdk.java.net/browse/JDK-8251546

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-riscv64-openj9/ OpenJ9 issue in omrsharedhelper.c - PR waiting to be merged Related to: https://github.com/eclipse/openj9-omr/commit/90a894f176acffca70bfa0b251ef74e02a06a7b0 Issue: https://github.com/eclipse/omr/issues/5484

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-windows-x64-hotspot/240/console Windows sign failure - Machine went offline during signing Rerun: https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-windows-x64-hotspot/241/console - SUCCESS

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-aix-ppc64-hotspot/674/console 01:06:25 /opt/IBM/xlC/13.1.3/bin/.orig/xlc_r: 1501-222 (S) cannot fork process - Resource temporarily unavailable Followed by: 01:06:25 gmake[3]: *** [/home/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-aix-ppc64-hotspot/workspace/builAwt2dLibraries.gmk:50: recipe for target '/home/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-aix-ppc64-hotspot/workspace/build/src/build/aix-ppc64-normal-server-release/support/native/java.desktop/libmlib_image/mlib_ImageClipping.o' failed

Old Issue: https://github.com/AdoptOpenJDK/openjdk-build/issues/1248 Machine: build-osuosl-aix71-ppc64-2 Running AIX 7.1.0 00:33:14 BOOT JDK: openjdk version "10.0.2" 2018-07-17 00:33:14 BOOT JDK: OpenJDK Runtime Environment (build 10.0.2+13) 00:33:14 BOOT JDK: Eclipse OpenJ9 VM (build openj9-0.9.0, JRE 10 AIX ppc64-64-Bit Compressed References 20180813_100 (JIT enabled, AOT enabled) Issue: https://github.com/AdoptOpenJDK/openjdk-build/issues/1450#issuecomment-680753282

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-windows-x64-hotspot/13/console Missing file sign error. [sign_build] $ sh -xe C:\Users\adoptopenjdk\AppData\Local\Temp\jenkins4654799616833035855.sh The system cannot find the file specified FATAL: command execution failed java.io.IOException: CreateProcess error=2, The system cannot find the file specified Potentially fixed by gdams, windows sign certificate updated.

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-openj9/721/console 00:57:11 /Users/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-mac-x64-openj9/workspace/build/src/build/macosx-x86_64-normal-server-release/support/modules_libs/java.base/compressedrefs/libj9zlib29.dylib: A timestamp was expected but was not found. Rerun: https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-openj9/722/console - SUCCESS

Thursday 27th August Builds

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-mac-x64-openj9-macosXL/18/console J9 JVM crash Issue: https://github.com/eclipse/openj9/issues/10313 Error information in issue comment.

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-mac-x64-openj9/96/console Segfault on libjncrypto.dylib 04:55:17 make[3]: *** [/Users/jenkins/workspace/build-scripts/jobs/jdk/jdk-mac-x64-openj9/workspace/build/src/build/macosx-x86_64-server-release/support/modules_libs/java.base/libjncrypto.dylib] Segmentation fault: 11 Rerun: https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-mac-x64-openj9/97/console - SUCCESS

Tuesday 1st September Builds

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-x64-hotspot/729/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-s390x-hotspot/678/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-ppc64le-hotspot/664/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot/434/console OpenJDK issue, fix already reviewed waiting for merge. 18:28:36 /home/adoptopenjdk/workspace/build-scripts/jobs/jdk8u/jdk8u-linux-x64-hotspot/workspace/build/src/build/linux-x86_64-normal-server-release/jdk/objs/libjava/Metrics.o: In function Java_jdk_internal_platform_cgroupv1_Metrics_isUseContainerSupport': 18:28:36 Metrics.c:(.text+0x6): undefined reference toJVM_IsUseContainerSupport'

18:38:49 Undefined first referenced 18:38:49 symbol in file 18:38:49 Java_jdk_internal_platform_cgroupv1_Metrics_isUseContainerSupport /export/home/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-solaris-x64-hotspot/workspace/build/src/jdk/make/mapfiles/libjava/mapfile-vers Commit causing: https://github.com/AdoptOpenJDK/openjdk-jdk8u/commit/b7ca6f3a7e833184be946e44e26a860bd4cef4d6 Issue: https://bugs.openjdk.java.net/browse/JDK-8250627

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-windows-x86-32-hotspot/19/console Windows sign issue Copied 3 artifacts from "build-scripts » jobs » jdk15u » jdk15u-windows-x86-32-hotspot" build number 19 [sign_build] $ sh -xe C:\Users\adoptopenjdk\AppData\Local\Temp\jenkins7855679505507571797.sh The system cannot find the file specified

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-linux-arm-hotspot/19/console Network issue

What went wrong: Execution failed for task ':deb:uploadDebianPackage'.

org.apache.http.NoHttpResponseException: adoptopenjdk.jfrog.io:443 failed to respond Rerun: https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-linux-arm-hotspot/20/ - SUCCESS

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-windows-x64-hotspot/252/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-mac-x64-hotspot/231/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-x64-hotspot/239/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-aarch64-hotspot/234/console OpenJDK issue, undeclared identifiers. - Rerun passed assuming change reverted. 04:41:28 Compiling 944 files for jdk.hotspot.agent 04:43:38 ./src/hotspot/share/gc/shenandoah/shenandoahArguments.cpp:77:5: error: use of undeclared identifier 'vm_exit_during_initialization' 04:43:38 vm_exit_during_initialization("Shenandoah expects ConcGCThreads > 0, check -XX:ConcGCThreads=#"); 04:43:38 ^ 04:43:38 ./src/hotspot/share/gc/shenandoah/shenandoahArguments.cpp:91:5: error: use of undeclared identifier 'vm_exit_during_initialization' 04:43:38 vm_exit_during_initialization("Shenandoah expects ParallelGCThreads > 0, check -XX:ParallelGCThreads=#"); 04:43:38 ^ 04:43:38 ./src/hotspot/share/gc/shenandoah/shenandoahArguments.cpp:104:7: error: use of undeclared identifier 'vm_exit_during_initialization' 04:43:38 vm_exit_during_initialization("Shenandoah thread count ergonomic error"); 04:43:38 ^ 04:43:38 ./src/hotspot/share/gc/shenandoah/shenandoahArguments.cpp:107:7: error: use of undeclared identifier 'vm_exit_during_initialization' 04:43:38 vm_exit_during_initialization("Shenandoah expects ConcGCThreads <= ParallelGCThreads, check -XX:ParallelGCThreads, -XX:ConcGCThreads"); Rerun as pLinux jdk16 passed: https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-x64-hotspot/240/console - SUCCESS

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-ppc64le-openj9/101/consoleFull OpenJ9 issue, some kind of compilation error. 04:51:51 IOException caught during compilation: Server failed to initialize: Resource deadlock avoided 04:51:51 CompileToolsJdk.gmk:45: recipe for target '/home/jenkins/workspace/build-scripts/jobs/jdk/jdk-linux-ppc64le-openj9/workspace/build/src/build/linux-ppc64le-server-release/buildtools/jdk_tools_classes/_the.BUILD_TOOLS_JDK_batch' failed Rerun: https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-ppc64le-openj9/102/ - SUCCESS

(Copy-and-paste from the google doc we used for triage for a few months. Pt 3 of 3.)

Wednesday 2nd September Builds https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot/435/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-x64-hotspot/730/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-s390x-hotspot/679/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-ppc64le-hotspot/665/console OpenJDK issue, fix already reviewed waiting for merge. 18:28:36 /home/adoptopenjdk/workspace/build-scripts/jobs/jdk8u/jdk8u-linux-x64-hotspot/workspace/build/src/build/linux-x86_64-normal-server-release/jdk/objs/libjava/Metrics.o: In function Java_jdk_internal_platform_cgroupv1_Metrics_isUseContainerSupport': 18:28:36 Metrics.c:(.text+0x6): undefined reference toJVM_IsUseContainerSupport'

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-openj9-macosXL/507/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-hotspot/713/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-mac-x64-openj9-macosXL/24/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-mac-x64-hotspot/20/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-openj9-macosXL/675/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-openj9/729/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-mac-x64-hotspot/232/console Mac installer failure - no access to logs passed to @khel Issue: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1382

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-mac-x64-openj9/103/console Mac segfault, OpenJ9 unable to investigate as macs cannot create core dumps. (Intermittent) Rerun: https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-mac-x64-openj9/104/console - FAIL (same error)

Thursday 3rd September Builds https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot/436/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-x64-hotspot/731/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-s390x-hotspot/680/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-ppc64le-hotspot/666/console OpenJDK issue, fix already reviewed waiting for merge. 18:28:36 /home/adoptopenjdk/workspace/build-scripts/jobs/jdk8u/jdk8u-linux-x64-hotspot/workspace/build/src/build/linux-x86_64-normal-server-release/jdk/objs/libjava/Metrics.o: In function Java_jdk_internal_platform_cgroupv1_Metrics_isUseContainerSupport': 18:28:36 Metrics.c:(.text+0x6): undefined reference toJVM_IsUseContainerSupport'

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-openj9-macosXL/508/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-mac-x64-hotspot/21/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-openj9-macosXL/676/console Mac installer failure

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-linux-ppc64le-openj9-linuxXL/26/console Git fetch failed Rerun: https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-linux-ppc64le-openj9-linuxXL/27/console - SUCCESS

Friday 4th September Builds https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot/437/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-x64-hotspot/732/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-s390x-hotspot/681/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-ppc64le-hotspot/667/console OpenJDK issue, fix already reviewed waiting for merge. 18:28:36 /home/adoptopenjdk/workspace/build-scripts/jobs/jdk8u/jdk8u-linux-x64-hotspot/workspace/build/src/build/linux-x86_64-normal-server-release/jdk/objs/libjava/Metrics.o: In function Java_jdk_internal_platform_cgroupv1_Metrics_isUseContainerSupport': 18:28:36 Metrics.c:(.text+0x6): undefined reference toJVM_IsUseContainerSupport'

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-openj9-macosXL/509/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-openj9/685/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-mac-x64-openj9-macosXL/26/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-mac-x64-openj9/24/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-openj9-macosXL/677/consoleFull https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-openj9/731/consoleFull https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-mac-x64-openj9/106/consoleFull https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-aix-ppc64-openj9/23/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-aix-ppc64-openj9/218/console 18:13:12 vrfyhelp.c:1046:24: error: passing 'U_8 []' to parameter of type 'const char ' converts between pointers to integer types with different sign [-Werror,-Wpointer-sign] 18:13:12 || (0 != strncmp(J9UTF8_DATA(currentClassName), targetClassName, targetClassLength)) 18:13:12 ^~~~~~~~~ 18:13:12 ../oti/j9.h:169:36: note: expanded from macro 'J9UTF8_DATA' 18:13:12 #define J9UTF8_DATA(j9UTF8Address) (((struct J9UTF8 )(j9UTF8Address))->data) 18:13:12 ^~~~~~~~~~ 18:13:12 /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/string.h:84:26: note: passing argument to parameter 's1' here 18:13:12 int strncmp(const char *s1, const char __s2, size_t __n); 18:13:12 ^ 18:13:12 vrfyhelp.c:1046:55: error: passing 'U_8 ' (aka 'unsigned char ') to parameter of type 'const char ' converts between pointers to integer types with different sign [-Werror,-Wpointer-sign] 18:13:12 || (0 != strncmp(J9UTF8_DATA(currentClassName), targetClassName, targetClassLength)) 18:13:12 ^~~~~~~ 18:13:12 /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/string.h:84:44: note: passing argument to parameter 's2' here 18:13:12 int strncmp(const char *s1, const char *__s2, size_t __n); 18:13:12 ^ Breaking commit: https://github.com/eclipse/openj9/commit/c464059fca87b49a6d1d61a22af3bc4c0e16c66f Issue: https://github.com/eclipse/openj9/issues/10522

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-hotspot/715/console Mac sign failure Signing OSX release security: SecKeychainUnlock : The user name or passphrase you entered is not correct.

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-hotspot/684/ https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-mac-x64-hotspot/234/console Mac installer failure - @khel

Monday 7th September Builds https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x64-openj9-windowsXL/410/console Windows Sign Error Copied 4 artifacts from "build-scripts » jobs » jdk8u » jdk8u-windows-x64-openj9-windowsXL" build number 410 [sign_build] $ sh -xe C:\Users\adoptopenjdk\AppData\Local\Temp\jenkins8046905624217863443.sh The system cannot find the file specified

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot/440/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-x64-hotspot/735/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-s390x-hotspot/684/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-ppc64le-hotspot/670/console OpenJDK issue, fix already reviewed waiting for merge. Commit causing: https://github.com/AdoptOpenJDK/openjdk-jdk8u/commit/b7ca6f3a7e833184be946e44e26a860bd4cef4d6 Issue: https://bugs.openjdk.java.net/browse/JDK-8250627

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-hotspot/718/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-mac-x64-openj9-macosXL/29/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-openj9/734/ https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-hotspot/687/ https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-mac-x64-hotspot/237/console Mac Installer Issue - @khel https://ci.adoptopenjdk.net/job/build-scripts/job/release/job/create_installer_mac/4600/ https://ci.adoptopenjdk.net/job/build-scripts/job/release/job/create_installer_mac/4604/ https://ci.adoptopenjdk.net/job/build-scripts/job/release/job/create_installer_mac/4608/ https://ci.adoptopenjdk.net/job/build-scripts/job/release/job/create_installer_mac/4605/ https://ci.adoptopenjdk.net/job/build-scripts/job/release/job/create_installer_mac/4606/ Issue: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1382

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-linux-aarch64-openj9-linuxXL/28/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-aarch64-openj9/106/console OpenJ9 JVM crash Issue: https://github.com/eclipse/openj9/issues/10527

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-s390x-hotspot/238/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-ppc64le-hotspot/237/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-aix-ppc64-hotspot/220/console Hotspot JVM crash related to https://bugs.openjdk.java.net/browse/JDK-8231441 04:48:31 # 04:48:31 # A fatal error has been detected by the Java Runtime Environment: 04:48:31 # 04:48:31 # SIGSEGV (0xb) at pc=0x00000200133cca72, pid=30675, tid=30705 04:48:31 # 04:48:31 # JRE version: OpenJDK Runtime Environment AdoptOpenJDK (16.0+13) (build 16+13-202009070342) 04:48:31 # Java VM: OpenJDK 64-Bit Server VM AdoptOpenJDK (16+13-202009070342, mixed mode, tiered, compressed oops, g1 gc, linux-s390x) 04:48:31 # Problematic frame: 04:48:31 # V [libjvm.so+0x8cca72] Matcher::regmask_for_ideal_register(unsigned int, Node*)+0xba Bug: https://bugs.openjdk.java.net/browse/JDK-8252846 Issue: https://github.com/AdoptOpenJDK/openjdk-build/issues/2059

Tuesday 8th September Builds

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x64-openj9-windowsXL/411/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-windows-x86-32-hotspot/26/console Windows sign failure - create issue Copied 4 artifacts from "build-scripts » jobs » jdk8u » jdk8u-windows-x64-openj9-windowsXL" build number 411 [sign_build] $ sh -xe C:\Users\adoptopenjdk\AppData\Local\Temp\jenkins7034618390663610176.sh The system cannot find the file specified Issue:

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot/441/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-x64-hotspot/736/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-s390x-hotspot/685/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-ppc64le-hotspot/671/console OpenJDK issue, fix already reviewed waiting for merge. “seems the hg-git jdk8u mirror has a merge conflict on hotspot”-@leaonarda Commit causing: https://github.com/AdoptOpenJDK/openjdk-jdk8u/commit/b7ca6f3a7e833184be946e44e26a860bd4cef4d6 Bug: https://bugs.openjdk.java.net/browse/JDK-8250627 Issue: https://github.com/AdoptOpenJDK/openjdk-build/issues/2065

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-openj9/689/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-mac-x64-openj9-macosXL/30/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-mac-x64-openj9/28/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-mac-x64-hotspot/26/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-hotspot/688/ https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-mac-x64-openj9/110/console Mac Installer failure Issue: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1382 Fix: https://github.com/AdoptOpenJDK/openjdk-build/pull/2064

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-hotspot/719/console Mac Sign failure, same error as installer failures. security: SecKeychainUnlock : The user name or passphrase you entered is not correct. Fix: https://github.com/AdoptOpenJDK/openjdk-build/pull/2064

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-linux-aarch64-hotspot/26/console Linux installer failure - connection dropped Rerun: https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-linux-aarch64-hotspot/27/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-openj9-macosXL/681/console Mac OpenJ9 intermittent segfault Core files are not generated on mac so OpenJ9 can’t investigate Ref: https://github.com/eclipse/openj9/issues/10313#issuecomment-682071756

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-s390x-hotspot/239/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-ppc64le-hotspot/238/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-aix-ppc64-hotspot/221/consoleFull Hotspot JVM crash related to https://bugs.openjdk.java.net/browse/JDK-8231441 Bug: https://bugs.openjdk.java.net/browse/JDK-8252846 Issue: https://github.com/AdoptOpenJDK/openjdk-build/issues/2059

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-aarch64-openj9/108/consoleFull OpenJ9 JVM crash Issue: https://github.com/eclipse/openj9/issues/10527

Wednesday 9th September Builds https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-hotspot/720/ https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-mac-x64-hotspot/lastFailedBuild/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-mac-x64-hotspot/239/console Problem: error: The specified item could not be found in the keychain. Issue: Could be related to https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1382 PR: Might be resolved by https://github.com/AdoptOpenJDK/openjdk-build/pull/2064

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot/442/ Problem: ld: fatal: symbol referencing errors. No output written to /jdk_build_dir/lib/amd64/libjava.so Issue: Could be related to this: https://github.com/AdoptOpenJDK/openjdk-build/issues/2065

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x64-hotspot/741/ https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x86-32-hotspot/714/ Problem: 18:20:53 C:\workspace\openjdk-build\workspace\build\src\hotspot\src\share\vm\compiler\disassembler.cpp(262) : error C2220: warning treated as error - no 'object' file generated 18:20:53 C:\workspace\openjdk-build\workspace\build\src\hotspot\src\share\vm\compiler\disassembler.cpp(262) : warning C4351: new behavior: elements of array 'decode_env::_option_buf' will be default initialized 18:20:53 NMAKE : fatal error U1077: 'C:\progra~2\micros~1.0\vc\bin\amd64\cl.exe' : return code '0x2' 18:20:53 Stop. 18:20:53 NMAKE : fatal error U1077: 'cd' : return code '0x2' 18:20:53 Stop. 18:20:53 NMAKE : fatal error U1077: '"C:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\BIN\amd64\nmake.EXE"' : return code '0x2' Issue: https://bugs.openjdk.java.net/browse/JDK-8252573

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-openj9-macosXL/682/console Problem: 01:27:19 Assertion failed at /Users/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-mac-x64-openj9-macosXL/workspace/build/src/openj9/runtime/compiler/compile/J9SymbolReferenceTable.cpp:823: containingClass != NULL 01:27:19 VMState: 0x00050080 01:27:19 failed to get defining class of field ref cpIndex=26 in owning method J9Method=0x525b460 Issue: https://github.com/eclipse/openj9/issues/10313

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-s390x-openj9-linuxXL/333/consoleFull https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-s390x-openj9/738/consoleFull Problem: build-marist-rhel77-s390x-1 is low on disk space, and runs out during build. Issue: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1537

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-s390x-hotspot/240/console Problem: SIGSEGV (0xb) at pc=0x0000020039f4c96a, pid=63324, tid=63355 Issue: https://github.com/AdoptOpenJDK/openjdk-build/issues/2059

Thursday 10th of September Builds

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-linux-aarch64-openj9-linuxXL/31/console Problem: 22:16:39 Unhandled exception 22:16:39 Type=Segmentation error vmState=0x0005ff09 Issue: https://github.com/eclipse/openj9/issues/10527

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-mac-x64-openj9-macosXL/32/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-openj9-macosXL/683/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-hotspot/721/ Problem: running ./pkgbuild.sh --sign Developer ID Installer: London Jamocha Community CIC --major_version 15 --full_version 15+36-202009092033 --input_directory jdk-15+36 --output_directory /Users/jenkins/workspace/build-scripts/release/create_installer_mac/workspace/target/OpenJDK15U-jdk_x64_mac_openj9_macosXL_2020-09-09-20-27.pkg error: The specified item could not be found in the keychain. Issue: https://github.com/AdoptOpenJDK/openjdk-build/issues/2071

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-linux-ppc64le-openj9/30/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-linux-ppc64le-hotspot/28/console Problem: Failed to fetch from https://github.com/AdoptOpenJDK/openjdk-build.git Conclusion: Likely a transitory networking issue or git access issue. The re-run job passed this point with no problems.

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x86-32-hotspot/715/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x64-hotspot/742/console Problem: 18:20:36 C:\workspace\openjdk-build\workspace\build\src\hotspot\src\share\vm\compiler\disassembler.cpp(262) : error C2220: warning treated as error - no 'object' file generated 18:20:36 C:\workspace\openjdk-build\workspace\build\src\hotspot\src\share\vm\compiler\disassembler.cpp(262) : warning C4351: new behavior: elements of array 'decode_env::_option_buf' will be default initialized 18:20:36 NMAKE : fatal error U1077: 'C:\progra~2\micros~1.0\vc\bin\cl.exe' : return code '0x2' Issue: https://bugs.openjdk.java.net/browse/JDK-8252573

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot/443/console Problem: 18:40:31 Undefined first referenced 18:40:31 symbol in file 18:40:31 Java_jdk_internal_platform_cgroupv1_Metrics_isUseContainerSupport Issue: https://github.com/AdoptOpenJDK/openjdk-build/issues/2065

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-x64-openj9/773/console Problem: Installer subjob failed with:

org.apache.http.NoHttpResponseException: adoptopenjdk.jfrog.io:443 failed to respond While trying to upload the Red Hat rpm package. Conclusion: May be a temporary network issue. Will raise an bug if it occurs again.

Friday 11th of September Builds https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-openj9/692/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-hotspot/722/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-mac-x64-openj9-macosXL/33/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-openj9/738/console Problem: Installer subjob fails with: error: The specified item could not be found in the keychain. Issue: https://github.com/AdoptOpenJDK/openjdk-build/issues/2071

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot/444/console Problem: 18:40:46 Undefined first referenced 18:40:46 symbol in file 18:40:46 Java_jdk_internal_platform_cgroupv1_Metrics_isUseContainerSupport Issue: https://github.com/AdoptOpenJDK/openjdk-build/issues/2065

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x86-32-hotspot/671/console Problem: sign-build subjob fails with: [sign_build] $ sh -xe C:\Users\adoptopenjdk\AppData\Local\Temp\jenkins8015638099892079480.sh The system cannot find the file specified Issue:

Monday 14th of September Builds https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x64-hotspot/743/console https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x64-openj9/743/ Problem: Sign_build subjob fails with: [sign_build] $ sh -xe C:\Users\adoptopenjdk\AppData\Local\Temp\jenkins1497845439152064696.sh The system cannot find the file specified Issue: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1543

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot/447/console Problem: 18:40:41 Undefined first referenced 18:40:41 symbol in file 18:40:41 Java_jdk_internal_platform_cgroupv1_Metrics_isUseContainerSupport Issue: https://github.com/AdoptOpenJDK/openjdk-build/issues/2065

Tuesday 15th of September Builds https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-linux-ppc64le-openj9-linuxXL/41/console Problem: GitException: Failed to fetch from https://github.com/AdoptOpenJDK/openjdk-build.git (build-osuosl-centos74-ppc64le-2) Conclusion: Likely a transitory networking issue. Re-running on the same machine to verify: https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-linux-ppc64le-openj9-linuxXL/43/

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-openj9/742/console Problem: 01:18:11 Creating images/jmods/java.security.sasl.jmod 01:18:26 java.lang.ClassCastException: java.lang.String incompatible with java.nio.file.FileTreeWalker$Event Issue: https://github.com/eclipse/openj9/issues/8173

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-ppc64le-openj9/116/ https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-ppc64le-hotspot/245/ Problem: java.io.IOException: Failed to extract /home/jenkins/workspace/build-scripts/jobs/jdk/jdk-linux-ppc64le-openj9/transfer of 11 files Conclusion: Transfer failure linked to EOF failure. Possible networking issue. Will re-run on the same machines. https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-ppc64le-openj9/118/ https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-ppc64le-hotspot/247/

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot/448/console Problem: 18:38:54 Undefined first referenced 18:38:54 symbol in file 18:38:54 Java_jdk_internal_platform_cgroupv1_Metrics_isUseContainerSupport Issue: https://github.com/AdoptOpenJDK/openjdk-build/issues/2065

Thursday 17th of September Builds https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot/450/console 18:38:53 Undefined first referenced 18:38:53 symbol in file 18:38:53 Java_jdk_internal_platform_cgroupv1_Metrics_isUseContainerSupport Issue: https://github.com/AdoptOpenJDK/openjdk-build/issues/2065

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-aix-ppc64-hotspot/230/console 04:59:41 /home/jenkins/workspace/build-scripts/jobs/jdk/jdk-aix-ppc64-hotspot/workspace/build/src/src/java.base/share/classes/java/util/TreeMap.java:2717: error: incompatible types: cannot infer type-variable(s) K#1,V#1 04:59:41 setColor(sib, colorOf(parentOf(x))); 04:59:41 ^ 04:59:41 (argument mismatch; inference variable K#2 has incompatible equality constraints V#2,K#3,V#4,K#4) 04:59:41 where K#1,V#1,K#2,V#2,K#3,V#3,V#4,K#4 are type-variables: 04:59:41 K#1 extends Object declared in method <K#1,V#1>setColor(Entry<K#1,V#1>,boolean) 04:59:41 V#1 extends Object declared in method <K#1,V#1>setColor(Entry<K#1,V#1>,boolean) 04:59:41 K#2 extends Object declared in method <K#2,V#2>parentOf(Entry<K#2,V#2>) 04:59:41 V#2 extends Object declared in method <K#2,V#2>parentOf(Entry<K#2,V#2>) 04:59:41 K#3 extends Object declared in method <K#3,V#3>colorOf(Entry<K#3,V#3>) 04:59:41 V#3 extends Object declared in method <K#3,V#3>colorOf(Entry<K#3,V#3>) 04:59:41 V#4 extends Object declared in class TreeMap 04:59:41 K#4 extends Object declared in class TreeMap 04:59:41 1 error Issue: https://github.com/AdoptOpenJDK/openjdk-build/issues/2087

Wednesday 16th of September

Builds https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot/449/ Problem: 18:40:21 Undefined first referenced 18:40:21 symbol in file 18:40:21 Java_jdk_internal_platform_cgroupv1_Metrics_isUseContainerSupport Issue: https://github.com/AdoptOpenJDK/openjdk-build/issues/2065

Friday 18th of September Builds https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot/451/console 18:44:22 Undefined first referenced 18:44:22 symbol in file 18:44:22 Java_jdk_internal_platform_cgroupv1_Metrics_isUseContainerSupport Issue: https://github.com/AdoptOpenJDK/openjdk-build/issues/2065

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-aix-ppc64-hotspot/41/console Problem: build-osuosl-aix71-ppc64-1 was marked offline Conclusion: Transitory issue. Machine seems online now.

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-ppc64le-openj9/121/ Problem: Failed to fetch from https://github.com/AdoptOpenJDK/openjdk-build.git Notes: Looks like a transitory issue, but we’ve seen this issue before on this machine (build-osuosl-centos74-ppc64le-2 Once two days ago, and again in July). Will raise an infra issue to investigate. Issue: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1553

Monday 21st September build-marist-rhel77-s390x-1 out of disk space https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1554 build-scaleway-ubuntu1604-armv7-1 offline https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1555 windows installer failure https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1556 ConcurrentModificationException Pipeline failure https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1557

Friday 25th September Mac Installer failures: IOException: Remote call on test-macincloud-macos1014-x64-3 failed https://ci.adoptopenjdk.net/job/build-scripts/job/release/job/create_installer_mac/4799/console Raised: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1565 Jdk8u Solaris: Fails due to sort -s option not supported https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot/458/console Raised: https://github.com/AdoptOpenJDK/openjdk-build/issues/2101

Tuesday 29th September Jdk11 Windows hung raised: https://github.com/AdoptOpenJDK/openjdk-tests/issues/1980 Jdk16 create_installer_linux stalled, node offline build-scaleway-ubuntu1604-x64-1 raised: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1575 zLinux builds stalled due to node offline, raised: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1576

Monday 5th October build-osuosl-aix71-ppc64-2 low on disk space 1.94Gb free Raised: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1589 test-softlayer-win2012r2-x64-2 low on disk space Raised: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1590

Thursday 15th October Builds Jdk15u-linux-s390x-openj9 Build passed, but installer creation subjob failed with: Execution failed for task ':rpm:uploadRedHatRpmPackage'.

org.apache.http.NoHttpResponseException: adoptopenjdk.jfrog.io:443 failed to respond

jdk15u-linux-aarch64-openj9-linuxXL Jdk15u-linux-aarch64-openj9 Jdk15u-linux-aarch64-hotspot Error:

No active node matches this label: build&&linux&&aarch64&&dockerBuild

Potential fix: https://github.com/AdoptOpenJDK/openjdk-build/pull/2146

Jdk15u-aix-ppc64-openj9 21:29:10 Execution error: hudson.AbortException: script returned exit code 1 [Pipeline] echo 21:29:10 hudson.AbortException: script returned exit code 1 21:29:10 at org.jenkinsci.plugins.workflow.steps.durable_task.DurableTaskStep$Execution.handleExit(DurableTaskStep.java:659) 21:29:10 at org.jenkinsci.plugins.workflow.steps.durable_task.DurableTaskStep$Execution.check(DurableTaskStep.java:605) 21:29:10 at org.jenkinsci.plugins.workflow.steps.durable_task.DurableTaskStep$Execution.run(DurableTaskStep.java:549) 21:29:10 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 21:29:10 at java.util.concurrent.FutureTask.run(FutureTask.java:266) 21:29:10 at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) 21:29:10 at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) 21:29:10 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 21:29:10 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 21:29:10 at java.lang.Thread.run(Thread.java:748)

Jdk11u-linux-ppc64le-openj9 Network glitch, re-submitted to same node to check: https://ci.adoptopenjdk.net/view/Failed%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-ppc64le-openj9/748/console

Jdk11u-mac-x64-hotspot common.MetaData constructor error: 01:00:15 Execution error: java.lang.SecurityException: Unable to find constructor: new common.MetaData java.lang.String java.lang.String java.lang.String java.lang.String common.VersionInfo java.lang.String java.lang.String java.util.LinkedHashMap java.lang.String java.lang.String java.lang.String [Pipeline] echo 01:00:15 java.lang.SecurityException: Unable to find constructor: new common.MetaData java.lang.String java.lang.String java.lang.String java.lang.String common.VersionInfo java.lang.String java.lang.String java.util.LinkedHashMap java.lang.String java.lang.String java.lang.String https://ci.adoptopenjdk.net/view/Failed%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-hotspot/727/console Likely caused by new commit: https://github.com/AdoptOpenJDK/openjdk-build/commit/433c6f2324d2b6f52a8fcf4611ab642c89ee77e3

test-macincloud-macos1014-x64-1 offline and cannot be brought online https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1628 Node has got stuck, Re-launch fails to do anything, it just switches to the log that falsely claims the node is online...

Gradle glitch: https://ci.adoptopenjdk.net/view/Failed%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-aarch64-openj9-linuxXL/394/console

00:39:42  To honour the JVM settings for this build a new JVM will be forked. Please consider using the daemon: https://docs.gradle.org/6.5/userguide/gradle_daemon.html.
00:39:42  Daemon will be stopped at the end of the build stopping after processing
00:39:43  
00:39:43  FAILURE: Build failed with an exception.
00:39:43  
00:39:43  * What went wrong:
00:39:43  Could not determine the dependencies of task ':shadowJar'.
00:39:43  > Could not resolve all dependencies for configuration ':runtimeClasspath'.
00:39:43     > Could not resolve org.testng:testng:7.2.0.
00:39:43       Required by:
00:39:43           project : > org.codehaus.groovy:groovy-all:3.0.4 > org.codehaus.groovy:groovy-testng:3.0.4
00:39:43        > Could not resolve org.testng:testng:7.2.0.
00:39:43           > Could not get resource 'https://repository.mulesoft.org/nexus/content/repositories/public/org/testng/testng/7.2.0/testng-7.2.0.pom'.
00:39:43              > Could not GET 'https://repository.mulesoft.org/nexus/content/repositories/public/org/testng/testng/7.2.0/testng-7.2.0.pom'. Received status code 401 from server: Unauthorized
00:39:43  
00:39:43  * Try:
00:39:43  Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
00:39:43  
00:39:43  * Get more help at https://help.gradle.org
00:39:43  
00:39:43  Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
00:39:43  Use '--warning-mode all' to show the individual deprecation warnings.
00:39:43  See https://docs.gradle.org/6.5/userguide/command_line_interface.html#sec:command_line_warnings
00:39:43  
00:39:43  BUILD FAILED in 13s
00:39:43  RETRYWARNING: Gradle failed on attempt 3

aarch64 were all failing with "laggy filesystem" errors and aborting after 30 minutes. Seemed to resolve itself but was happening on multipple buids between Saturday afternoon (17th) and this afternoon (19th) https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1630

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x64-openj9-windowsXL/538/console

00:28:45  Creating support/demos/image/jfc/Notepad/Notepad.jar
00:28:45  java.lang.InternalError: Unexpected CryptoAPI failure generating seed
00:28:45    at java.base/sun.security.provider.NativeSeedGenerator.getSeedBytes(NativeSeedGenerator.java:62)
00:28:45    at java.base/sun.security.provider.SeedGenerator.generateSeed(SeedGenerator.java:144)
00:28:45    at java.base/sun.security.provider.AbstractDrbg.lambda$static$0(AbstractDrbg.java:524)
00:28:45    at java.base/sun.security.provider.AbstractDrbg.getEntropyInput(AbstractDrbg.java:507)
00:28:45    at java.base/sun.security.provider.AbstractDrbg.getEntropyInput(AbstractDrbg.java:494)
00:28:45    at java.base/sun.security.provider.AbstractDrbg.instantiateIfNecessary(AbstractDrbg.java:696)
00:28:45    at java.base/sun.security.provider.AbstractDrbg.engineNextBytes(AbstractDrbg.java:378)
00:28:45    at java.base/sun.security.provider.AbstractDrbg.engineNextBytes(AbstractDrbg.java:334)
00:28:45    at java.base/sun.security.provider.AbstractDrbg$SeederHolder.lambda$static$0(AbstractDrbg.java:558)
00:28:45    at java.base/sun.security.provider.AbstractDrbg.getEntropyInput(AbstractDrbg.java:507)
00:28:45    at java.base/sun.security.provider.AbstractDrbg.getEntropyInput(AbstractDrbg.java:494)
00:28:45    at java.base/sun.security.provider.AbstractDrbg.instantiateIfNecessary(AbstractDrbg.java:696)
00:28:45    at java.base/sun.security.provider.AbstractDrbg.engineNextBytes(AbstractDrbg.java:378)
00:28:45    at java.base/sun.security.provider.AbstractDrbg.engineNextBytes(AbstractDrbg.java:334)
00:28:45    at java.base/sun.security.provider.DRBG.engineNextBytes(DRBG.java:233)
00:28:45    at java.base/java.security.SecureRandom.nextBytes(SecureRandom.java:741)
00:28:45    at java.base/java.security.SecureRandom.next(SecureRandom.java:798)
00:28:45    at java.base/java.util.Random.nextLong(Random.java:424)
00:28:45    at java.base/java.io.File$TempDirectory.generateFile(File.java:1928)
00:28:45    at java.base/java.io.File.createTempFile(File.java:2076)
00:28:45    at java.base/java.io.File.createTempFile(File.java:2136)
00:28:45    at jdk.jartool/sun.tools.jar.Main.createTemporaryFile(Main.java:1712)
00:28:45    at jdk.jartool/sun.tools.jar.Main.run(Main.java:313)
00:28:45    at jdk.jartool/sun.tools.jar.Main.main(Main.java:1669)
00:28:45  make[3]: *** [CompileDemos.gmk:202: /cygdrive/j/jenkins/tmp/workspace/build/src/build/windows-x86_64-normal-server-release/support/demos/image/jfc/Notepad/Notepad.jar] Error 1

https://ci.adoptopenjdk.net/job/build-scripts/job/release/job/create_installer_windows/9030/console

WScript.CreateObject 80020009: Could not locate automation class named "Wscript.Shell".
WiLangId failed with : 2
Failed to generate setup translation of culture "ja-jp" with LangID "1041".
failed to build translation ja-jp 1041
Build step 'Execute Windows batch command' marked build as failure

Both of the previous two failures occurred on build-azure-win2012r2-x64-1 - the create_installer_windows issue did not recur evenon the same machine after a re-run

Both build-macstadium-macos1014-x64-1 build-macstadium-macos1014-x64-2 went offline for no apparent reason, had to use the add dummy label trick to re-enable

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-aarch64-openj9/552/console

[Pipeline] library
23:31:54  Loading library openjdk-jenkins-helper@master
[Pipeline] End of Pipeline
[Checks API] No suitable checks publisher found.
java.util.ConcurrentModificationException
    at java.util.ArrayList$Itr.checkForComodification(ArrayList.java:911)
    at java.util.ArrayList$Itr.next(ArrayList.java:861)
    at com.thoughtworks.xstream.converters.collections.CollectionConverter.marshal(CollectionConverter.java:73)
    at com.thoughtworks.xstream.core.AbstractReferenceMarshaller.convert(AbstractReferenceMarshaller.java:69)
    at com.thoughtworks.xstream.core.TreeMarshaller.convertAnother(TreeMarshaller.java:58)
    at com.thoughtworks.xstream.core.AbstractReferenceMarshaller$1.convertAnother(AbstractReferenceMarshaller.java:84)
    at hudson.util.RobustReflectionConverter.marshallField(RobustReflectionConverter.java:264)
    at hudson.util.RobustReflectionConverter$2.writeField(RobustReflectionConverter.java:251)
Caused: java.lang.RuntimeException: Failed to serialize org.jenkinsci.plugins.workflow.libs.LibrariesAction#libraries for class org.jenkinsci.plugins.workflow.libs.LibrariesAction
    at hudson.util.RobustReflectionConverter$2.writeField(RobustReflectionConverter.java:255)
    at hudson.util.RobustReflectionConverter$2.visit(RobustReflectionConverter.java:223)
    at com.thoughtworks.xstream.converters.reflection.PureJavaReflectionProvider.visitSerializableFields(PureJavaReflectionProvider.java:138)
    at hudson.util.RobustReflectionConverter.doMarshal(RobustReflectionConverter.java:209)
    at hudson.util.RobustReflectionConverter.marshal(RobustReflectionConverter.java:150)
    at com.thoughtworks.xstream.core.AbstractReferenceMarshaller.convert(AbstractReferenceMarshaller.java:69)
    at com.thoughtworks.xstream.core.TreeMarshaller.convertAnother(TreeMarshaller.java:58)
    at com.thoughtworks.xstream.core.TreeMarshaller.convertAnother(TreeMarshaller.java:43)
    at com.thoughtworks.xstream.core.AbstractReferenceMarshaller$1.convertAnother(AbstractReferenceMarshaller.java:88)
    at com.thoughtworks.xstream.converters.collections.AbstractCollectionConverter.writeItem(AbstractCollectionConverter.java:64)
    at com.thoughtworks.xstream.converters.collections.CollectionConverter.marshal(CollectionConverter.java:74)
    at com.thoughtworks.xstream.core.AbstractReferenceMarshaller.convert(AbstractReferenceMarshaller.java:69)
    at com.thoughtworks.xstream.core.TreeMarshaller.convertAnother(TreeMarshaller.java:58)
    at com.thoughtworks.xstream.core.AbstractReferenceMarshaller$1.convertAnother(AbstractReferenceMarshaller.java:84)
    at hudson.util.RobustReflectionConverter.marshallField(RobustReflectionConverter.java:264)
    at hudson.util.RobustReflectionConverter$2.writeField(RobustReflectionConverter.java:251)
Caused: java.lang.RuntimeException: Failed to serialize hudson.model.Actionable#actions for class org.jenkinsci.plugins.workflow.job.WorkflowRun

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-windows-x64-hotspot/312/console

03:40:17  Compiling 131 files for jdk.charsets
03:40:17  Could not create temporary file name for at file!
03:40:17  make[3]: *** [CompileJavaModules.gmk:614: /cygdrive/e/jenkins/tmp/workspace/build/src/build/windows-x86_64-server-release/jdk/modules/jdk.charsets/_the.jdk.charsets_batch] Error 127
03:40:17  make[2]: *** [make/Main.gmk:193: jdk.charsets-java] Error 2
03:40:17  make[2]: *** Waiting for unfinished jobs....

https://ci.adoptopenjdk.net/job/build-scripts/job/release/job/create_installer_windows/9065/console

Package language = 1041, ProductLanguage = 1041, Database codepage = 932
Done
1031
1036
1041
3082
Building setup translation for culture "zh-cn" with LangID "2052"...
Windows Installer XML Toolset Linker version 3.14.0.3910
Copyright (c) .NET Foundation and contributors. All rights reserved.

CScript Error: Can't find script engine "VBScript" for script "C:\Program Files (x86)\Windows Kits\10\bin\10.0.17763.0\x64\WiLangId.vbs".
WiLangId failed with : 1
Failed to generate setup translation of culture "zh-cn" with LangID "2052".
failed to build translation zh-cn 2052
Build step 'Execute Windows batch command' marked build as failure

Seems to have built fine on this node, just this one off failure.

Is the last one the same as the ja-JP error from yesterday - interestingly it was also on build-azure-win2012r2-x64-1

Also the temporary file issue was on build-ibmcloud-win2012r2-x64-1 - I've asked @Willsparker to take a look at it

Is the last one the same as the ja-JP error from yesterday - interestingly it was also on build-azure-win2012r2-x64-1

Also the temporary file issue was on build-ibmcloud-win2012r2-x64-1 - I've asked @Willsparker to take a look at it

It's doing zh-cn this one, but maybe similar cause possibly

https://ci.adoptopenjdk.net/job/build-scripts/job/release/job/create_installer_mac/5190/console

./packagesbuild.sh: line 194: 52352 Segmentation fault: 11  /usr/bin/productsign --sign "${SIGN_CERT}" build/"$OUTPUT_FILE.pkg" "$OUTPUT_DIRECTORY"
Build step 'Execute shell' marked build as failure

Looks like a seg fault in the Mac sign tool

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-windows-x64-openj9/90/console

20:27:42  Waiting for next available executor on ‘build&&windows&&x64’
20:36:00  Running on winazureb600b0 in c:\users\adoptopenjdk\workspace\build-scripts\jobs\jdk15u\jdk15u-windows-x64-openj9

20:37:01  Execution error: java.io.IOException: Cannot run program "nohup" (in directory "C:\workspace\openjdk-build"): CreateProcess error=2, The system cannot find the file specified
[Pipeline] echo
20:37:01  java.io.IOException: Cannot run program "nohup" (in directory "C:\workspace\openjdk-build"): CreateProcess error=2, The system cannot find the file specified
20:37:01    at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048)

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-windows-x64-openj9/174/consoleFull

04:01:05  Could not create temporary file name for at file!
04:01:05  make[3]: *** [CompileDemos.gmk:164: /cygdrive/e/jenkins/tmp/workspace/build/src/build/windows-x86_64-server-release/support/demos/image/jfc/CodePointIM/CodePointIM.jar] Error 127
04:01:05  make[3]: *** Deleting file '/cygdrive/e/jenkins/tmp/workspace/build/src/build/windows-x86_64-server-release/support/demos/image/jfc/CodePointIM/CodePointIM.jar'
04:01:05  make[3]: *** Waiting for unfinished jobs....

Comes from: https://github.com/openjdk/jdk/blob/379ba80eb7999f60fb12a08a9d0b2ff16263ab23/make/src/native/fixpath.c#L262

  rc = _mktemp_s(name, strlen(name)+1);
  if (rc) {
    fprintf(stderr, "Could not create temporary file name for at file!\n");
    exit(-1);
  }

Testcase hang: https://ci.adoptopenjdk.net/job/Test_openjdk11_j9_extended.functional_aarch64_linux/22/console

04:47:31  Testing: Test 207: Create a non-persistent cache
04:47:31  Test start time: 2020/10/30 04:47:30 Coordinated Universal Time
04:47:31  Running command: "/home/jenkins/workspace/Test_openjdk11_j9_extended.functional_aarch64_linux/openjdkbinary/j2sdk-image/bin/java"  -Xcompressedrefs -Xjit -Xgcpolicy:gencon  -Xtrace:print=j9prt.700 -Xshareclasses:name=ShareClassesCMLTests,nonpersistent -version
04:47:31  Time spent starting: 1 milliseconds
04:57:44  ***[TEST INFO 2020/10/30 04:57:30] ProcessKiller detected a timeout after 600000 milliseconds!***
04:57:44  INFO: getUnixPID() has failed indicating this is not a UNIX System.'Debug on timeout' is currently only supported on Linux.
04:57:44  
04:57:44

https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk15u/job/jdk15u-windows-x64-openj9-windowsXL/96/console

20:48:37  * For target jdk_modules_jdk.internal.jvmstat__the.jdk.internal.jvmstat_batch:
20:48:37  Could not create temporary file name for at file!

The installer sub-jobs for several Mac builds (openj9 + hotspot for head, 11, and 15) e.g.:

https://ci.adoptopenjdk.net/job/build-scripts/job/release/job/create_installer_mac/5268/console

Failed with this error:

Processing: /Users/jenkins/workspace/build-scripts/release/create_installer_mac/workspace/target/OpenJDK-jre_x64_mac_hotspot_2020-11-05-03-30.tar.gz
running ./packagesbuild.sh --sign Developer ID Installer: London Jamocha Community CIC --major_version 16 --full_version 16+22-202011050337 --input_directory jdk-16+22-jre --output_directory /Users/jenkins/workspace/build-scripts/release/create_installer_mac/workspace/target/OpenJDK-jre_x64_mac_hotspot_2020-11-05-03-30.pkg --jvm hotspot --type jre
adoptopenjdk-16.jre: replacing existing signature
adoptopenjdk-16.jre: errSecInternalComponent
Build step 'Execute shell' marked build as failure
Archiving artifacts
[Checks API] No suitable checks publisher found.
Finished: FAILURE

Affected all jdk8 builds in varying ways, I am suspecting a Jenkins/network glitch

Creating placeholder flownodes because failed loading originals.
[Checks API] No suitable checks publisher found.
java.io.IOException: Tried to load head FlowNodes for execution Owner[build-scripts/jobs/jdk8u/jdk8u-aix-ppc64-openj9/877:build-scripts/jobs/jdk8u/jdk8u-aix-ppc64-openj9 #877] but FlowNode was not found in storage for head id:FlowNodeId 1:178
    at org.jenkinsci.plugins.workflow.cps.CpsFlowExecution.initializeStorage(CpsFlowExecution.java:689)
    at org.jenkinsci.plugins.workflow.cps.CpsFlowExecution.onLoad(CpsFlowExecution.java:726)
    at org.jenkinsci.plugins.workflow.job.WorkflowRun.getExecution(WorkflowRun.java:691)
    at org.jenkinsci.plugins.workflow.job.WorkflowRun.onLoad(WorkflowRun.java:550)
    at hudson.model.RunMap.retrieve(RunMap.java:225)
    at hudson.model.RunMap.retrieve(RunMap.java:57)
    at jenkins.model.lazy.AbstractLazyLoadRunMap.load(AbstractLazyLoadRunMap.java:501)
    at jenkins.model.lazy.AbstractLazyLoadRunMap.load(AbstractLazyLoadRunMap.java:483)
    at jenkins.model.lazy.AbstractLazyLoadRunMap.getByNumber(AbstractLazyLoadRunMap.java:381)
    at hudson.model.RunMap.getById(RunMap.java:205)
    at org.jenkinsci.plugins.workflow.job.WorkflowRun$Owner.run(WorkflowRun.java:940)
    at org.jenkinsci.plugins.workflow.job.WorkflowRun$Owner.get(WorkflowRun.java:951)
    at org.jenkinsci.plugins.workflow.flow.FlowExecutionList$1.computeNext(FlowExecutionList.java:65)
    at org.jenkinsci.plugins.workflow.flow.FlowExecutionList$1.computeNext(FlowExecutionList.java:57)
    at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
    at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
    at org.jenkinsci.plugins.workflow.flow.FlowExecutionList$ItemListenerImpl.onLoaded(FlowExecutionList.java:178)
    at jenkins.model.Jenkins.<init>(Jenkins.java:1017)
    at hudson.model.Hudson.<init>(Hudson.java:85)
    at hudson.model.Hudson.<init>(Hudson.java:81)
    at hudson.WebAppMain$3.run(WebAppMain.java:282)
Finished: FAILURE

adoptium / temurin-build

Intermittent build failures list #1450