Linux/x64 OpenJ9 build pipelines failing (JDK11 only)

sxa commented 2 years ago

Thank you for reporting a broken build! Please fill in the following details:

Jenkins link to the failing log: https://ci.adoptopenjdk.net/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-x64-openj9/
Which platforms (OS+arch) are affected: Linux/x64
If you look at the historic logs, does the problem appear to be specific to one machine? No

Link to any upstream project bug report (e.g. OpenJ9/JBS) n/a

19:20:14  Compiling 16 files for jdk.security.jgss
19:20:17  ar: creating apps/libapps.a
19:20:17  ar: creating libssl.a
19:20:17  ar: creating test/libtestutil.a
19:20:28  /bin/sh: CCACHE_COMPRESS=1: command not found
19:20:28  Makefile:9018: recipe for target 'test/rsa_complex' failed
19:20:28  gmake[5]: *** [test/rsa_complex] Error 127
19:20:28  gmake[5]: *** Waiting for unfinished jobs....
19:20:28  Makefile:174: recipe for target 'all' failed
19:20:28  gmake[4]: *** [all] Error 2
19:20:28  /home/adoptopenjdk/workspace/build-scripts/jobs/jdk11u/jdk11u-linux-x64-openj9/workspace/build/src/closed/openssl.gmk:41: recipe for target 'build_openssl' failed
19:20:28  gmake[3]: *** [build_openssl] Error 1
19:20:28  /home/adoptopenjdk/workspace/build-scripts/jobs/jdk11u/jdk11u-linux-x64-openj9/workspace/build/src/closed/custom/Main.gmk:49: recipe for target 'j9vm-build' failed
19:20:28  gmake[2]: *** [j9vm-build] Error 2
19:20:28  
19:20:28  ERROR: Build failed for targets 'product-images legacy-jre-image test-image debug-image' in configuration 'linux-x86_64-normal-server-release' (exit code 2) 
19:20:28  Stopping sjavac server

FYI @AdamBrousseau I've got a feeling we've seen this before but I haven't got the bandwidth to look into it just now. Seems to have been broken for a while (Cc @smlambert @andrew-m-leonard)

karianna commented 2 years ago

This is a ci.adoptopenjdk.net failure only. Semeru builds fine on their CI

sxa commented 2 years ago

@AdamBrousseau Do you remember if we did see this one before and what the resolution might have been? Looks like it's running under a base sh or something instead of a shell that supports VAR=value blah blah blah

(Or do you just have all ccache stuff disabled on your CI?)

AdamBrousseau commented 2 years ago

Looks like OpenSSL failing to compile. Is your build still using the container's v1.0.2?

--with-openssl=/usr/local/openssl-1.0.2

sxa commented 2 years ago

@AdamBrousseau Am I right in saying that you're currently building using CentOS7? We're still building on the CentOS6 container image which is why it's pointing to the separate openssl, so we should possibly switch over to using 7 now. https://ci.adoptopenjdk.net/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-x64-openj9/1103/ seemed to run through ok on CentOS7 and not using the separate /usr/local parameter to pick up openssl.

AdamBrousseau commented 2 years ago

OpenJ9 & Semeru are still using cent6 for jdk8 & 11. Semeru was using an older version of the Adopt build container that still had 1.0.2 up until last week when a Jenkins plugin regression broke us. The regression is not resolved yet but in the meantime I have changed all our compiles to use the latest containers (we had them frozen on jdk8 and also aarch64) and also disable-ccache on jdk11 xlinux. We only switched to cent7 on xlinux jdk15+.

AdamBrousseau commented 3 months ago

Guessing this can be closed?

karianna commented 3 months ago

@sxa to confirm

sxa commented 3 months ago

Let's keep it open for now as Adam has put in some fixes and we're going to discuss this further this week ...

adoptium / temurin-build

Linux/x64 OpenJ9 build pipelines failing (JDK11 only) #2763