adoptium / infrastructure

This repo contains all information about machine maintenance.
Apache License 2.0
85 stars 101 forks source link

AIX build box 1 not successfully building #414

Closed sxa closed 5 years ago

sxa commented 6 years ago

Leaving this open because I've had some issues with build-ppc-osuosl-ppc64-aix-1, and will start properly logging everything in here as I'm starting to lose track. Build machine build-ppc-osuosl-ppc64-aix-2 has been generally ok as far as I can tell.

mleipe commented 6 years ago

Are both machines configured with the same playbook?

jdekonin commented 6 years ago

Are your failures on JDK11, looking like this? https://github.com/eclipse/openj9/issues/2468

In setup of OpenJ9 pull request jobs, I could never get a successful jdk11 compile on aix.

sej-jackson commented 6 years ago

@sxa555 could you let me know some details please so I can take a look for you?

sej-jackson commented 6 years ago

It looks like aix-1 has incompatible versions of libgcc & gmp rpms - both systems have libgcc-4.8.5-1.pcc, but aix-1 has gmp-6.1.2-1.pcc (which contains references to symbols _GLOBAL__AIXI_shr_o & _GLOBAL__AIXD_shr_o) whereas gmp-5.1.3-2.ppc on aix-2 doesn't which is why it's not complaining. It appears you need libgcc-6.3.0-1.ppc to go with gmp-6.1.2-1.

sxa commented 6 years ago

I suspect that given what @sej-jackson has found that a library (presumably a dependency of something else) has got updated when I was prototyping some changes for java11 on that machine. Should be easy enough to fix. @mleipe Yes they were originally but I was using the -1 machine to test extra setup which was required for java 11 building and during that likely caused the breakage (the risk of that happening was why I only touched one machine of course)

I will look at either dropping the version of gmp or allowing a later libgccto be installed on that machine (although it's surprising that yum left it in that state)

sxa commented 6 years ago

@jdekonin No I haven't hit that particular failure (yet) At the moment our machines don't have a suitable autoconf that JDK11 likes (See this log) so I almost certainly just haven't got as a far as that error but thanks for the heads-up!

sxa commented 5 years ago

Downloaded https://public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc/gmp/gmp-5.1.3-2.aix6.1.ppc.rpm then:

# rpm -Uvh --oldpackage gmp-6.1.2-1.aix6.1.ppc.rpm gmp-5.1.3-2.aix6.1.ppc.rpm
warning: package gmp-6.1.2-1.ppc was already added, skipping gmp-5.1.3-2.ppc
Preparing...                ########################################### [100%]
        package gmp-6.1.2-1.ppc is already installed
# yum downgrade gmp-6.1.2-1.aix6.1.ppc.rpm gmp-5.1.3-2.aix6.1.ppc.rpm
Setting up Downgrade Process
AIX_Toolbox                                                     | 2.9 kB  00:00:00     
AIX_Toolbox/primary_db                                          | 1.1 MB  00:00:03     
AIX_Toolbox_71                                                  | 2.9 kB  00:00:00     
AIX_Toolbox_71/primary_db                                       |  13 kB  00:00:00     
AIX_Toolbox_noarch                                              | 2.9 kB  00:00:00     
AIX_Toolbox_noarch/primary_db                                   |  51 kB  00:00:00     
Examining gmp-6.1.2-1.aix6.1.ppc.rpm: gmp-6.1.2-1.ppc
Only Upgrade available on package: gmp-6.1.2-1.ppc
Examining gmp-5.1.3-2.aix6.1.ppc.rpm: gmp-5.1.3-2.ppc
Resolving Dependencies
--> Running transaction check
---> Package gmp.ppc 0:5.1.3-2 will be a downgrade
---> Package gmp.ppc 0:6.1.2-1 will be erased
--> Finished Dependency Resolution

Dependencies Resolved

=======================================================================================
 Package       Arch          Version           Repository                         Size
=======================================================================================
Downgrading:
 gmp           ppc           5.1.3-2           /gmp-5.1.3-2.aix6.1.ppc           2.6 M

Transaction Summary
=======================================================================================
Downgrade     1 Package

Total size: 2.6 M
Is this ok [y/N]: y
Downloading Packages:
Running Transaction Check
Running Transaction Test
Transaction Test Succeeded
Running Transaction
  Installing : gmp-5.1.3-2.ppc                                                     1/2 
  Cleanup    : gmp-6.1.2-1.ppc                                                     2/2 

Removed:
  gmp.ppc 0:6.1.2-1                                                                    

Installed:
  gmp.ppc 0:5.1.3-2                                                                    

Complete!
# 
sxa commented 5 years ago

JDK8+HotSpot has built successfully on the machine

sxa commented 5 years ago

JDK11+OpenJ9 failed prior to installing these dependencies via yum:

sxa commented 5 years ago

All working ... Closing :-D

sxa commented 5 years ago

Also killed an apparently defunct jenkins slave process that was holding the CPU load at almost 10 on the machine:

# ps -fu jenkins
     UID      PID     PPID   C    STIME    TTY  TIME CMD
 jenkins  9699536        1 431   Nov 02      - 13901:28 java -jar remoting.jar -workDir 
sxa commented 5 years ago

Killed multiple processes today:

     UID      PID     PPID   C    STIME    TTY  TIME CMD
 jenkins  9633954        1   0   Dec 11      -  0:00 /ramdisk0/build/workspace/Grinder/openjdkbinary/j2sdk-image/bin/../bin/java -cp /ramdisk0/build/workspace/Grinder/jvmtest/openjdk_regression/work/classes/ja
 jenkins  6029718        1   0   Dec 11      -  0:00 /ramdisk0/build/workspace/Grinder/openjdkbinary/j2sdk-image/bin/../bin/java -cp /ramdisk0/build/workspace/Grinder/jvmtest/openjdk_regression/work/classes/ja
 jenkins  6160736        1   0   Nov 15      -  0:00 /ramdisk0/build/workspace/openjdk11_j9_openjdktest_ppc64_aix/openjdkbinary/j2sdk-image/bin/../bin/java -cp /ramdisk0/build/workspace/openjdk11_j9_openjdktes
 jenkins  8323494        1   0   Dec 11      -  0:00 /ramdisk0/build/workspace/Grinder/openjdkbinary/j2sdk-image/bin/../bin/java -cp /ramdisk0/build/workspace/Grinder/jvmtest/openjdk_regression/work/classes/ja
$