saltstack / salt-bootstrap

Generic Salt Bootstrap Script
Other
928 stars 551 forks source link

rhel based - nightly bootstraps are failing #1941

Closed ITJamie closed 1 year ago

ITJamie commented 1 year ago

Description of Issue/Question

the salt-formulas working group is attempting to cleanup some of our build images, we have noticed that all the rhel nightlys are failing to build. there is an attempt to download a signing pub key from a URL that doesn't exist:

* ERROR: https://repo.saltproject.io/salt-dev/salt/py3/redhat/8/x86_64/SALT-PROJECT-GPG-PUBKEY-2023.pub failed to download to /tmp/salt-gpg-TdymRsEw.pub

the URL that's being calculated for the RHEL nightlys is incorrect, in the repo the file is called SALTSTACK-GPG-KEY.pub, not SALT-PROJECT-GPG-PUBKEY-2023.pub

Steps to Reproduce Issue

on almalinux 8

 curl -L https://raw.githubusercontent.com/saltstack/salt-bootstrap/develop/bootstrap-salt.sh 
 sh -s -- -XUdfPD -x python3 onedir nightly
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0 *  INFO: Running version: 2023.06.28
 *  INFO: Executed by: 
 *  INFO: Command line: 'sh -XUdfPD -x python3 onedir nightly'
 *  WARN: Running the unstable version of bootstrap-salt.sh

 *  INFO: System Information:
 *  INFO:   CPU:          AuthenticAMD
 *  INFO:   CPU Arch:     x86_64
 *  INFO:   OS Name:      Linux
 *  INFO:   OS Version:   5.4.109+
 *  INFO:   Distribution: AlmaLinux 8.8

 * DEBUG: Binaries will be searched using the following $PATH: /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
 *  INFO: Installing minion
 *  INFO: Daemons will not be started
  100  345k    0     0  1521k      0 --:--:-- --:--:-- --:--:-- 1521k
 * DEBUG: install_almalinux_8_onedir_deps not found....
 * DEBUG: install_almalinux_8_8_onedir_deps not found....
 * DEBUG: install_almalinux_8_deps not found....
 * DEBUG: install_almalinux_8_8_deps not found....
 *  INFO: Found function install_almalinux_onedir_deps
 * DEBUG: DEPS_INSTALL_FUNC=install_almalinux_onedir_deps
 * DEBUG: config_almalinux_8_onedir_salt not found....
 * DEBUG: config_almalinux_8_8_onedir_salt not found....
 * DEBUG: config_almalinux_8_salt not found....
 * DEBUG: config_almalinux_8_8_salt not found....
 * DEBUG: config_almalinux_onedir_salt not found....
 * DEBUG: config_almalinux_salt not found....
 *  INFO: Found function config_salt
 * DEBUG: CONFIG_SALT_FUNC=config_salt
 * DEBUG: preseed_almalinux_8_onedir_master not found....
 * DEBUG: preseed_almalinux_8_8_onedir_master not found....
 * DEBUG: preseed_almalinux_8_master not found....
 * DEBUG: preseed_almalinux_8_8_master not found....
 * DEBUG: preseed_almalinux_onedir_master not found....
 * DEBUG: preseed_almalinux_master not found....
 *  INFO: Found function preseed_master
 * DEBUG: PRESEED_MASTER_FUNC=preseed_master
 * DEBUG: INSTALL_FUNC_NAMES=install_almalinux_8_onedir install_almalinux_8_8_onedir install_almalinux_onedir
 * DEBUG: install_almalinux_8_onedir not found....
 * DEBUG: install_almalinux_8_8_onedir not found....
 *  INFO: Found function install_almalinux_onedir
 * DEBUG: INSTALL_FUNC=install_almalinux_onedir
 * DEBUG: install_almalinux_8_onedir_post not found....
 * DEBUG: install_almalinux_8_8_onedir_post not found....
 * DEBUG: install_almalinux_8_post not found....
 * DEBUG: install_almalinux_8_8_post not found....
 *  INFO: Found function install_almalinux_onedir_post
 * DEBUG: POST_INSTALL_FUNC=install_almalinux_onedir_post
 * DEBUG: install_almalinux_8_onedir_restart_daemons not found....
 * DEBUG: install_almalinux_8_8_onedir_restart_daemons not found....
 * DEBUG: install_almalinux_8_restart_daemons not found....
 * DEBUG: install_almalinux_8_8_restart_daemons not found....
 * DEBUG: install_almalinux_onedir_restart_daemons not found....
 *  INFO: Found function install_almalinux_restart_daemons
 * DEBUG: STARTDAEMONS_INSTALL_FUNC=install_almalinux_restart_daemons
 * DEBUG: daemons_running_almalinux_8_onedir not found....
 * DEBUG: daemons_running_almalinux_8_8_onedir not found....
 * DEBUG: daemons_running_almalinux_8 not found....
 * DEBUG: daemons_running_almalinux_8_8 not found....
 * DEBUG: daemons_running_almalinux_onedir not found....
 * DEBUG: daemons_running_almalinux not found....
 *  INFO: Found function daemons_running_onedir
 * DEBUG: DAEMONS_RUNNING_FUNC=daemons_running_onedir
 * DEBUG: CHECK_SERVICES_FUNC=null
 *  INFO: Running install_almalinux_onedir_deps()
AlmaLinux 8 - BaseOS                             16 MB/s | 4.0 MB     00:00    
AlmaLinux 8 - AppStream                          12 MB/s |  11 MB     00:00    
AlmaLinux 8 - Extras                             62 kB/s |  18 kB     00:00    
Dependencies resolved.
================================================================================
 Package                  Arch      Version                  Repository    Size
================================================================================
Upgrading:
 krb5-devel               x86_64    1.18.2-25.el8_8          baseos       561 k
 krb5-libs                x86_64    1.18.2-25.el8_8          baseos       841 k
 libkadm5                 x86_64    1.18.2-25.el8_8          baseos       187 k
 platform-python          x86_64    3.6.8-51.el8_8.1.alma    baseos        86 k
 platform-python-devel    x86_64    3.6.8-51.el8_8.1.alma    appstream    239 k
 python3-libs             x86_64    3.6.8-51.el8_8.1.alma    baseos       7.8 M
 sqlite-libs              x86_64    3.26.0-18.el8_8          baseos       580 k

Transaction Summary
================================================================================
Upgrade  7 Packages

Total download size: 10 M
Downloading Packages:
(1/7): libkadm5-1.18.2-25.el8_8.x86_64.rpm      2.9 MB/s | 187 kB     00:00    
(2/7): platform-python-3.6.8-51.el8_8.1.alma.x8 4.7 MB/s |  86 kB     00:00    
(3/7): krb5-devel-1.18.2-25.el8_8.x86_64.rpm    6.0 MB/s | 561 kB     00:00    
(4/7): krb5-libs-1.18.2-25.el8_8.x86_64.rpm     8.0 MB/s | 841 kB     00:00    
(5/7): sqlite-libs-3.26.0-18.el8_8.x86_64.rpm    19 MB/s | 580 kB     00:00    
(6/7): platform-python-devel-3.6.8-51.el8_8.1.a  12 MB/s | 239 kB     00:00    
(7/7): python3-libs-3.6.8-51.el8_8.1.alma.x86_6  49 MB/s | 7.8 MB     00:00    
--------------------------------------------------------------------------------
Total                                            17 MB/s |  10 MB     00:00     
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                        1/1 
  Upgrading        : krb5-libs-1.18.2-25.el8_8.x86_64                      1/14 
  Upgrading        : libkadm5-1.18.2-25.el8_8.x86_64                       2/14 
  Upgrading        : sqlite-libs-3.26.0-18.el8_8.x86_64                    3/14 
  Upgrading        : python3-libs-3.6.8-51.el8_8.1.alma.x86_64             4/14 
  Upgrading        : platform-python-3.6.8-51.el8_8.1.alma.x86_64          5/14 
  Running scriptlet: platform-python-3.6.8-51.el8_8.1.alma.x86_64          5/14 
  Upgrading        : platform-python-devel-3.6.8-51.el8_8.1.alma.x86_64    6/14 
  Upgrading        : krb5-devel-1.18.2-25.el8_8.x86_64                     7/14 
  Cleanup          : krb5-devel-1.18.2-22.el8_7.x86_64                     8/14 
  Cleanup          : platform-python-devel-3.6.8-51.el8.alma.x86_64        9/14 
  Cleanup          : libkadm5-1.18.2-22.el8_7.x86_64                      10/14 
  Cleanup          : platform-python-3.6.8-51.el8.alma.x86_64             11/14 
  Running scriptlet: platform-python-3.6.8-51.el8.alma.x86_64             11/14 
  Cleanup          : python3-libs-3.6.8-51.el8.alma.x86_64                12/14 
  Cleanup          : sqlite-libs-3.26.0-17.el8_7.x86_64                   13/14 
  Cleanup          : krb5-libs-1.18.2-22.el8_7.x86_64                     14/14 
  Running scriptlet: krb5-libs-1.18.2-22.el8_7.x86_64                     14/14 
  Verifying        : krb5-devel-1.18.2-25.el8_8.x86_64                     1/14 
  Verifying        : krb5-devel-1.18.2-22.el8_7.x86_64                     2/14 
  Verifying        : krb5-libs-1.18.2-25.el8_8.x86_64                      3/14 
  Verifying        : krb5-libs-1.18.2-22.el8_7.x86_64                      4/14 
  Verifying        : libkadm5-1.18.2-25.el8_8.x86_64                       5/14 
  Verifying        : libkadm5-1.18.2-22.el8_7.x86_64                       6/14 
  Verifying        : platform-python-3.6.8-51.el8_8.1.alma.x86_64          7/14 
  Verifying        : platform-python-3.6.8-51.el8.alma.x86_64              8/14 
  Verifying        : python3-libs-3.6.8-51.el8_8.1.alma.x86_64             9/14 
  Verifying        : python3-libs-3.6.8-51.el8.alma.x86_64                10/14 
  Verifying        : sqlite-libs-3.26.0-18.el8_8.x86_64                   11/14 
  Verifying        : sqlite-libs-3.26.0-17.el8_7.x86_64                   12/14 
  Verifying        : platform-python-devel-3.6.8-51.el8_8.1.alma.x86_64   13/14 
  Verifying        : platform-python-devel-3.6.8-51.el8.alma.x86_64       14/14 

Upgraded:
  krb5-devel-1.18.2-25.el8_8.x86_64                                             
  krb5-libs-1.18.2-25.el8_8.x86_64                                              
  libkadm5-1.18.2-25.el8_8.x86_64                                               
  platform-python-3.6.8-51.el8_8.1.alma.x86_64                                  
  platform-python-devel-3.6.8-51.el8_8.1.alma.x86_64                            
  python3-libs-3.6.8-51.el8_8.1.alma.x86_64                                     
  sqlite-libs-3.26.0-18.el8_8.x86_64                                            

Complete!
 * ERROR: https://repo.saltproject.io/salt-dev/salt/py3/redhat/8/x86_64/SALT-PROJECT-GPG-PUBKEY-2023.pub failed to download to /tmp/salt-gpg-TdymRsEw.pub
 * ERROR: Failed to run install_almalinux_onedir_deps()!!!
 * DEBUG: Removing the logging pipe /tmp/bootstrap-salt.logpipe
 * DEBUG: Removing the temporary apt error file /tmp/apt_error.ZP9L7W

Versions and Systems

unable to get that far.

build logs:

alma8: https://gitlab.com/saltstack-formulas/infrastructure/salt-image-builder/-/jobs/4634110909 alma9: https://gitlab.com/saltstack-formulas/infrastructure/salt-image-builder/-/jobs/4634110899 amazon2.0: https://gitlab.com/saltstack-formulas/infrastructure/salt-image-builder/-/jobs/4634110918 rocky8: https://gitlab.com/saltstack-formulas/infrastructure/salt-image-builder/-/jobs/4634110996 rocky9: https://gitlab.com/saltstack-formulas/infrastructure/salt-image-builder/-/jobs/4634110992