glideinWMS / glideinwms

The glideinWMS Project
http://tinyurl.com/glideinwms
Apache License 2.0
16 stars 46 forks source link

cvmfsexec.cfg assumed blank and recreated at every factory reconfig #348

Closed mmascher closed 1 year ago

mmascher commented 1 year ago

Describe the bug Every time the reconfigure command is executed in the factory several messages regarding the recreation of the cvmfsexec.cfg file appears.

To Reproduce Run reconfigure with some entries and no cvmfs configuration.

Expected behavior Those files should just be created once if necessary, or no messages should appear.

Screenshots

Assuming blank, and re-creating...
Error opening /var/lib/gwms-factory/work-dir/entry_CMSHTPC_T2_US_Purdue_Negishi/cvmfsexec.cfg: [Errno 2] No such file or directory: '/var/lib/gwms-factory/work-dir/entry_CMSHTPC_T2_US_Purdue_Negishi/cvmfsexec.cfg'
Assuming blank, and re-creating...
Error opening /var/lib/gwms-factory/work-dir/entry_CMSHTPC_T2_US_Purdue_Negishi_Op/cvmfsexec.cfg: [Errno 2] No such file or directory: '/var/lib/gwms-factory/work-dir/entry_CMSHTPC_T2_US_Purdue_Negishi_Op/cvmfsexec.cfg'
Assuming blank, and re-creating...
Error opening /var/lib/gwms-factory/work-dir/entry_CMSHTPC_T2_US_Purdue_Rice/cvmfsexec.cfg: [Errno 2] No such file or directory: '/var/lib/gwms-factory/work-dir/entry_CMSHTPC_T2_US_Purdue_Rice/cvmfsexec.cfg'
Assuming blank, and re-creating...
Error opening /var/lib/gwms-factory/work-dir/entry_CMSHTPC_T2_US_Purdue_hansen/cvmfsexec.cfg: [Errno 2] No such file or directory: '/var/lib/gwms-factory/work-dir/entry_CMSHTPC_T2_US_Purdue_hansen/cvmfsexec.cfg'
Assuming blank, and re-creating...
Error opening /var/lib/gwms-factory/work-dir/entry_CMSHTPC_T2_US_UCSD_gw2/cvmfsexec.cfg: [Errno 2] No such file or directory: '/var/lib/gwms-factory/work-dir/entry_CMSHTPC_T2_US_UCSD_gw2/cvmfsexec.cfg'
Assuming blank, and re-creating...
Error opening /var/lib/gwms-factory/work-dir/entry_CMSHTPC_T2_US_UCSD_gw4/cvmfsexec.cfg: [Errno 2] No such file or directory: '/var/lib/gwms-factory/work-dir/entry_CMSHTPC_T2_US_UCSD_gw4/cvmfsexec.cfg'
Assuming blank, and re-creating...
Error opening /var/lib/gwms-factory/work-dir/entry_CMSHTPC_T2_US_UCSD_gw4_gpu/cvmfsexec.cfg: [Errno 2] No such file or directory: '/var/lib/gwms-factory/work-dir/entry_CMSHTPC_T2_US_UCSD_gw4_gpu/cvmfsexec.cfg'
Assuming blank, and re-creating...
Error opening /var/lib/gwms-factory/work-dir/entry_CMSHTPC_T2_US_UCSD_gw6/cvmfsexec.cfg: [Errno 2] No such file or directory: '/var/lib/gwms-factory/work-dir/entry_CMSHTPC_T2_US_UCSD_gw6/cvmfsexec.cfg'
Assuming blank, and re-creating...
Error opening /var/lib/gwms-factory/work-dir/entry_CMSHTPC_T2_US_UCSD_gw6_Comet/cvmfsexec.cfg: [Errno 2] No such file or directory: '/var/lib/gwms-factory/work-dir/entry_CMSHTPC_T2_US_UCSD_gw6_Comet/cvmfsexec.cfg'
Assuming blank, and re-creating...
Error opening /var/lib/gwms-factory/work-dir/entry_CMSHTPC_T2_US_UCSD_gw6_fake/cvmfsexec.cfg: [Errno 2] No such file or directory: '/var/lib/gwms-factory/work-dir/entry_CMSHTPC_T2_US_UCSD_gw6_fake/cvmfsexec.cfg'
Assuming blank, and re-creating...
Error opening /var/lib/gwms-factory/work-dir/entry_CMSHTPC_T2_US_UCSD_gw7/cvmfsexec.cfg: [Errno 2] No such file or directory: '/var/lib/gwms-factory/work-dir/entry_CMSHTPC_T2_US_UCSD_gw7/cvmfsexec.cfg'
Assuming blank, and re-creating...
Error opening /var/lib/gwms-factory/work-dir/entry_CMSHTPC_T2_US_UCSD_gw7_gpu/cvmfsexec.cfg: [Errno 2] No such file or directory: '/var/lib/gwms-factory/work-dir/entry_CMSHTPC_T2_US_UCSD_gw7_gpu/cvmfsexec.cfg'

Info (please complete the following information):

mambelli commented 1 year ago

This is in a simple test Factory with 3.10.4 and no cvmfsexec line in the configuration (glideinWMS.xml), and never had cvmfsexec that I remember. The default should be that cvmfsexec is disabled and nothing is done.

[root@fermicloud245 ~]# gwms-factory upgrade
Using default factory config file: /etc/gwms-factory/glideinWMS.xml
Error opening /var/lib/gwms-factory/work-dir/cvmfsexec.cfg: [Errno 2] No such file or directory: '/var/lib/gwms-factory/work-dir/cvmfsexec.cfg'
Assuming blank, and re-creating...
Error opening /var/lib/gwms-factory/work-dir/entry_DUNE_T3_US_NERSC_Perlmutter_triton_SL7/cvmfsexec.cfg: [Errno 2] No such file or directory: '/var/lib/gwms-factory/work-dir/entry_DUNE_T3_US_NERSC_Perlmutter_triton_SL7/cvmfsexec.cfg'
Assuming blank, and re-creating...
Error opening /var/lib/gwms-factory/work-dir/entry_TEST_ENTRY/cvmfsexec.cfg: [Errno 2] No such file or directory: '/var/lib/gwms-factory/work-dir/entry_TEST_ENTRY/cvmfsexec.cfg'
Assuming blank, and re-creating...
Error opening /var/lib/gwms-factory/work-dir/entry_fermicloud489_GSI/cvmfsexec.cfg: [Errno 2] No such file or directory: '/var/lib/gwms-factory/work-dir/entry_fermicloud489_GSI/cvmfsexec.cfg'
Assuming blank, and re-creating...
Error opening /var/lib/gwms-factory/work-dir/entry_fermicloud489_SciToken/cvmfsexec.cfg: [Errno 2] No such file or directory: '/var/lib/gwms-factory/work-dir/entry_fermicloud489_SciToken/cvmfsexec.cfg'
Assuming blank, and re-creating...
Error opening /var/lib/gwms-factory/work-dir/entry_fermicloud528/cvmfsexec.cfg: [Errno 2] No such file or directory: '/var/lib/gwms-factory/work-dir/entry_fermicloud528/cvmfsexec.cfg'
Assuming blank, and re-creating...
No sources specified. Building/Rebuilding of cvmfsexec distributions disabled!

=======================!!WARNING!!========================
There might be existing cvmfsexec distributions, from a
previous factory reconfig that might be obsolete in case
a newer version of cvmfsexec exists. If using the on-demand
CVMFS provisioning feature, it is recommended to build
the cvmfsexec distributions from scratch so that the latest
version of distributions are shipped with the glideins.
==========================================================
...Ignoring building/rebuilding of cvmfsexec distributions.
...Updated the glidein_startup.sh and local_start.sh scripts
...Updated the glidein_startup.sh file in the staging area
...Updated the factory_startup script
...Reconfigured glidein 'gfactory_instance' is complete
...Active entries are:
     DUNE_T3_US_NERSC_Perlmutter_triton_SL7
     fermicloud528
...Verifying rrd schema
...Submit files are in /var/lib/gwms-factory/work-dir
Upgrading the factory                                      [  OK  ]
[root@fermicloud245 ~]# grep cvmfs /etc/gwms-factory/glideinWMS.xml
[root@fermicloud245 ~]#

And after running the upgrade the cvmfsexec.cfg files are not there, so the same error messages will repeat the next time. Some considerations:

Probably the check on wether to run the cvmfsexec is too late, if should be before the invocation of the code.