search

italiangrid / puppet-creamce

puppet module to install and configure a cream CE (EMI3)
Other
0 stars 4 forks source link

Allow configuration of BLAH_JOBID_PREFIX #2

Open lflis opened 7 years ago

lflis commented 7 years ago

Yaim configuration generator allowed to define custom prefix for the names of job submitted to a cluster from particular cream node.

This is important when site is deploying more than one cream node on the same batch system.

For example: In the yaim config file we defined the following variable BLAH_JOBIDPREFIX=crm02

Configuration generator in case of PBS created the following entries in configuration files:

/etc/lrms/scheduler.conf:cream_prefix: crm02_
/etc/lrms/pbs.conf:cream_prefix: crm02_
/etc/glite-ce-cream/cream-config.xml:      <parameter name="BLAH_JOBID_PREFIX" value="crm02_" />

Currenty in case of slurm we need to manually change parameters in scheduler.conf and cream-config.xml after each pupper run

Please consider adding blah::jobid_prefix variable to address this requirement.

sgaravat commented 7 years ago

I raised the same issue and this was implemented with the attribute creamce::job::prefix. At least for LSF it works

lflis commented 7 years ago

Massimo, thank you for pointing this out

I am testing if cream_prefix scheduler.conf is required for slurm (it is only set up for LSF now) Meanwhile it looks like we need to test length of cream prefix in puppet because anything other than 6 characters is rejected

31 Aug 2017 12:34:36,706 WARN org.glite.ce.cream.jobmanagement.cmdexecutor.blah.BLAHExecutor - initExecutor: wrong BLAH_JOBID_PREFIX value length found (crm_ce01_): the prefix must be 6 chars long! Going on with the default value (cream_)

It is important to check if _ is the last char of prefix

pandreetto commented 7 years ago

Unfortunately the documentation in puppet forge is not complete. We're merging the old guide of CREAM with the guide for puppet in these days. The complete documentation won't be published in puppet forge but (probably) in readthedocs or gitbook.

At the moment a WIP guide is avalable at http://www.pd.infn.it/~andreett/pub/cream-guide/index.html