Tools to submit jobs on the LNGS batch system

[emanueledimarco]

Typical usage:

python3.8 scripts/submit_batch.py $PWD "[3792-3796]" --outdir cosmics_1stset_261120 --dry-run

to create the jobs and just print the commands to submit the jobs. Remove "--dry-run" to submit to the queues for real.

Notes:

• the reconstruction jobs are submitted to the queue "cygno-custom", with an optimal setup which is discussed with S. Stalio: 24 cores, 10 Gb of SSD machine for the input, 30GB memory each.
• no more than 20 jobs can be submitted to this queue otherwise, one can send to the normal queues, but need to write the input to /tmp (this is automatic in the code)

@baracch @gdimperi @davidepinci @SamueleTorelli @gmazzitelli

[emanueledimarco]

Forgetting: this need a macumba that has to be done by each user the first time to install the python libraries on /nfs instead that in the home, since the latter is on AFS and the AFS token is not passed to the batch machines. Will write this on the twiki with @gdimperi @fabriziopetrucci