test SL7 container in AL9

[gavinsdavies]

SL7 Containerization Task Force requests that experiments test their SL7 environments in the standard container on an AL9 VM.

I'm going to attempt to do this, and will report progress here. Note AL9 VM is: emphaticgpvm-test-al9

container: /cvmfs/singularity.opensciencegrid.org/fermilab/fnal-wn-sl7:latest

• [x] make a first attempt at setting up and building emphaticsoft
• [x] update RPMs in fnal-wn-sl7:latest
• [x] test art simulation
• [ ] test art reconstruction
• [ ] test caf-making

[gavinsdavies]

Logged on to emphaticgpvm-test-al9 and starting interactive container:

apptainer shell -B /cvmfs -B /run/user -B /exp/emph /cvmfs/singularity.opensciencegrid.org/fermilab/fnal-wn-sl7:latest

Mounting /run/user/ allows for SSH agent forwarding to work seamlessly. Inside the container I tested a "from scratch" build:

cd /exp/emph/app/users/gsdavies/al9
git clone https://github.com/EmphaticSoft/emphaticsoft
source /exp/emph/app/users/gsdavies/al9/emphaticsoft/setup/setup_emphatic.sh
cd /exp/emph/app/users/gsdavies/al9/build;
source /exp/emph/app/users/gsdavies/al9/emphaticsoft/ups/setup_for_development -p
buildtool --generator=ninja

The setup_for_development command was slow. I'll time it next time. The build didn't last very long.

In file included from /cvmfs/emphatic.opensciencegrid.org/products/ifdh_art/v2_15_00/slf7.x86_64.e20.prof/inc/ifdh_art/IFDHService/IFDH_service.h:4,
                 from /exp/emph/app/users/gsdavies/al9/emphaticsoft/CAFMaker/CAFMaker_module.cc:42:
/cvmfs/emphatic.opensciencegrid.org/products/ifdhc/v2_6_8/Linux64bit+3.10-2.17-e20-p3913-prof/inc/ifdh.h:11:10: fatal error: uuid/uuid.h: No such file or directory
   11 | #include <uuid/uuid.h>
      |          ^~~~~~~~~~~~~
compilation terminated.

RPM missing in the apptainer, along with several others. This work is inspired by V Hewes' effort on NOvA. They already identified several RPMs missing from this apptainer and have requested they be added by CSAID

[gavinsdavies]

Vito pointed me to /cvmfs/singularity.opensciencegrid.org/fermilab/fnal-dev-sl7:latest

Use this as the SL7 container:

apptainer shell -B /cvmfs -B /run/user -B /exp/emph /cvmfs/singularity.opensciencegrid.org/fermilab/fnal-dev-sl7:latest

and we get further... to the point of a successful build 🎉 I can move on to testing some runtime examples now.

[gavinsdavies]

art -c g4gen_job.fcl -n 10

incredibly slow ... but works!

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 22.935582 Real = 394.592437

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1566.55 VmHWM = 965.702

real time to run through Geant4: 396.136

[gavinsdavies]

the art sim made these files btw:

G4EMPHGeantinoTuple_V1_undef.txt
G4EMPHARICHHitTuple_V1_Undef.txt
G4EMPHTrackListTuple_V1_undef.txt
G4EMPHLGHitTuple_V1_undef.txt
emphmc_r2293_s1.root

[gavinsdavies]

testing reco and caf:

art -c prod_reco_caf_job.fcl emphmc_r2293_s1.root

Crashed gracefully because it's a configuration issue. Will come back later.

Beam Configuration: 0 GeV/c
**************************************************
Error: Invalid Beam Momentum for BACkov signals
Art has completed and will exit with status 0.

Testing is good.