Use spack in wrappers

[marcmengel]

This change uses the /cvmfs/fermilab.opensciencegrid.org/packages/common Spack area to find ifdhc, via a spack environment, rather than using the UPS pacakges in /cvmfs/fermilab.opensciencegrid.org/products/common, or looking in /grid/fermiapp which hasn't actually worked for some time.

[marcmengel]

Note, we should definitely squash-merge this, as it has been rebased/merged and looks like a lot of commits that way.

[shreyb]

I just tried running all three of those commands on dunegpvm01, and it didn't work:

-bash-4.2$ . /cvmfs/fermilab.opensciencegrid.org/packages/common/setup-env.sh
-bash-4.2$ spack env list
==> 6 environments
    ifdh_env_almalinux9_current  ifdh_env_almalinux9_v2_6_20  ifdh_env_almalinux9_v2_7  ifdh_env_scientific7_current  ifdh_env_scientific7_v2_6_20  ifdh_env_scientific7_v2_7
-bash-4.2$ spack env activate ifdh_env_scientific7_current
==> Warning: could not load runtime environment due to RuntimeError: Unable to locate python command in /cvmfs/fermilab.opensciencegrid.org/packages/common/spack/v0.21.0-fermi/NULL/var/spack/environments/ifdh_env_scientific7_current/.spack-env/view/./bin

Is python missing from those ifdh environments?

[marcmengel]

Sigh. I just renamed the environment directories, but there was a symlink in there that still had the old path...

-- Marc W. Mengel Computer Services Senior Developer

Data Management and Applications Fermi National Accelerator Laboratory 630 840 8256 office www.fnal.govhttps://email.fnal.gov/owa/redir.aspx?C=JkVsWjSyHEuWV2kFJWNPyC9OyMKf7dEIp_yxPk9yfhfadE3mdLfI6T8Ztf8BVaJjzoIe8oJ5H0M.&URL=http%3a%2f%2fwww.fnal.gov https://email.fnal.gov/owa/redir.aspx?C=JkVsWjSyHEuWV2kFJWNPyC9OyMKf7dEIp_yxPk9yfhfadE3mdLfI6T8Ztf8BVaJjzoIe8oJ5H0M.&URL=http%3a%2f%2fwww.fnal.gov Connect with us! Newsletterhttps://email.fnal.gov/owa/redir.aspx?C=-29AtpIe40SAvGF4aiNr86KvVjap7dEIuxIdg8Q5bYa9sT7QTFVhxhVnl8zwXkEuBSuAQLRkEfg.&URL=http%3a%2f%2fwww.fnal.gov%2fpub%2ftoday | Facebookhttps://email.fnal.gov/owa/UrlBlockedError.aspx | Twitterhttps://email.fnal.gov/owa/redir.aspx?C=-29AtpIe40SAvGF4aiNr86KvVjap7dEIuxIdg8Q5bYa9sT7QTFVhxhVnl8zwXkEuBSuAQLRkEfg.&URL=https%3a%2f%2ftwitter.com%2fFermilabToday

---

From: Shreyas Bhat @.> Sent: Wednesday, February 21, 2024 1:44 PM To: fermitools/jobsub_lite @.> Cc: Marc W Mengel @.>; Author @.> Subject: Re: [fermitools/jobsub_lite] Use spack in wrappers (PR #536)

[EXTERNAL] – This message is from an external sender

I just tried running all three of those commands on dunegpvm01, and it didn't work:

-bash-4.2$ . /cvmfs/fermilab.opensciencegrid.org/packages/common/setup-env.sh -bash-4.2$ spack env list ==> 6 environments ifdh_env_almalinux9_current ifdh_env_almalinux9_v2_6_20 ifdh_env_almalinux9_v2_7 ifdh_env_scientific7_current ifdh_env_scientific7_v2_6_20 ifdh_env_scientific7_v2_7 -bash-4.2$ spack env activate ifdh_env_scientific7_current ==> Warning: could not load runtime environment due to RuntimeError: Unable to locate python command in /cvmfs/fermilab.opensciencegrid.org/packages/common/spack/v0.21.0-fermi/NULL/var/spack/environments/ifdh_env_scientific7_current/.spack-env/view/./bin

Is python missing from those ifdh environments?

— Reply to this email directly, view it on GitHubhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_fermitools_jobsub-5Flite_pull_536-23issuecomment-2D1957778740&d=DwMFaQ&c=gRgGjJ3BkIsb5y6s49QqsA&r=mA4qFs7Hfq-joWhWXnsXfA&m=VTnADIkh-Nz7EyC4mt55YudX0L-qLQHxPvaJ9NVLhEzxzlpBLMzN9d8YjlOZEQFn&s=PfJO_lUUDqgzjBxxb14xxq2d4CECBh0Zju9n8LyDlvI&e=, or unsubscribehttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AAB6GV4R2FL7NU7NQR2KE2DYUZFA5AVCNFSM6AAAAABDSAEENKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSNJXG43TQNZUGA&d=DwMFaQ&c=gRgGjJ3BkIsb5y6s49QqsA&r=mA4qFs7Hfq-joWhWXnsXfA&m=VTnADIkh-Nz7EyC4mt55YudX0L-qLQHxPvaJ9NVLhEzxzlpBLMzN9d8YjlOZEQFn&s=dV4ZzvZXrScDykQUDLxWfu5LGaqsMr74mulFxW1q1bw&e=. You are receiving this because you authored the thread.Message ID: @.***>

[shreyb]

No worries - it looks good to me! I'll go ahead and squash-merge this then.

[shreyb]

Actually - doing two quick test submissions to make sure this works onsite and offsite:

8439421.0@jobsub04.fnal.gov (Onsite) 53143895.0@jobsub03.fnal.gov (Offsite)

[shreyb]

Both tests worked. This is good to go.