wesketchum
commented
3 years ago Since most of these are production/data management related, I'm going to assign this to @mayawos and @mattfcs, and suggest they delegate. Think these may be good topics to take on for people getting started in production and data management...
NOvA originated some scripts, which are now also available in duneutil, which I think are very useful. Perhaps SBN already has equivalents, in which case please point me to them, but if not I think we should look into adopting these.
setup_fnal_security - takes care of getting all the various tickets you need to work with the grid, xrootd, etc. This is all very confusing, and the advice keeps changing, so having one script to do everything, that someone else maintains, is very useful.
samweb2xrootd - This is a combination of pnfs2xrootd (which SBN already has a version of as pnfsToXRootD from the larsoft product itself) and samweb locate-file. The upshot is you give it the filename of something in SAM, and it gives back an xrootd URL, allowing you to open the file in one step.
latest - finds the most recent version of a ups product and prints it in a form appropriate for passing to ups setup
cache_state.py - reports whether a file, or what fraction of a dataset, is available in cache vs only on tape
ack - this is a better (more code-focused) version of grep. https://beyondgrep.com/ This one is so good I have gone to the effort of installing it in my home directory (it's just a perl script).
There was talk of moving these to some more central larsoft location, but now that dune has its itch scratched I imagine there will be no further movement unless we start making requests.