Creates NCSA Delta modules and mako templates for batch jobs

[sbryngelson]

Description

Creates NCSA Delta modules and mako templates for batch jobs

Type of change

Please delete options that are not relevant.

• [ ] Bug fix (non-breaking change which fixes an issue)
• [x] New feature (non-breaking change which adds functionality)
• [ ] Something else

Scope

• [x] This PR comprises a set of related changes with a common goal

If you cannot check the above box, please split your PR into multiple PRs that each have a common goal.

How Has This Been Tested?

Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration

• [ ] Checked compilation on CPU and GPU
• [ ] Checked that tests pass
• [ ] Checked that batch jobs submit as expected

Test Configuration:

• What computers and compilers did you use to test this:
  • NCSA Delta

Checklist

• [ ] I have added comments for the new code
• [ ] I added Doxygen docstrings to the new code
• [ ] I have made corresponding changes to the documentation (docs/)
• [ ] I have added regression tests to the test suite so that people can verify in the future that the feature is behaving as expected
• [ ] I have added example cases in examples/ that demonstrate my new feature performing as expected
• [ ] I ran ./mfc.sh format before committing my code
• [x] New and existing tests pass locally with my changes, including with GPU capability enabled and disabled
• [x] This PR does not introduce any repeated code (it follows the DRY principle)
• [x] I cannot think of a way to condense this code and reduce any introduced additional line count

If your code changes any code source files (anything in src/)

To make sure the code is performing as expected on GPU devices, I have:

• [ ] Checked that the code compiles using NVHPC compilers
• [ ] Ran the code on either V100, A100, or H100 GPUs and ensured the new feature performed as expected (the GPU results match the CPU results)
• [ ] Enclosed the new feature via nvtx ranges so that they can be identified in profiles
• [ ] Ran a Nsight Systems profile using ./mfc.sh run XXXX --gpu -t simulation --nsys, and have attached the output file (.nsys-rep) and plain text results to this PR
• [ ] Ran my code using various numbers of different GPUs (1, 2, and 8, for example) in parallel and made sure that the results scale similarly to what happens if you run without the new code/feature

[henryleberre]

@sbryngelson, does this template also work for interactive jobs? i.e. are you able to run the test suite on an allocated node with ./mfc.sh test -- -c delta ?

[sbryngelson]

@sbryngelson, does this template also work for interactive jobs? i.e. are you able to run the test suite on an allocated node with ./mfc.sh test -- -c delta ?

It works if you first salloc yourself resources, which I assume is the intended use case?

[henryleberre]

@sbryngelson, does this template also work for interactive jobs? i.e. are you able to run the test suite on an allocated node with ./mfc.sh test -- -c delta ?

It works if you first salloc yourself resources, which I assume is the intended use case?

Yes! I was just checking since srun does not always work interactively.

[sbryngelson]

Update: It actually didn't work with srun in interactive mode. I just didn't notice the change I made. Updating now.