This PR introduces law.JobInputFile which is meant to improve control over job input files. It wraps an input file path, as well as three flags:
copy (default True): Whether the file should be copied into submission directory.
postfix (default True): When copied, whether the file should receive a string postfix.
render (default True): When copied, whether render variables in the file should be replaced. For non-text files, it might be good to set this flag to False.
In the *_job_config hook of workflow tasks, this might look like the following (shown for the HTCondorWorkflow).
class MyTask(..., law.htcondor.HTCondorWorkflow):
...
def htcondor_job_config(self, config, job_num, branches):
# a normal input file
config.input_files["file_a"] = "/path/to/file"
# same as law.JobInputFile("/path/to/file")
# a file that should not be rendered
config.input_files["file_b"] = law.JobInputFile("/path/to/archive.tgz", render=False)
return config
Besides these additions, a couple smaller fixes are included in this PR that resolve some ambiguities that arose during handling of submission-relative and job-relative paths of input files.
This PR introduces
law.JobInputFilewhich is meant to improve control over job input files. It wraps an input file path, as well as three flags:copy(defaultTrue): Whether the file should be copied into submission directory.postfix(defaultTrue): When copied, whether the file should receive a string postfix.render(defaultTrue): When copied, whether render variables in the file should be replaced. For non-text files, it might be good to set this flag toFalse.In the
*_job_confighook of workflow tasks, this might look like the following (shown for theHTCondorWorkflow).Besides these additions, a couple smaller fixes are included in this PR that resolve some ambiguities that arose during handling of submission-relative and job-relative paths of input files.