tjgalvin / flint

BSD 3-Clause "New" or "Revised" License
7 stars 1 forks source link

Add initial archiving functionality #104

Closed tjgalvin closed 1 month ago

tjgalvin commented 1 month ago

In preparation for running jobs automatically, it has become apparent that archiving options are needed. This pull request adds functions to:

There is a new ArchiveOptions class used to help control and interface into these functions. At the moment the list of files that will be copied are hard-coded across 4 or 5 glob expressions.

This has also been patched into the typical continuum pipeline, but I think that there are better ways of implementing this. Perhaps as a separate flow that is called after the initial larger workflow.