pepkit / looper

A job submitter for Portable Encapsulated Projects
http://looper.databio.org
BSD 2-Clause "Simplified" License
20 stars 7 forks source link

Looper should use hook/plugin system to construct pipestat config files #413

Closed donaldcampbelljr closed 1 month ago

donaldcampbelljr commented 10 months ago
          Will proceed with having Looper construct a new pipestat config file from a given pipestat config file AND the pipeline interfaces. Looper will use that config file to construct pipestat manager objects. Future work will investigate using a `pre-project` hook to construct this namespace and associated config file.

Originally posted by @donaldcampbelljr in https://github.com/pepkit/looper/issues/412#issuecomment-1703219004

donaldcampbelljr commented 10 months ago

Similar to the pre_submission hooks that are evaluated before writing the submission script, it would be nice to move the construction (and updating) of the pipestat namespace to use a hook, perhaps at the project level. This pipestat namespace would be assembled from a given pipestat config (provided within the looper config file) and any pipestat relevant information contained within a pipeline interface file. This namespace would be used to check if pipestat is properly configured as well as for creating the relevant pipestat manager objects.

Challenges:

donaldcampbelljr commented 10 months ago

Related to but an improvement on #411

donaldcampbelljr commented 1 month ago

With the most recent refactoring work, I believe this is no longer a relevant approach. Closing for now.