pepkit / looper

A job submitter for Portable Encapsulated Projects
http://looper.databio.org
BSD 2-Clause "Simplified" License
20 stars 7 forks source link

Design of looper configuration #344

Closed nsheff closed 12 months ago

nsheff commented 1 year ago

With some proposed changes, including #343 and #342, it's time to revisit how looper is configured.

Right now there's a dotfile, which has some discussion here:

It's very simple, and just points to the PEP, which defines a looper section that configures looper.

(Aside: some related discussion in pephub, too, but there we changed it to .pep.yaml, with the point being that it was like an environment config file that marked this as a repo, that just points to a PEP. But I think this went away with the PEPhub switch to a database back-end.)

Next steps

Some brainstorming about how to configure looper:

Example idea for new config file:

output_dir: path/to/output_dir
pep_config_file: relative/path/to/project_config.yaml
pipeline_interfaces:
  project: path/to/project_pipeline_interface.yaml
  sample: path/to/sample_pipeline_interface.yaml

Disadvantages: