search

unity-sds / unity-project-management

Container repo for project management (projects, epics, etc)
Apache License 2.0
0 stars 1 forks source link

SSM Parameters as native items in the CWL Workflow #102

Open mike-gangl opened 10 months ago

mike-gangl commented 10 months ago

brought up in https://github.com/unity-sds/sounder-sips-chirp-workflows/issues/14#issuecomment-1692355441

A way of pre-processing SSM parameters and adding them into a CWL document before execution would be a very useful feature. SSM is a single example of a 'vault' like interface.

some 'template' language could be used to identify tokens that need to be substituted before execution.

token: (jinja) edl_user_name: {{ ssm("sps/processing/workflows/edl_password")}}

this is just an example, i'm not a language syntax expert.

pseudocode:

cwlfile = downlaod_cwl_file()
replace_ssm_tokens(cwlfile)
cwltool cwl-file #run the file