ScottishCovidResponse / SCRCIssueTracking

Central issue tracking repository for all repos in the consortium
6 stars 0 forks source link

Allow reading of registry config.yaml files in download script #709

Open richardreeve opened 4 years ago

richardreeve commented 4 years ago

End users of the outputs of models, such as visualisation people, often need to use the inputs of a model run as well as the outputs to plot against each other. At the moment they will need to specify by hand the individual versions of the individual data products that they need. However, it would be easier to allow them to specify the data product output, and to pull the specific inputs used from config.yaml file uploaded to the registry. This could be achieved by pulling in the config file from the registry when needed.

So I propose extending the config.yaml syntax for the input files to allow a dependencies=true flag in a read: -> use: section, that would pull in all of the dependencies for that component (the inputs to the code run that produced that data product - i.e. the read: section of the registry's code_run.model_config entry).

github-actions[bot] commented 4 years ago

Heads up @mrow84 @bobturneruk - the "data pipeline api" label was applied to this issue.