search

ScottishCovidResponse / SCRCIssueTracking

Central issue tracking repository for all repos in the consortium
6 stars 0 forks source link

Write metadata.yaml #673

Open ianhinder opened 4 years ago

ianhinder commented 4 years ago

The Standard API expects to find a metadata.yaml file in the data repository, but it does not add entries to the file when data is written through the pipeline. It would be very convenient to be able to populate a repository through the Python API in a way which allowed the Python API to read the data back. This would require writing new entries to the metadata.yaml file. This could be made optional (if necessary). When data products are replaced, the entries should probably be updated.

github-actions[bot] commented 4 years ago

Heads up @mrow84 @bobturneruk - the "data pipeline api" label was applied to this issue.

ianhinder commented 4 years ago

I've put a proof of concept in https://github.com/ScottishCovidResponse/data_pipeline_api/pull/53 as an example.