ONSdigital / dp-data-pipelines

Pipeline specific python scripts and tooling for automated website data ingress.
MIT License
1 stars 0 forks source link

Metadata Output Requirements #87

Open RedWalters opened 5 months ago

RedWalters commented 5 months ago

What is this?

So, currently the metadata output has a lot of empty fields, either because we lack the information from the data/DSD to fill them or because I simply don't know what they are.

We need to figure out which of these fields are a capital R Requirement for the API/Application Profile (meaning fields that MUST have information in them for minimal viable product) and in general gather information on the rest of them where possible.

What to do:

The main work of this task will be communicating with someone who knows the nitty gritty details on the API/Application Profile (If I remember correctly Andrew Fergusson offered to convene on this) and writing up as much information as possible that we can then use to adjust the transform where necessary or plan steps to get hold of the required information (adding required information to the config specification etc)

Acceptance Criteria

and depending on what the requirements end up being either:

or: