ONS_CPA

[Shannon95]

• [x] Does the dataset show up or is there an error? Yes. No errors. PMDv3 : UK trade in goods by classification of product by activity time series (Date Modified Wednesday 22 Apr 2020) PMDv4 : UK trade in goods by classification of product by activity time series
• [x] Is it in the list of datasets from the main page? Yes.
• [x] Is there descriptive metadata on the search page? Yes. PMDv3: “Quarterly and annual time series of the value of UK imports and exports of goods grouped by product. Goods are attributed to the activity of which they are the principal products.” PMDv4: “Quarterly and annual times series of the value of UK imports and exports of goods grouped by product. Goods are attributed to the activity of which they are the principal products.”
• [x] Does transformed info match the original? Yes. Release Date and Next Release date are detailed on the original data however this is information that could shown on the PMD side of things to the user.
• [x] Does the tidydata download show all the data? Yes, large.
• [x] Note differences in column/row headers N/A.
• [x] Are there multiple cubes? List titles of cubes No. One cube : UK trade in goods by classification of product by activity time series.
• [x] What needs differentiating? Totals N/A
• [x] Are there titles that need harmonising? World/Worldwide No.
• [x] Does the structure look sensible? Yes.
• [x] Does the hierarchy work? Yes.
• [ ] What needs further investigation or context? Product dimension needs further investigation on how to structure and link with CPA codes. Build is unstable.
  No filter available for Product on PMDv4.
• [x] Any duplications? No.
• [x] List any detailed metadata/methodology to add retrospectively N/A
• [x] Short metadata added N/A

[MartynBSpooner]

Outstanding: Product dimension (agreed meeting to discuss).

[ajtucker]

Added new dimension, <http://gss-data.org.uk/def/dimension/cpa>, using codelist <http://stamina-project.org/codes/cpav2008/cpa>, separately labelling it "Product". Commit 11d9711efa8a43987d7b9bc7fe3e5c2c0dce803f

See Swirrl/ons-data-export#23

[JasonHowell]

BA's have reviewed and good to go.

[JasonHowell]

Closing issue as now been deployed onto PMDv4.

[Shannon95]

GitHub https://github.com/GSS-Cogs/family-trade/tree/master/datasets/ONS_CPA Jenkins https://ci.floop.org.uk/job/GSS_data/job/Trade/job/ONS_CPA/

[canwaf]

The xlsx is no longer properly formed as it has too many columns. Will use the CSV instead.

[LPerryman]

published to PMD4 with CDIDS but need to check unit with BAs, have out in gbp million as temp measure

https://staging.gss-data.org.uk/cube/explore?uri=http%3A%2F%2Fgss-data.org.uk%2Fdata%2Fgss_data%2Ftrade%2Fons_cpa-catalog-entry

[Tracey-B]

BA Comments; Producer confirmed unit as GBP Million. There is no Tech Spec.
I have completed a QA check on the transformed dataset in PMD4 and had discussions with @LPerryman. As far as i can determine the dataset appears reasonable however I am unable to complete a full QA check as I am unable to sort or filter any of the dimensions. @rossbowen @JasonHowell please see comments above.

[mikeAdamss]

sorry to be be awkward but there's a bug on this scraper at the mo, should be fixed and in by some point relatively soon (I'll update this comment when it's sorted). Probably no point picking this up before if you need to rerun it, it'll just fall over. https://github.com/GSS-Cogs/gss-utils/issues/188. Back to working 😄

[mikeAdamss]

this had an erroneous failure on the 25th, that was the same week we deployed all the databaker/gss-utils fixes. It works now, just needed to kick the job off again.

it's probably worth rerunning on Jenkins for any fail that are more than about a week old, might be they work now.

[Shannon95]

Published on PMD4 with filters working: https://staging.gss-data.org.uk/cube/explore?uri=http%3A%2F%2Fgss-data.org.uk%2Fdata%2Fgss_data%2Ftrade%2Fons_cpa-catalog-entry&filters-drawer=open

[Shannon95]

Now passing again on Jenkins - avilable on staging here https://staging.gss-data.org.uk/cube/explore?uri=http%3A%2F%2Fgss-data.org.uk%2Fdata%2Fgss_data%2Ftrade%2Fons_cpa-catalog-entry

[Robsteranium]

The CPA dimension ought to be a sub-property of the family's product dimension.

[JasonHowell]

@rossbowen Please see above feedback from Robin. What are the next steps?

The dataset is published on Beta env.