DWP-work-and-health-programme-statistics

[ajtucker]

• [x] Create Jenkins job (in Jenkins).
• [x] Figure out landing page.
• [x] Create main.py and check scraper works.
• [x] Add definition to reference/columns.csv
• [x] Add newly required codelists (under reference/codelists) and add info to reference/codelists-metadata.json
• [x] Add component definitions to reference/components.csv
• [x] Write a transformation to Tidy CSV and output metadata dataset.trig and schema.
  • [x] Draft
  • [x] Finalised

[RedWalters]

Note for QA: There seems to be a discrepancy between 'Start' values between the initial 1_1 tab and subsequent tabs. For instance 1_1 has' Dec 17 Disability Starts as 370' while further tabs have it at 290. For now the 1_1 tab value is being used as it seems to be the more complete but investigation into whether there is an explanation for the variance will be needed.

Also, DWP Area has values which are the same CPA number but have different descriptions. Need to find out whether they are the same or separate. Eg:

• Cpa 1 Central Shaw Trust and
• Cpa 1 Central West Midlands Combined Authority Shaw Trust

For now they are kept as separate.

[IeuanMan]

Check the title as it doesn't match ETL Doc

[RedWalters]

Check the title as it doesn't match ETL Doc

Fixed, was issue created by table splitting not working.