Open ajtucker opened 4 years ago
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 241 lines...]
Masking supported pattern matches of $CACHE_USER or $CACHE_PASS
[Pipeline] {
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
Deleting 1 temporary files
[Pipeline] // configFileProvider
[Pipeline] echo
Finding job draft
[Pipeline] configFileProvider
provisioning config files...
copy managed file [JsonConfig] to file:/var/jenkins_home/workspace/GSS_data/Disability/DWP-Family-Resources-Survey-Disability@tmp/config5852901972674263067tmp
[Pipeline] {
[Pipeline] readFile
[Pipeline] readJSON
[Pipeline] withCredentials
Masking supported pattern matches of $USER or $PASS
[Pipeline] {
[Pipeline] withCredentials
Masking supported pattern matches of $CACHE_USER or $CACHE_PASS
[Pipeline] {
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
Deleting 1 temporary files
[Pipeline] // configFileProvider
[Pipeline] }
[Pipeline] // script
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build: No changes No changes
[noreply] ab079e2b34e898c19e2b17b4258205a6fa23550a - Create Jenkinsfile
[noreply] 960faf02e732d8adc36ccb50807dfa2fe9c41710 - Work so far
[Alex Tucker] ab84325e0080c22e9a9edd4d46396dc84b3e17f6 - Add upload.
[shannon1995black] a957bd123fd226c763d0ce8b49c97faae4177671 - removed text not required
[Alex Tucker] bcbd91d7f701da93d7d7c976f095ca78204e75a3 - Point to the right directory.
[Alex Tucker] a788916c1c44553673904fb72be22e8912f77815 - addData() arguments were the wrong way around.
[Alex Tucker] 0ba40c134125fa8f8faa7c7822d1463de19686c6 - Turtle is output in the base directory
[shannon1995black] 7be1e7dcbf2dba47709b612ae36065e6396d41aa - added column, and output observations.csv
[shannon1995black] 3592f9eeb4e041df2c0e059420ecf3485866f317 - update column names to match info.json
[shannon1995black] 7b1018a3fde9570f14d98e3b6d6f199f3d65c07c - Map column names to codelists
[Alex Tucker] 8f8f82c3cce034288148be6a7c6b212600965e25 - Add ${WORKSPACE} to file path. Use text/turtle.
[Alex Tucker] 21d442cc10477d802144d373d18effee097cbc54 - Add 'GP Practice' column definition.
[shannon1995black] c4e814f67a078c1b353178d42976721b6e71389d - Add household-disability-status to columns.csv
[shannon1995black] c1dd2827532008c6a82fbd21ad302e3c6e00cf60 - add workless-household-type to columns.csv
[shannon1995black] b267efd95be68166a494e0cafb76f4fa35f6c8fc - small typo
[Alex Tucker] 72f165d648b16b7f1fbcd2a2b74806795aca1fc0 - Fixed up NHS Scraper, so refactored a bit.
[noreply] e1d22f440042975dd3bfae687eb7fc73cd5ba048 - Add files via upload
[lperryman] cfac3c3424d6391fdd1b992d6e7b658e84a70e9c - Adding main.py file for DWP Survey Carer data
[lperryman] 5f15a5c69180bbb76c3641ba431dcff97e36bae3 - Adding main.py file for DWP Survey Carer data
[lperryman] 6483ab716295e6811facf1ef40b1ad5230aa2cad - Add codelists
[Grace Spitzer-Wong] 7b41f63bdeceb571e2ab89cbee2427a2cd813480 - geographical codelist creation
[Alex Tucker] e2c0b707b5dbdd02dcb3a0269f82b195346aafe9 - Initial Jenkinsfile for publishing reference data.
[mikelovesbooks] e4da872501be3f5d6d606f1968467f9b7ffb4229 - use /concept in value_template
[lperryman] 059cf57513ca76bd2edfc58702d4a6204c4a47c3 - Adding column names to colmns.csv file
[lperryman] 3c475e679a4d3d5b959598f4dd4d5223ea7997fc - Add Jenkins fileto DWP-Family-Resources-Survey-Carer
[lperryman] 0002fcdbd2f24d6b9660fcb5af826dd2e3fa9cfe - Changing Main extension to ipynb
[noreply] 7a094bbe548c0fcb93c0f73a70f265b06e58ed94 - Delete main.py
[mikelovesbooks] 534f0934e7d14c81bbec91f4d2f53c145039bbd9 - added PHE mental health specific age codelist
[noreply] af36168d16e3791c9d30f853b93e8322d77c132e - Delete phe-co-occurring-substance-misuse-and-mental-health-issues-age.csv
[lperryman] e0798dda2e2f4c181850d56154be9df02becd98d - CHanged Jenkins file
[mikelovesbooks] 659afb7998d2b69d93731a64f53c7999c71c851d - Add phe age codelist
[lperryman] d40b5d6ea35b06a78883f04f68306f5c87bad63a - CHanged Jenkins file
[mikelovesbooks] 8ff04a992123843da5db60d56eed495132f6a860 - remove temp code and notes, added local source
[lperryman] 8cca084f0c155a0f0e450344a12fd26431ac2e5b - adding main.py
[Alex Tucker] a11b7d0258a71b983debab13be4e978259f2e454 - Move codelist to reference/codelists
[mikelovesbooks] 2e5d8a348d574db9d19335bda313b6b690b11c25 - first stab at components.csv
[Alex Tucker] f19f8ddddafe532fb7caa38db5168a49bdba3058 - Swap notation/label. Add nhs-geographies.csv to list.
[noreply] f3edd1008ce566270d52a7822e3561b90ffdbb5b - Update Jenkinsfile
[mikelovesbooks] 8824f1e1e9ca8c1c36b5411b8a086cef40ecbc8d - update to typical path output conventions
[mikelovesbooks] 3d3e2f03022b702a219d9d0e3eb146dc5653cdcd - correct casing
[noreply] 6d630f3ccc45f348b3c6048d85a39ae1ad1b1063 - Update Jenkinsfile
[noreply] 9d5b15cbdcfe072a2a9967604cad658cbc63ce8c - Update Jenkinsfile
[noreply] 4c0f449081c55185bd7ca5ad02b079ef3a946bcc - Update Jenkinsfile
[noreply] b6b32719db9690130927a39cb7b3e2c646d24f30 - Update Jenkinsfile
[noreply] a60a003012bbf3783658da5e6e28716a8ee7c130 - Update Jenkinsfile
[noreply] 39e7f17f9f8e1287bcf511467c202510c6147ec7 - Update Jenkinsfile
[shannon1995black] d6d5b4111179c453f2008c356fa81ad0da472a55 - update info.json
[noreply] cd1591baa2e288256c701ec19dfa405e4a31817c - Update Jenkinsfile
[noreply] d4d2cdee726a0d253b656787e8fb793750b03e42 - Update Jenkinsfile
[noreply] 7fe955895c704dfed655bc9490c82c127bb6d7bc - Update Jenkinsfile
[noreply] febf6406f11d95d4478d49f7e4d08bd34cc604cc - Update Jenkinsfile
[noreply] 27a4d0665b94d991dc923c4d90e83b9a5de29257 - Update Jenkinsfile
[noreply] bb23d6f3fd6e4a864a11e41eac7c0c686088fad1 - Update Jenkinsfile
[Alex Tucker] 579161c647d95e3cafcd54136a6805ad48f3b39a - Add .DS_Store to ignore list.
[Alex Tucker] 54edcd208b0c7e3d4190eb0b9d06cd43026dd509 - Add NHS geographies column. Re-do some other columns for consistency.
[noreply] 2ff2c83493c1d833f8e3d8466c9442f790f601b2 - Update Jenkinsfile
[noreply] 38a7f55562f0c276372a360454ebbf18a911ca68 - Update Jenkinsfile
[noreply] 0e03166e5bb28d0693d6b605d6905dc72825fe60 - Remove Mac files
[noreply] 2de15466065da2c8605856e10c7465bad4671fc6 - Update Jenkinsfile
[noreply] 42e050a48416b3dae4cf8af651e5513dd89e6477 - Update Jenkinsfile
[noreply] d0dfcf5101b7878e5dd42cd854e52bbeb9ee1ac2 - Update Jenkinsfile
[noreply] 1ba5797427d04641549cda6d8668ccde90955cd0 - Update Jenkinsfile
[Alex Tucker] 01da946fdf72e70dbeb390619cf4f3110a2ffa32 - Remove tabs.
[noreply] 7f0c211f6c1fe86c5a67f8c7dc0ab30836292bcb - Update Jenkinsfile
[shannon1995black] 806748dc362e7ad7445368619df8ae755eb2c38f - update codelist-metadata
[shannon1995black] e3624416fb3c5b5e0166f6277fa1ad7228aa8d78 - Update components.csv
[Alex Tucker] 0bddb1261111bc95352c0b7a4cd50f6a114dc95b - Added missing ,
[Alex Tucker] b11947f1637fc913a1d6ab204045733882999e84 - Add 'ONS Geography' column
[Alex Tucker] 63c8b0b886a3a8286159f69d179ba679cdacdfe4 - Renamed columns to NHS Geography and ONS Geography to coincide with columns.csv.
[Alex Tucker] b74fbaef4bd3b995b22ca0e297a6a29014da14ea - Ignore more files
[Alex Tucker] f313dfd0f4e979985c7931800791bd609259b0c6 - Show tidied table.
[Alex Tucker] f8df83994d022f02ecd05edb1e029dec4962f0ec - Re-do template Jenkinsfile to account for changed directory layout.
[Alex Tucker] c82de2a234aa7041495547d045784ce7b62b33df - Move generic dataset Jenkinsfile to datasets directory, for use with all dataset pipelines.
[vtula2000] 7f2225f7c73d64b2cdba2432446b9fdd4cdd2127 - Tidy data
[noreply] 6d81f64d1d69f039559ee892bc91c66e4613b69a - Delete jenkinsfile
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 135 lines...]
4. duplicate_key. Row: 112. 2015-18,United Kingdom,No Disability,Male,0-4,Count,People (Millions)
5. duplicate_key. Row: 113. 2015-18,United Kingdom,Any Disability,Female,0-4,Count,People (Millions)
6. duplicate_key. Row: 114. 2015-18,United Kingdom,No Disability,Female,0-4,Count,People (Millions)
7. duplicate_key. Row: 115. 2015-18,United Kingdom,Any Disability,All,5-9,Count,People (Millions)
8. duplicate_key. Row: 116. 2015-18,United Kingdom,No Disability,All,5-9,Count,People (Millions)
9. duplicate_key. Row: 117. 2015-18,United Kingdom,Any Disability,Male,5-9,Count,People (Millions)
10. duplicate_key. Row: 118. 2015-18,United Kingdom,No Disability,Male,5-9,Count,People (Millions)
11. duplicate_key. Row: 119. 2015-18,United Kingdom,Any Disability,Female,5-9,Count,People (Millions)
12. duplicate_key. Row: 120. 2015-18,United Kingdom,No Disability,Female,5-9,Count,People (Millions)
13. duplicate_key. Row: 234. 2017/18,United Kingdom,Mobility,All,All,Count,People (Millions)
14. duplicate_key. Row: 238. 2017/18,United Kingdom,Stamina/breathing/fatigue,All,All,Count,People (Millions)
15. duplicate_key. Row: 242. 2017/18,United Kingdom,Dexterity,All,All,Count,People (Millions)
16. duplicate_key. Row: 246. 2017/18,United Kingdom,Mental health,All,All,Count,People (Millions)
17. duplicate_key. Row: 250. 2017/18,United Kingdom,Memory,All,All,Count,People (Millions)
18. duplicate_key. Row: 254. 2017/18,United Kingdom,Hearing,All,All,Count,People (Millions)
19. duplicate_key. Row: 258. 2017/18,United Kingdom,Vision,All,All,Count,People (Millions)
20. duplicate_key. Row: 262. 2017/18,United Kingdom,Learning,All,All,Count,People (Millions)
21. duplicate_key. Row: 266. 2017/18,United Kingdom,Social/behavioural,All,All,Count,People (Millions)
22. duplicate_key. Row: 270. 2017/18,United Kingdom,Other,All,All,Count,People (Millions)
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 63c3ffe26e37695d5144f838814585fd7153357f51f3c4762d1b224df42c632f
$ docker rm -f 63c3ffe26e37695d5144f838814585fd7153357f51f3c4762d1b224df42c632f
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build: No changes No changes
[noreply] ab079e2b34e898c19e2b17b4258205a6fa23550a - Create Jenkinsfile
[noreply] 960faf02e732d8adc36ccb50807dfa2fe9c41710 - Work so far
[Alex Tucker] ab84325e0080c22e9a9edd4d46396dc84b3e17f6 - Add upload.
[shannon1995black] a957bd123fd226c763d0ce8b49c97faae4177671 - removed text not required
[Alex Tucker] bcbd91d7f701da93d7d7c976f095ca78204e75a3 - Point to the right directory.
[Alex Tucker] a788916c1c44553673904fb72be22e8912f77815 - addData() arguments were the wrong way around.
[Alex Tucker] 0ba40c134125fa8f8faa7c7822d1463de19686c6 - Turtle is output in the base directory
[shannon1995black] 7be1e7dcbf2dba47709b612ae36065e6396d41aa - added column, and output observations.csv
[shannon1995black] 3592f9eeb4e041df2c0e059420ecf3485866f317 - update column names to match info.json
[shannon1995black] 7b1018a3fde9570f14d98e3b6d6f199f3d65c07c - Map column names to codelists
[Alex Tucker] 8f8f82c3cce034288148be6a7c6b212600965e25 - Add ${WORKSPACE} to file path. Use text/turtle.
[Alex Tucker] 21d442cc10477d802144d373d18effee097cbc54 - Add 'GP Practice' column definition.
[shannon1995black] c4e814f67a078c1b353178d42976721b6e71389d - Add household-disability-status to columns.csv
[shannon1995black] c1dd2827532008c6a82fbd21ad302e3c6e00cf60 - add workless-household-type to columns.csv
[shannon1995black] b267efd95be68166a494e0cafb76f4fa35f6c8fc - small typo
[Alex Tucker] 72f165d648b16b7f1fbcd2a2b74806795aca1fc0 - Fixed up NHS Scraper, so refactored a bit.
[noreply] e1d22f440042975dd3bfae687eb7fc73cd5ba048 - Add files via upload
[lperryman] cfac3c3424d6391fdd1b992d6e7b658e84a70e9c - Adding main.py file for DWP Survey Carer data
[lperryman] 5f15a5c69180bbb76c3641ba431dcff97e36bae3 - Adding main.py file for DWP Survey Carer data
[lperryman] 6483ab716295e6811facf1ef40b1ad5230aa2cad - Add codelists
[Grace Spitzer-Wong] 7b41f63bdeceb571e2ab89cbee2427a2cd813480 - geographical codelist creation
[Alex Tucker] e2c0b707b5dbdd02dcb3a0269f82b195346aafe9 - Initial Jenkinsfile for publishing reference data.
[mikelovesbooks] e4da872501be3f5d6d606f1968467f9b7ffb4229 - use /concept in value_template
[lperryman] 059cf57513ca76bd2edfc58702d4a6204c4a47c3 - Adding column names to colmns.csv file
[lperryman] 3c475e679a4d3d5b959598f4dd4d5223ea7997fc - Add Jenkins fileto DWP-Family-Resources-Survey-Carer
[lperryman] 0002fcdbd2f24d6b9660fcb5af826dd2e3fa9cfe - Changing Main extension to ipynb
[noreply] 7a094bbe548c0fcb93c0f73a70f265b06e58ed94 - Delete main.py
[mikelovesbooks] 534f0934e7d14c81bbec91f4d2f53c145039bbd9 - added PHE mental health specific age codelist
[noreply] af36168d16e3791c9d30f853b93e8322d77c132e - Delete phe-co-occurring-substance-misuse-and-mental-health-issues-age.csv
[lperryman] e0798dda2e2f4c181850d56154be9df02becd98d - CHanged Jenkins file
[mikelovesbooks] 659afb7998d2b69d93731a64f53c7999c71c851d - Add phe age codelist
[lperryman] d40b5d6ea35b06a78883f04f68306f5c87bad63a - CHanged Jenkins file
[mikelovesbooks] 8ff04a992123843da5db60d56eed495132f6a860 - remove temp code and notes, added local source
[lperryman] 8cca084f0c155a0f0e450344a12fd26431ac2e5b - adding main.py
[Alex Tucker] a11b7d0258a71b983debab13be4e978259f2e454 - Move codelist to reference/codelists
[mikelovesbooks] 2e5d8a348d574db9d19335bda313b6b690b11c25 - first stab at components.csv
[Alex Tucker] f19f8ddddafe532fb7caa38db5168a49bdba3058 - Swap notation/label. Add nhs-geographies.csv to list.
[noreply] f3edd1008ce566270d52a7822e3561b90ffdbb5b - Update Jenkinsfile
[mikelovesbooks] 8824f1e1e9ca8c1c36b5411b8a086cef40ecbc8d - update to typical path output conventions
[mikelovesbooks] 3d3e2f03022b702a219d9d0e3eb146dc5653cdcd - correct casing
[noreply] 6d630f3ccc45f348b3c6048d85a39ae1ad1b1063 - Update Jenkinsfile
[noreply] 9d5b15cbdcfe072a2a9967604cad658cbc63ce8c - Update Jenkinsfile
[noreply] 4c0f449081c55185bd7ca5ad02b079ef3a946bcc - Update Jenkinsfile
[noreply] b6b32719db9690130927a39cb7b3e2c646d24f30 - Update Jenkinsfile
[noreply] a60a003012bbf3783658da5e6e28716a8ee7c130 - Update Jenkinsfile
[noreply] 39e7f17f9f8e1287bcf511467c202510c6147ec7 - Update Jenkinsfile
[shannon1995black] d6d5b4111179c453f2008c356fa81ad0da472a55 - update info.json
[noreply] cd1591baa2e288256c701ec19dfa405e4a31817c - Update Jenkinsfile
[noreply] d4d2cdee726a0d253b656787e8fb793750b03e42 - Update Jenkinsfile
[noreply] 7fe955895c704dfed655bc9490c82c127bb6d7bc - Update Jenkinsfile
[noreply] febf6406f11d95d4478d49f7e4d08bd34cc604cc - Update Jenkinsfile
[noreply] 27a4d0665b94d991dc923c4d90e83b9a5de29257 - Update Jenkinsfile
[noreply] bb23d6f3fd6e4a864a11e41eac7c0c686088fad1 - Update Jenkinsfile
[Alex Tucker] 579161c647d95e3cafcd54136a6805ad48f3b39a - Add .DS_Store to ignore list.
[Alex Tucker] 54edcd208b0c7e3d4190eb0b9d06cd43026dd509 - Add NHS geographies column. Re-do some other columns for consistency.
[noreply] 2ff2c83493c1d833f8e3d8466c9442f790f601b2 - Update Jenkinsfile
[noreply] 38a7f55562f0c276372a360454ebbf18a911ca68 - Update Jenkinsfile
[noreply] 0e03166e5bb28d0693d6b605d6905dc72825fe60 - Remove Mac files
[noreply] 2de15466065da2c8605856e10c7465bad4671fc6 - Update Jenkinsfile
[noreply] 42e050a48416b3dae4cf8af651e5513dd89e6477 - Update Jenkinsfile
[noreply] d0dfcf5101b7878e5dd42cd854e52bbeb9ee1ac2 - Update Jenkinsfile
[noreply] 1ba5797427d04641549cda6d8668ccde90955cd0 - Update Jenkinsfile
[Alex Tucker] 01da946fdf72e70dbeb390619cf4f3110a2ffa32 - Remove tabs.
[noreply] 7f0c211f6c1fe86c5a67f8c7dc0ab30836292bcb - Update Jenkinsfile
[shannon1995black] 806748dc362e7ad7445368619df8ae755eb2c38f - update codelist-metadata
[shannon1995black] e3624416fb3c5b5e0166f6277fa1ad7228aa8d78 - Update components.csv
[Alex Tucker] 0bddb1261111bc95352c0b7a4cd50f6a114dc95b - Added missing ,
[Alex Tucker] b11947f1637fc913a1d6ab204045733882999e84 - Add 'ONS Geography' column
[Alex Tucker] 63c8b0b886a3a8286159f69d179ba679cdacdfe4 - Renamed columns to NHS Geography and ONS Geography to coincide with columns.csv.
[Alex Tucker] b74fbaef4bd3b995b22ca0e297a6a29014da14ea - Ignore more files
[Alex Tucker] f313dfd0f4e979985c7931800791bd609259b0c6 - Show tidied table.
[Alex Tucker] f8df83994d022f02ecd05edb1e029dec4962f0ec - Re-do template Jenkinsfile to account for changed directory layout.
[Alex Tucker] c82de2a234aa7041495547d045784ce7b62b33df - Move generic dataset Jenkinsfile to datasets directory, for use with all dataset pipelines.
[vtula2000] 7f2225f7c73d64b2cdba2432446b9fdd4cdd2127 - Tidy data
[noreply] 6d81f64d1d69f039559ee892bc91c66e4613b69a - Delete jenkinsfile
[noreply] ae06f00bb536d5204ba6264fbd8b61e03b1fdb1a - Update columns.csv
[noreply] 66d93a9e02d31f8e2245324327bfec0c68d6c0ab - Add files via upload
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 396 lines...]
265. duplicate_key. Row: 258. 2017/18,United Kingdom,Vision,All,All,Count,People (Millions)
266. too_many_values. Row: 259. 4_6
267. too_many_values. Row: 260. 4_6
268. too_many_values. Row: 261. 4_6
269. too_many_values. Row: 262. 4_6
270. duplicate_key. Row: 262. 2017/18,United Kingdom,Learning,All,All,Count,People (Millions)
271. too_many_values. Row: 263. 4_6
272. too_many_values. Row: 264. 4_6
273. too_many_values. Row: 265. 4_6
274. too_many_values. Row: 266. 4_6
275. duplicate_key. Row: 266. 2017/18,United Kingdom,Social/behavioural,All,All,Count,People (Millions)
276. too_many_values. Row: 267. 4_6
277. too_many_values. Row: 268. 4_6
278. too_many_values. Row: 269. 4_6
279. too_many_values. Row: 270. 4_6
280. duplicate_key. Row: 270. 2017/18,United Kingdom,Other,All,All,Count,People (Millions)
281. too_many_values. Row: 271. 4_6
282. too_many_values. Row: 272. 4_6
283. too_many_values. Row: 273. 4_6
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 eb5db7f6645b618bbfb851f9bd49d29351ae6550249319f16d2216cab7ea7901
$ docker rm -f eb5db7f6645b618bbfb851f9bd49d29351ae6550249319f16d2216cab7ea7901
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build: No changes No changes
[noreply] ab079e2b34e898c19e2b17b4258205a6fa23550a - Create Jenkinsfile
[noreply] 960faf02e732d8adc36ccb50807dfa2fe9c41710 - Work so far
[Alex Tucker] ab84325e0080c22e9a9edd4d46396dc84b3e17f6 - Add upload.
[shannon1995black] a957bd123fd226c763d0ce8b49c97faae4177671 - removed text not required
[Alex Tucker] bcbd91d7f701da93d7d7c976f095ca78204e75a3 - Point to the right directory.
[Alex Tucker] a788916c1c44553673904fb72be22e8912f77815 - addData() arguments were the wrong way around.
[Alex Tucker] 0ba40c134125fa8f8faa7c7822d1463de19686c6 - Turtle is output in the base directory
[shannon1995black] 7be1e7dcbf2dba47709b612ae36065e6396d41aa - added column, and output observations.csv
[shannon1995black] 3592f9eeb4e041df2c0e059420ecf3485866f317 - update column names to match info.json
[shannon1995black] 7b1018a3fde9570f14d98e3b6d6f199f3d65c07c - Map column names to codelists
[Alex Tucker] 8f8f82c3cce034288148be6a7c6b212600965e25 - Add ${WORKSPACE} to file path. Use text/turtle.
[Alex Tucker] 21d442cc10477d802144d373d18effee097cbc54 - Add 'GP Practice' column definition.
[shannon1995black] c4e814f67a078c1b353178d42976721b6e71389d - Add household-disability-status to columns.csv
[shannon1995black] c1dd2827532008c6a82fbd21ad302e3c6e00cf60 - add workless-household-type to columns.csv
[shannon1995black] b267efd95be68166a494e0cafb76f4fa35f6c8fc - small typo
[Alex Tucker] 72f165d648b16b7f1fbcd2a2b74806795aca1fc0 - Fixed up NHS Scraper, so refactored a bit.
[noreply] e1d22f440042975dd3bfae687eb7fc73cd5ba048 - Add files via upload
[lperryman] cfac3c3424d6391fdd1b992d6e7b658e84a70e9c - Adding main.py file for DWP Survey Carer data
[lperryman] 5f15a5c69180bbb76c3641ba431dcff97e36bae3 - Adding main.py file for DWP Survey Carer data
[lperryman] 6483ab716295e6811facf1ef40b1ad5230aa2cad - Add codelists
[Grace Spitzer-Wong] 7b41f63bdeceb571e2ab89cbee2427a2cd813480 - geographical codelist creation
[Alex Tucker] e2c0b707b5dbdd02dcb3a0269f82b195346aafe9 - Initial Jenkinsfile for publishing reference data.
[mikelovesbooks] e4da872501be3f5d6d606f1968467f9b7ffb4229 - use /concept in value_template
[lperryman] 059cf57513ca76bd2edfc58702d4a6204c4a47c3 - Adding column names to colmns.csv file
[lperryman] 3c475e679a4d3d5b959598f4dd4d5223ea7997fc - Add Jenkins fileto DWP-Family-Resources-Survey-Carer
[lperryman] 0002fcdbd2f24d6b9660fcb5af826dd2e3fa9cfe - Changing Main extension to ipynb
[noreply] 7a094bbe548c0fcb93c0f73a70f265b06e58ed94 - Delete main.py
[mikelovesbooks] 534f0934e7d14c81bbec91f4d2f53c145039bbd9 - added PHE mental health specific age codelist
[noreply] af36168d16e3791c9d30f853b93e8322d77c132e - Delete phe-co-occurring-substance-misuse-and-mental-health-issues-age.csv
[lperryman] e0798dda2e2f4c181850d56154be9df02becd98d - CHanged Jenkins file
[mikelovesbooks] 659afb7998d2b69d93731a64f53c7999c71c851d - Add phe age codelist
[lperryman] d40b5d6ea35b06a78883f04f68306f5c87bad63a - CHanged Jenkins file
[mikelovesbooks] 8ff04a992123843da5db60d56eed495132f6a860 - remove temp code and notes, added local source
[lperryman] 8cca084f0c155a0f0e450344a12fd26431ac2e5b - adding main.py
[Alex Tucker] a11b7d0258a71b983debab13be4e978259f2e454 - Move codelist to reference/codelists
[mikelovesbooks] 2e5d8a348d574db9d19335bda313b6b690b11c25 - first stab at components.csv
[Alex Tucker] f19f8ddddafe532fb7caa38db5168a49bdba3058 - Swap notation/label. Add nhs-geographies.csv to list.
[noreply] f3edd1008ce566270d52a7822e3561b90ffdbb5b - Update Jenkinsfile
[mikelovesbooks] 8824f1e1e9ca8c1c36b5411b8a086cef40ecbc8d - update to typical path output conventions
[mikelovesbooks] 3d3e2f03022b702a219d9d0e3eb146dc5653cdcd - correct casing
[noreply] 6d630f3ccc45f348b3c6048d85a39ae1ad1b1063 - Update Jenkinsfile
[noreply] 9d5b15cbdcfe072a2a9967604cad658cbc63ce8c - Update Jenkinsfile
[noreply] 4c0f449081c55185bd7ca5ad02b079ef3a946bcc - Update Jenkinsfile
[noreply] b6b32719db9690130927a39cb7b3e2c646d24f30 - Update Jenkinsfile
[noreply] a60a003012bbf3783658da5e6e28716a8ee7c130 - Update Jenkinsfile
[noreply] 39e7f17f9f8e1287bcf511467c202510c6147ec7 - Update Jenkinsfile
[shannon1995black] d6d5b4111179c453f2008c356fa81ad0da472a55 - update info.json
[noreply] cd1591baa2e288256c701ec19dfa405e4a31817c - Update Jenkinsfile
[noreply] d4d2cdee726a0d253b656787e8fb793750b03e42 - Update Jenkinsfile
[noreply] 7fe955895c704dfed655bc9490c82c127bb6d7bc - Update Jenkinsfile
[noreply] febf6406f11d95d4478d49f7e4d08bd34cc604cc - Update Jenkinsfile
[noreply] 27a4d0665b94d991dc923c4d90e83b9a5de29257 - Update Jenkinsfile
[noreply] bb23d6f3fd6e4a864a11e41eac7c0c686088fad1 - Update Jenkinsfile
[Alex Tucker] 579161c647d95e3cafcd54136a6805ad48f3b39a - Add .DS_Store to ignore list.
[Alex Tucker] 54edcd208b0c7e3d4190eb0b9d06cd43026dd509 - Add NHS geographies column. Re-do some other columns for consistency.
[noreply] 2ff2c83493c1d833f8e3d8466c9442f790f601b2 - Update Jenkinsfile
[noreply] 38a7f55562f0c276372a360454ebbf18a911ca68 - Update Jenkinsfile
[noreply] 0e03166e5bb28d0693d6b605d6905dc72825fe60 - Remove Mac files
[noreply] 2de15466065da2c8605856e10c7465bad4671fc6 - Update Jenkinsfile
[noreply] 42e050a48416b3dae4cf8af651e5513dd89e6477 - Update Jenkinsfile
[noreply] d0dfcf5101b7878e5dd42cd854e52bbeb9ee1ac2 - Update Jenkinsfile
[noreply] 1ba5797427d04641549cda6d8668ccde90955cd0 - Update Jenkinsfile
[Alex Tucker] 01da946fdf72e70dbeb390619cf4f3110a2ffa32 - Remove tabs.
[noreply] 7f0c211f6c1fe86c5a67f8c7dc0ab30836292bcb - Update Jenkinsfile
[shannon1995black] 806748dc362e7ad7445368619df8ae755eb2c38f - update codelist-metadata
[shannon1995black] e3624416fb3c5b5e0166f6277fa1ad7228aa8d78 - Update components.csv
[Alex Tucker] 0bddb1261111bc95352c0b7a4cd50f6a114dc95b - Added missing ,
[Alex Tucker] b11947f1637fc913a1d6ab204045733882999e84 - Add 'ONS Geography' column
[Alex Tucker] 63c8b0b886a3a8286159f69d179ba679cdacdfe4 - Renamed columns to NHS Geography and ONS Geography to coincide with columns.csv.
[Alex Tucker] b74fbaef4bd3b995b22ca0e297a6a29014da14ea - Ignore more files
[Alex Tucker] f313dfd0f4e979985c7931800791bd609259b0c6 - Show tidied table.
[Alex Tucker] f8df83994d022f02ecd05edb1e029dec4962f0ec - Re-do template Jenkinsfile to account for changed directory layout.
[Alex Tucker] c82de2a234aa7041495547d045784ce7b62b33df - Move generic dataset Jenkinsfile to datasets directory, for use with all dataset pipelines.
[vtula2000] 7f2225f7c73d64b2cdba2432446b9fdd4cdd2127 - Tidy data
[noreply] 6d81f64d1d69f039559ee892bc91c66e4613b69a - Delete jenkinsfile
[noreply] ae06f00bb536d5204ba6264fbd8b61e03b1fdb1a - Update columns.csv
[noreply] 66d93a9e02d31f8e2245324327bfec0c68d6c0ab - Add files via upload
[noreply] 91f5d146791e548fca924c25f48bb8a2e15ffda2 - Add files via upload
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 123 lines...]
[Pipeline] {
[Pipeline] ansiColor
[Pipeline] {
[Pipeline] fileExists
[Pipeline] findFiles
[Pipeline] sh
+ csvlint --no-verbose -s datasets/DWP-Family-Resources-Survey-Disability/out/observations.csv-schema.json
/var/jenkins_home/workspace/GSS_data/Disability/DWP-Family-Resources-Survey-Disability/datasets/DWP-Family-Resources-Survey-Disability/out/observations.csv is INVALID
1. duplicate_key. Row: 234. 2017/18,United Kingdom,Mobility,All,All,Count,People (Millions)
2. duplicate_key. Row: 238. 2017/18,United Kingdom,Stamina/breathing/fatigue,All,All,Count,People (Millions)
3. duplicate_key. Row: 242. 2017/18,United Kingdom,Dexterity,All,All,Count,People (Millions)
4. duplicate_key. Row: 246. 2017/18,United Kingdom,Mental health,All,All,Count,People (Millions)
5. duplicate_key. Row: 250. 2017/18,United Kingdom,Memory,All,All,Count,People (Millions)
6. duplicate_key. Row: 254. 2017/18,United Kingdom,Hearing,All,All,Count,People (Millions)
7. duplicate_key. Row: 258. 2017/18,United Kingdom,Vision,All,All,Count,People (Millions)
8. duplicate_key. Row: 262. 2017/18,United Kingdom,Learning,All,All,Count,People (Millions)
9. duplicate_key. Row: 266. 2017/18,United Kingdom,Social/behavioural,All,All,Count,People (Millions)
10. duplicate_key. Row: 270. 2017/18,United Kingdom,Other,All,All,Count,People (Millions)
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 09ce5a116bd0d9ab455276349d5db17a87cc1ca78037537f71ee7fd3a216c684
$ docker rm -f 09ce5a116bd0d9ab455276349d5db17a87cc1ca78037537f71ee7fd3a216c684
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build: No changes No changes
[noreply] ab079e2b34e898c19e2b17b4258205a6fa23550a - Create Jenkinsfile
[noreply] 960faf02e732d8adc36ccb50807dfa2fe9c41710 - Work so far
[Alex Tucker] ab84325e0080c22e9a9edd4d46396dc84b3e17f6 - Add upload.
[shannon1995black] a957bd123fd226c763d0ce8b49c97faae4177671 - removed text not required
[Alex Tucker] bcbd91d7f701da93d7d7c976f095ca78204e75a3 - Point to the right directory.
[Alex Tucker] a788916c1c44553673904fb72be22e8912f77815 - addData() arguments were the wrong way around.
[Alex Tucker] 0ba40c134125fa8f8faa7c7822d1463de19686c6 - Turtle is output in the base directory
[shannon1995black] 7be1e7dcbf2dba47709b612ae36065e6396d41aa - added column, and output observations.csv
[shannon1995black] 3592f9eeb4e041df2c0e059420ecf3485866f317 - update column names to match info.json
[shannon1995black] 7b1018a3fde9570f14d98e3b6d6f199f3d65c07c - Map column names to codelists
[Alex Tucker] 8f8f82c3cce034288148be6a7c6b212600965e25 - Add ${WORKSPACE} to file path. Use text/turtle.
[Alex Tucker] 21d442cc10477d802144d373d18effee097cbc54 - Add 'GP Practice' column definition.
[shannon1995black] c4e814f67a078c1b353178d42976721b6e71389d - Add household-disability-status to columns.csv
[shannon1995black] c1dd2827532008c6a82fbd21ad302e3c6e00cf60 - add workless-household-type to columns.csv
[shannon1995black] b267efd95be68166a494e0cafb76f4fa35f6c8fc - small typo
[Alex Tucker] 72f165d648b16b7f1fbcd2a2b74806795aca1fc0 - Fixed up NHS Scraper, so refactored a bit.
[noreply] e1d22f440042975dd3bfae687eb7fc73cd5ba048 - Add files via upload
[lperryman] cfac3c3424d6391fdd1b992d6e7b658e84a70e9c - Adding main.py file for DWP Survey Carer data
[lperryman] 5f15a5c69180bbb76c3641ba431dcff97e36bae3 - Adding main.py file for DWP Survey Carer data
[lperryman] 6483ab716295e6811facf1ef40b1ad5230aa2cad - Add codelists
[Grace Spitzer-Wong] 7b41f63bdeceb571e2ab89cbee2427a2cd813480 - geographical codelist creation
[Alex Tucker] e2c0b707b5dbdd02dcb3a0269f82b195346aafe9 - Initial Jenkinsfile for publishing reference data.
[mikelovesbooks] e4da872501be3f5d6d606f1968467f9b7ffb4229 - use /concept in value_template
[lperryman] 059cf57513ca76bd2edfc58702d4a6204c4a47c3 - Adding column names to colmns.csv file
[lperryman] 3c475e679a4d3d5b959598f4dd4d5223ea7997fc - Add Jenkins fileto DWP-Family-Resources-Survey-Carer
[lperryman] 0002fcdbd2f24d6b9660fcb5af826dd2e3fa9cfe - Changing Main extension to ipynb
[noreply] 7a094bbe548c0fcb93c0f73a70f265b06e58ed94 - Delete main.py
[mikelovesbooks] 534f0934e7d14c81bbec91f4d2f53c145039bbd9 - added PHE mental health specific age codelist
[noreply] af36168d16e3791c9d30f853b93e8322d77c132e - Delete phe-co-occurring-substance-misuse-and-mental-health-issues-age.csv
[lperryman] e0798dda2e2f4c181850d56154be9df02becd98d - CHanged Jenkins file
[mikelovesbooks] 659afb7998d2b69d93731a64f53c7999c71c851d - Add phe age codelist
[lperryman] d40b5d6ea35b06a78883f04f68306f5c87bad63a - CHanged Jenkins file
[mikelovesbooks] 8ff04a992123843da5db60d56eed495132f6a860 - remove temp code and notes, added local source
[lperryman] 8cca084f0c155a0f0e450344a12fd26431ac2e5b - adding main.py
[Alex Tucker] a11b7d0258a71b983debab13be4e978259f2e454 - Move codelist to reference/codelists
[mikelovesbooks] 2e5d8a348d574db9d19335bda313b6b690b11c25 - first stab at components.csv
[Alex Tucker] f19f8ddddafe532fb7caa38db5168a49bdba3058 - Swap notation/label. Add nhs-geographies.csv to list.
[noreply] f3edd1008ce566270d52a7822e3561b90ffdbb5b - Update Jenkinsfile
[mikelovesbooks] 8824f1e1e9ca8c1c36b5411b8a086cef40ecbc8d - update to typical path output conventions
[mikelovesbooks] 3d3e2f03022b702a219d9d0e3eb146dc5653cdcd - correct casing
[noreply] 6d630f3ccc45f348b3c6048d85a39ae1ad1b1063 - Update Jenkinsfile
[noreply] 9d5b15cbdcfe072a2a9967604cad658cbc63ce8c - Update Jenkinsfile
[noreply] 4c0f449081c55185bd7ca5ad02b079ef3a946bcc - Update Jenkinsfile
[noreply] b6b32719db9690130927a39cb7b3e2c646d24f30 - Update Jenkinsfile
[noreply] a60a003012bbf3783658da5e6e28716a8ee7c130 - Update Jenkinsfile
[noreply] 39e7f17f9f8e1287bcf511467c202510c6147ec7 - Update Jenkinsfile
[shannon1995black] d6d5b4111179c453f2008c356fa81ad0da472a55 - update info.json
[noreply] cd1591baa2e288256c701ec19dfa405e4a31817c - Update Jenkinsfile
[noreply] d4d2cdee726a0d253b656787e8fb793750b03e42 - Update Jenkinsfile
[noreply] 7fe955895c704dfed655bc9490c82c127bb6d7bc - Update Jenkinsfile
[noreply] febf6406f11d95d4478d49f7e4d08bd34cc604cc - Update Jenkinsfile
[noreply] 27a4d0665b94d991dc923c4d90e83b9a5de29257 - Update Jenkinsfile
[noreply] bb23d6f3fd6e4a864a11e41eac7c0c686088fad1 - Update Jenkinsfile
[Alex Tucker] 579161c647d95e3cafcd54136a6805ad48f3b39a - Add .DS_Store to ignore list.
[Alex Tucker] 54edcd208b0c7e3d4190eb0b9d06cd43026dd509 - Add NHS geographies column. Re-do some other columns for consistency.
[noreply] 2ff2c83493c1d833f8e3d8466c9442f790f601b2 - Update Jenkinsfile
[noreply] 38a7f55562f0c276372a360454ebbf18a911ca68 - Update Jenkinsfile
[noreply] 0e03166e5bb28d0693d6b605d6905dc72825fe60 - Remove Mac files
[noreply] 2de15466065da2c8605856e10c7465bad4671fc6 - Update Jenkinsfile
[noreply] 42e050a48416b3dae4cf8af651e5513dd89e6477 - Update Jenkinsfile
[noreply] d0dfcf5101b7878e5dd42cd854e52bbeb9ee1ac2 - Update Jenkinsfile
[noreply] 1ba5797427d04641549cda6d8668ccde90955cd0 - Update Jenkinsfile
[Alex Tucker] 01da946fdf72e70dbeb390619cf4f3110a2ffa32 - Remove tabs.
[noreply] 7f0c211f6c1fe86c5a67f8c7dc0ab30836292bcb - Update Jenkinsfile
[shannon1995black] 806748dc362e7ad7445368619df8ae755eb2c38f - update codelist-metadata
[shannon1995black] e3624416fb3c5b5e0166f6277fa1ad7228aa8d78 - Update components.csv
[Alex Tucker] 0bddb1261111bc95352c0b7a4cd50f6a114dc95b - Added missing ,
[Alex Tucker] b11947f1637fc913a1d6ab204045733882999e84 - Add 'ONS Geography' column
[Alex Tucker] 63c8b0b886a3a8286159f69d179ba679cdacdfe4 - Renamed columns to NHS Geography and ONS Geography to coincide with columns.csv.
[Alex Tucker] b74fbaef4bd3b995b22ca0e297a6a29014da14ea - Ignore more files
[Alex Tucker] f313dfd0f4e979985c7931800791bd609259b0c6 - Show tidied table.
[Alex Tucker] f8df83994d022f02ecd05edb1e029dec4962f0ec - Re-do template Jenkinsfile to account for changed directory layout.
[Alex Tucker] c82de2a234aa7041495547d045784ce7b62b33df - Move generic dataset Jenkinsfile to datasets directory, for use with all dataset pipelines.
[vtula2000] 7f2225f7c73d64b2cdba2432446b9fdd4cdd2127 - Tidy data
[noreply] 6d81f64d1d69f039559ee892bc91c66e4613b69a - Delete jenkinsfile
[noreply] ae06f00bb536d5204ba6264fbd8b61e03b1fdb1a - Update columns.csv
[noreply] 66d93a9e02d31f8e2245324327bfec0c68d6c0ab - Add files via upload
[noreply] 91f5d146791e548fca924c25f48bb8a2e15ffda2 - Add files via upload
[noreply] 167078c929ef98933d5fd902a3332314c7994b64 - Add files via upload
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 243 lines...]
Masking supported pattern matches of $CACHE_USER or $CACHE_PASS
[Pipeline] {
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
Deleting 1 temporary files
[Pipeline] // configFileProvider
[Pipeline] echo
Finding job draft
[Pipeline] configFileProvider
provisioning config files...
copy managed file [JsonConfig] to file:/var/jenkins_home/workspace/GSS_data/Disability/DWP-Family-Resources-Survey-Disability@tmp/config7776766211331266212tmp
[Pipeline] {
[Pipeline] readFile
[Pipeline] readJSON
[Pipeline] withCredentials
Masking supported pattern matches of $USER or $PASS
[Pipeline] {
[Pipeline] withCredentials
Masking supported pattern matches of $CACHE_USER or $CACHE_PASS
[Pipeline] {
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
Deleting 1 temporary files
[Pipeline] // configFileProvider
[Pipeline] }
[Pipeline] // script
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build: No changes No changes
[noreply] ab079e2b34e898c19e2b17b4258205a6fa23550a - Create Jenkinsfile
[noreply] 960faf02e732d8adc36ccb50807dfa2fe9c41710 - Work so far
[Alex Tucker] ab84325e0080c22e9a9edd4d46396dc84b3e17f6 - Add upload.
[shannon1995black] a957bd123fd226c763d0ce8b49c97faae4177671 - removed text not required
[Alex Tucker] bcbd91d7f701da93d7d7c976f095ca78204e75a3 - Point to the right directory.
[Alex Tucker] a788916c1c44553673904fb72be22e8912f77815 - addData() arguments were the wrong way around.
[Alex Tucker] 0ba40c134125fa8f8faa7c7822d1463de19686c6 - Turtle is output in the base directory
[shannon1995black] 7be1e7dcbf2dba47709b612ae36065e6396d41aa - added column, and output observations.csv
[shannon1995black] 3592f9eeb4e041df2c0e059420ecf3485866f317 - update column names to match info.json
[shannon1995black] 7b1018a3fde9570f14d98e3b6d6f199f3d65c07c - Map column names to codelists
[Alex Tucker] 8f8f82c3cce034288148be6a7c6b212600965e25 - Add ${WORKSPACE} to file path. Use text/turtle.
[Alex Tucker] 21d442cc10477d802144d373d18effee097cbc54 - Add 'GP Practice' column definition.
[shannon1995black] c4e814f67a078c1b353178d42976721b6e71389d - Add household-disability-status to columns.csv
[shannon1995black] c1dd2827532008c6a82fbd21ad302e3c6e00cf60 - add workless-household-type to columns.csv
[shannon1995black] b267efd95be68166a494e0cafb76f4fa35f6c8fc - small typo
[Alex Tucker] 72f165d648b16b7f1fbcd2a2b74806795aca1fc0 - Fixed up NHS Scraper, so refactored a bit.
[noreply] e1d22f440042975dd3bfae687eb7fc73cd5ba048 - Add files via upload
[lperryman] cfac3c3424d6391fdd1b992d6e7b658e84a70e9c - Adding main.py file for DWP Survey Carer data
[lperryman] 5f15a5c69180bbb76c3641ba431dcff97e36bae3 - Adding main.py file for DWP Survey Carer data
[lperryman] 6483ab716295e6811facf1ef40b1ad5230aa2cad - Add codelists
[Grace Spitzer-Wong] 7b41f63bdeceb571e2ab89cbee2427a2cd813480 - geographical codelist creation
[Alex Tucker] e2c0b707b5dbdd02dcb3a0269f82b195346aafe9 - Initial Jenkinsfile for publishing reference data.
[mikelovesbooks] e4da872501be3f5d6d606f1968467f9b7ffb4229 - use /concept in value_template
[lperryman] 059cf57513ca76bd2edfc58702d4a6204c4a47c3 - Adding column names to colmns.csv file
[lperryman] 3c475e679a4d3d5b959598f4dd4d5223ea7997fc - Add Jenkins fileto DWP-Family-Resources-Survey-Carer
[lperryman] 0002fcdbd2f24d6b9660fcb5af826dd2e3fa9cfe - Changing Main extension to ipynb
[noreply] 7a094bbe548c0fcb93c0f73a70f265b06e58ed94 - Delete main.py
[mikelovesbooks] 534f0934e7d14c81bbec91f4d2f53c145039bbd9 - added PHE mental health specific age codelist
[noreply] af36168d16e3791c9d30f853b93e8322d77c132e - Delete phe-co-occurring-substance-misuse-and-mental-health-issues-age.csv
[lperryman] e0798dda2e2f4c181850d56154be9df02becd98d - CHanged Jenkins file
[mikelovesbooks] 659afb7998d2b69d93731a64f53c7999c71c851d - Add phe age codelist
[lperryman] d40b5d6ea35b06a78883f04f68306f5c87bad63a - CHanged Jenkins file
[mikelovesbooks] 8ff04a992123843da5db60d56eed495132f6a860 - remove temp code and notes, added local source
[lperryman] 8cca084f0c155a0f0e450344a12fd26431ac2e5b - adding main.py
[Alex Tucker] a11b7d0258a71b983debab13be4e978259f2e454 - Move codelist to reference/codelists
[mikelovesbooks] 2e5d8a348d574db9d19335bda313b6b690b11c25 - first stab at components.csv
[Alex Tucker] f19f8ddddafe532fb7caa38db5168a49bdba3058 - Swap notation/label. Add nhs-geographies.csv to list.
[noreply] f3edd1008ce566270d52a7822e3561b90ffdbb5b - Update Jenkinsfile
[mikelovesbooks] 8824f1e1e9ca8c1c36b5411b8a086cef40ecbc8d - update to typical path output conventions
[mikelovesbooks] 3d3e2f03022b702a219d9d0e3eb146dc5653cdcd - correct casing
[noreply] 6d630f3ccc45f348b3c6048d85a39ae1ad1b1063 - Update Jenkinsfile
[noreply] 9d5b15cbdcfe072a2a9967604cad658cbc63ce8c - Update Jenkinsfile
[noreply] 4c0f449081c55185bd7ca5ad02b079ef3a946bcc - Update Jenkinsfile
[noreply] b6b32719db9690130927a39cb7b3e2c646d24f30 - Update Jenkinsfile
[noreply] a60a003012bbf3783658da5e6e28716a8ee7c130 - Update Jenkinsfile
[noreply] 39e7f17f9f8e1287bcf511467c202510c6147ec7 - Update Jenkinsfile
[shannon1995black] d6d5b4111179c453f2008c356fa81ad0da472a55 - update info.json
[noreply] cd1591baa2e288256c701ec19dfa405e4a31817c - Update Jenkinsfile
[noreply] d4d2cdee726a0d253b656787e8fb793750b03e42 - Update Jenkinsfile
[noreply] 7fe955895c704dfed655bc9490c82c127bb6d7bc - Update Jenkinsfile
[noreply] febf6406f11d95d4478d49f7e4d08bd34cc604cc - Update Jenkinsfile
[noreply] 27a4d0665b94d991dc923c4d90e83b9a5de29257 - Update Jenkinsfile
[noreply] bb23d6f3fd6e4a864a11e41eac7c0c686088fad1 - Update Jenkinsfile
[Alex Tucker] 579161c647d95e3cafcd54136a6805ad48f3b39a - Add .DS_Store to ignore list.
[Alex Tucker] 54edcd208b0c7e3d4190eb0b9d06cd43026dd509 - Add NHS geographies column. Re-do some other columns for consistency.
[noreply] 2ff2c83493c1d833f8e3d8466c9442f790f601b2 - Update Jenkinsfile
[noreply] 38a7f55562f0c276372a360454ebbf18a911ca68 - Update Jenkinsfile
[noreply] 0e03166e5bb28d0693d6b605d6905dc72825fe60 - Remove Mac files
[noreply] 2de15466065da2c8605856e10c7465bad4671fc6 - Update Jenkinsfile
[noreply] 42e050a48416b3dae4cf8af651e5513dd89e6477 - Update Jenkinsfile
[noreply] d0dfcf5101b7878e5dd42cd854e52bbeb9ee1ac2 - Update Jenkinsfile
[noreply] 1ba5797427d04641549cda6d8668ccde90955cd0 - Update Jenkinsfile
[Alex Tucker] 01da946fdf72e70dbeb390619cf4f3110a2ffa32 - Remove tabs.
[noreply] 7f0c211f6c1fe86c5a67f8c7dc0ab30836292bcb - Update Jenkinsfile
[shannon1995black] 806748dc362e7ad7445368619df8ae755eb2c38f - update codelist-metadata
[shannon1995black] e3624416fb3c5b5e0166f6277fa1ad7228aa8d78 - Update components.csv
[Alex Tucker] 0bddb1261111bc95352c0b7a4cd50f6a114dc95b - Added missing ,
[Alex Tucker] b11947f1637fc913a1d6ab204045733882999e84 - Add 'ONS Geography' column
[Alex Tucker] 63c8b0b886a3a8286159f69d179ba679cdacdfe4 - Renamed columns to NHS Geography and ONS Geography to coincide with columns.csv.
[Alex Tucker] b74fbaef4bd3b995b22ca0e297a6a29014da14ea - Ignore more files
[Alex Tucker] f313dfd0f4e979985c7931800791bd609259b0c6 - Show tidied table.
[Alex Tucker] f8df83994d022f02ecd05edb1e029dec4962f0ec - Re-do template Jenkinsfile to account for changed directory layout.
[Alex Tucker] c82de2a234aa7041495547d045784ce7b62b33df - Move generic dataset Jenkinsfile to datasets directory, for use with all dataset pipelines.
[vtula2000] 7f2225f7c73d64b2cdba2432446b9fdd4cdd2127 - Tidy data
[noreply] 6d81f64d1d69f039559ee892bc91c66e4613b69a - Delete jenkinsfile
[noreply] ae06f00bb536d5204ba6264fbd8b61e03b1fdb1a - Update columns.csv
[noreply] 66d93a9e02d31f8e2245324327bfec0c68d6c0ab - Add files via upload
[noreply] 91f5d146791e548fca924c25f48bb8a2e15ffda2 - Add files via upload
[noreply] 167078c929ef98933d5fd902a3332314c7994b64 - Add files via upload
[noreply] ede44605bbf84dbb826c89242c5a59834e146ab3 - Add files via upload
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 243 lines...]
Masking supported pattern matches of $CACHE_USER or $CACHE_PASS
[Pipeline] {
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
Deleting 1 temporary files
[Pipeline] // configFileProvider
[Pipeline] echo
Finding job draft
[Pipeline] configFileProvider
provisioning config files...
copy managed file [JsonConfig] to file:/var/jenkins_home/workspace/GSS_data/Disability/DWP-Family-Resources-Survey-Disability@tmp/config1559252815753244281tmp
[Pipeline] {
[Pipeline] readFile
[Pipeline] readJSON
[Pipeline] withCredentials
Masking supported pattern matches of $USER or $PASS
[Pipeline] {
[Pipeline] withCredentials
Masking supported pattern matches of $CACHE_USER or $CACHE_PASS
[Pipeline] {
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
Deleting 1 temporary files
[Pipeline] // configFileProvider
[Pipeline] }
[Pipeline] // script
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build: No changes No changes
[noreply] ab079e2b34e898c19e2b17b4258205a6fa23550a - Create Jenkinsfile
[noreply] 960faf02e732d8adc36ccb50807dfa2fe9c41710 - Work so far
[Alex Tucker] ab84325e0080c22e9a9edd4d46396dc84b3e17f6 - Add upload.
[shannon1995black] a957bd123fd226c763d0ce8b49c97faae4177671 - removed text not required
[Alex Tucker] bcbd91d7f701da93d7d7c976f095ca78204e75a3 - Point to the right directory.
[Alex Tucker] a788916c1c44553673904fb72be22e8912f77815 - addData() arguments were the wrong way around.
[Alex Tucker] 0ba40c134125fa8f8faa7c7822d1463de19686c6 - Turtle is output in the base directory
[shannon1995black] 7be1e7dcbf2dba47709b612ae36065e6396d41aa - added column, and output observations.csv
[shannon1995black] 3592f9eeb4e041df2c0e059420ecf3485866f317 - update column names to match info.json
[shannon1995black] 7b1018a3fde9570f14d98e3b6d6f199f3d65c07c - Map column names to codelists
[Alex Tucker] 8f8f82c3cce034288148be6a7c6b212600965e25 - Add ${WORKSPACE} to file path. Use text/turtle.
[Alex Tucker] 21d442cc10477d802144d373d18effee097cbc54 - Add 'GP Practice' column definition.
[shannon1995black] c4e814f67a078c1b353178d42976721b6e71389d - Add household-disability-status to columns.csv
[shannon1995black] c1dd2827532008c6a82fbd21ad302e3c6e00cf60 - add workless-household-type to columns.csv
[shannon1995black] b267efd95be68166a494e0cafb76f4fa35f6c8fc - small typo
[Alex Tucker] 72f165d648b16b7f1fbcd2a2b74806795aca1fc0 - Fixed up NHS Scraper, so refactored a bit.
[noreply] e1d22f440042975dd3bfae687eb7fc73cd5ba048 - Add files via upload
[lperryman] cfac3c3424d6391fdd1b992d6e7b658e84a70e9c - Adding main.py file for DWP Survey Carer data
[lperryman] 5f15a5c69180bbb76c3641ba431dcff97e36bae3 - Adding main.py file for DWP Survey Carer data
[lperryman] 6483ab716295e6811facf1ef40b1ad5230aa2cad - Add codelists
[Grace Spitzer-Wong] 7b41f63bdeceb571e2ab89cbee2427a2cd813480 - geographical codelist creation
[Alex Tucker] e2c0b707b5dbdd02dcb3a0269f82b195346aafe9 - Initial Jenkinsfile for publishing reference data.
[mikelovesbooks] e4da872501be3f5d6d606f1968467f9b7ffb4229 - use /concept in value_template
[lperryman] 059cf57513ca76bd2edfc58702d4a6204c4a47c3 - Adding column names to colmns.csv file
[lperryman] 3c475e679a4d3d5b959598f4dd4d5223ea7997fc - Add Jenkins fileto DWP-Family-Resources-Survey-Carer
[lperryman] 0002fcdbd2f24d6b9660fcb5af826dd2e3fa9cfe - Changing Main extension to ipynb
[noreply] 7a094bbe548c0fcb93c0f73a70f265b06e58ed94 - Delete main.py
[mikelovesbooks] 534f0934e7d14c81bbec91f4d2f53c145039bbd9 - added PHE mental health specific age codelist
[noreply] af36168d16e3791c9d30f853b93e8322d77c132e - Delete phe-co-occurring-substance-misuse-and-mental-health-issues-age.csv
[lperryman] e0798dda2e2f4c181850d56154be9df02becd98d - CHanged Jenkins file
[mikelovesbooks] 659afb7998d2b69d93731a64f53c7999c71c851d - Add phe age codelist
[lperryman] d40b5d6ea35b06a78883f04f68306f5c87bad63a - CHanged Jenkins file
[mikelovesbooks] 8ff04a992123843da5db60d56eed495132f6a860 - remove temp code and notes, added local source
[lperryman] 8cca084f0c155a0f0e450344a12fd26431ac2e5b - adding main.py
[Alex Tucker] a11b7d0258a71b983debab13be4e978259f2e454 - Move codelist to reference/codelists
[mikelovesbooks] 2e5d8a348d574db9d19335bda313b6b690b11c25 - first stab at components.csv
[Alex Tucker] f19f8ddddafe532fb7caa38db5168a49bdba3058 - Swap notation/label. Add nhs-geographies.csv to list.
[noreply] f3edd1008ce566270d52a7822e3561b90ffdbb5b - Update Jenkinsfile
[mikelovesbooks] 8824f1e1e9ca8c1c36b5411b8a086cef40ecbc8d - update to typical path output conventions
[mikelovesbooks] 3d3e2f03022b702a219d9d0e3eb146dc5653cdcd - correct casing
[noreply] 6d630f3ccc45f348b3c6048d85a39ae1ad1b1063 - Update Jenkinsfile
[noreply] 9d5b15cbdcfe072a2a9967604cad658cbc63ce8c - Update Jenkinsfile
[noreply] 4c0f449081c55185bd7ca5ad02b079ef3a946bcc - Update Jenkinsfile
[noreply] b6b32719db9690130927a39cb7b3e2c646d24f30 - Update Jenkinsfile
[noreply] a60a003012bbf3783658da5e6e28716a8ee7c130 - Update Jenkinsfile
[noreply] 39e7f17f9f8e1287bcf511467c202510c6147ec7 - Update Jenkinsfile
[shannon1995black] d6d5b4111179c453f2008c356fa81ad0da472a55 - update info.json
[noreply] cd1591baa2e288256c701ec19dfa405e4a31817c - Update Jenkinsfile
[noreply] d4d2cdee726a0d253b656787e8fb793750b03e42 - Update Jenkinsfile
[noreply] 7fe955895c704dfed655bc9490c82c127bb6d7bc - Update Jenkinsfile
[noreply] febf6406f11d95d4478d49f7e4d08bd34cc604cc - Update Jenkinsfile
[noreply] 27a4d0665b94d991dc923c4d90e83b9a5de29257 - Update Jenkinsfile
[noreply] bb23d6f3fd6e4a864a11e41eac7c0c686088fad1 - Update Jenkinsfile
[Alex Tucker] 579161c647d95e3cafcd54136a6805ad48f3b39a - Add .DS_Store to ignore list.
[Alex Tucker] 54edcd208b0c7e3d4190eb0b9d06cd43026dd509 - Add NHS geographies column. Re-do some other columns for consistency.
[noreply] 2ff2c83493c1d833f8e3d8466c9442f790f601b2 - Update Jenkinsfile
[noreply] 38a7f55562f0c276372a360454ebbf18a911ca68 - Update Jenkinsfile
[noreply] 0e03166e5bb28d0693d6b605d6905dc72825fe60 - Remove Mac files
[noreply] 2de15466065da2c8605856e10c7465bad4671fc6 - Update Jenkinsfile
[noreply] 42e050a48416b3dae4cf8af651e5513dd89e6477 - Update Jenkinsfile
[noreply] d0dfcf5101b7878e5dd42cd854e52bbeb9ee1ac2 - Update Jenkinsfile
[noreply] 1ba5797427d04641549cda6d8668ccde90955cd0 - Update Jenkinsfile
[Alex Tucker] 01da946fdf72e70dbeb390619cf4f3110a2ffa32 - Remove tabs.
[noreply] 7f0c211f6c1fe86c5a67f8c7dc0ab30836292bcb - Update Jenkinsfile
[shannon1995black] 806748dc362e7ad7445368619df8ae755eb2c38f - update codelist-metadata
[shannon1995black] e3624416fb3c5b5e0166f6277fa1ad7228aa8d78 - Update components.csv
[Alex Tucker] 0bddb1261111bc95352c0b7a4cd50f6a114dc95b - Added missing ,
[Alex Tucker] b11947f1637fc913a1d6ab204045733882999e84 - Add 'ONS Geography' column
[Alex Tucker] 63c8b0b886a3a8286159f69d179ba679cdacdfe4 - Renamed columns to NHS Geography and ONS Geography to coincide with columns.csv.
[Alex Tucker] b74fbaef4bd3b995b22ca0e297a6a29014da14ea - Ignore more files
[Alex Tucker] f313dfd0f4e979985c7931800791bd609259b0c6 - Show tidied table.
[Alex Tucker] f8df83994d022f02ecd05edb1e029dec4962f0ec - Re-do template Jenkinsfile to account for changed directory layout.
[Alex Tucker] c82de2a234aa7041495547d045784ce7b62b33df - Move generic dataset Jenkinsfile to datasets directory, for use with all dataset pipelines.
[vtula2000] 7f2225f7c73d64b2cdba2432446b9fdd4cdd2127 - Tidy data
[noreply] 6d81f64d1d69f039559ee892bc91c66e4613b69a - Delete jenkinsfile
[noreply] ae06f00bb536d5204ba6264fbd8b61e03b1fdb1a - Update columns.csv
[noreply] 66d93a9e02d31f8e2245324327bfec0c68d6c0ab - Add files via upload
[noreply] 91f5d146791e548fca924c25f48bb8a2e15ffda2 - Add files via upload
[noreply] 167078c929ef98933d5fd902a3332314c7994b64 - Add files via upload
[noreply] ede44605bbf84dbb826c89242c5a59834e146ab3 - Add files via upload
[noreply] a943d5a4a9f7404f162fddd0d8c768b44916565c - Add files via upload
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 240 lines...]
Masking supported pattern matches of $CACHE_USER or $CACHE_PASS
[Pipeline] {
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
Deleting 1 temporary files
[Pipeline] // configFileProvider
[Pipeline] echo
Finding job draft
[Pipeline] configFileProvider
provisioning config files...
copy managed file [JsonConfig] to file:/var/jenkins_home/workspace/GSS_data/Disability/DWP-Family-Resources-Survey-Disability@tmp/config5796304277414502753tmp
[Pipeline] {
[Pipeline] readFile
[Pipeline] readJSON
[Pipeline] withCredentials
Masking supported pattern matches of $USER or $PASS
[Pipeline] {
[Pipeline] withCredentials
Masking supported pattern matches of $CACHE_USER or $CACHE_PASS
[Pipeline] {
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
Deleting 1 temporary files
[Pipeline] // configFileProvider
[Pipeline] }
[Pipeline] // script
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build: No changes No changes
[noreply] ab079e2b34e898c19e2b17b4258205a6fa23550a - Create Jenkinsfile
[noreply] 960faf02e732d8adc36ccb50807dfa2fe9c41710 - Work so far
[Alex Tucker] ab84325e0080c22e9a9edd4d46396dc84b3e17f6 - Add upload.
[shannon1995black] a957bd123fd226c763d0ce8b49c97faae4177671 - removed text not required
[Alex Tucker] bcbd91d7f701da93d7d7c976f095ca78204e75a3 - Point to the right directory.
[Alex Tucker] a788916c1c44553673904fb72be22e8912f77815 - addData() arguments were the wrong way around.
[Alex Tucker] 0ba40c134125fa8f8faa7c7822d1463de19686c6 - Turtle is output in the base directory
[shannon1995black] 7be1e7dcbf2dba47709b612ae36065e6396d41aa - added column, and output observations.csv
[shannon1995black] 3592f9eeb4e041df2c0e059420ecf3485866f317 - update column names to match info.json
[shannon1995black] 7b1018a3fde9570f14d98e3b6d6f199f3d65c07c - Map column names to codelists
[Alex Tucker] 8f8f82c3cce034288148be6a7c6b212600965e25 - Add ${WORKSPACE} to file path. Use text/turtle.
[Alex Tucker] 21d442cc10477d802144d373d18effee097cbc54 - Add 'GP Practice' column definition.
[shannon1995black] c4e814f67a078c1b353178d42976721b6e71389d - Add household-disability-status to columns.csv
[shannon1995black] c1dd2827532008c6a82fbd21ad302e3c6e00cf60 - add workless-household-type to columns.csv
[shannon1995black] b267efd95be68166a494e0cafb76f4fa35f6c8fc - small typo
[Alex Tucker] 72f165d648b16b7f1fbcd2a2b74806795aca1fc0 - Fixed up NHS Scraper, so refactored a bit.
[noreply] e1d22f440042975dd3bfae687eb7fc73cd5ba048 - Add files via upload
[lperryman] cfac3c3424d6391fdd1b992d6e7b658e84a70e9c - Adding main.py file for DWP Survey Carer data
[lperryman] 5f15a5c69180bbb76c3641ba431dcff97e36bae3 - Adding main.py file for DWP Survey Carer data
[lperryman] 6483ab716295e6811facf1ef40b1ad5230aa2cad - Add codelists
[Grace Spitzer-Wong] 7b41f63bdeceb571e2ab89cbee2427a2cd813480 - geographical codelist creation
[Alex Tucker] e2c0b707b5dbdd02dcb3a0269f82b195346aafe9 - Initial Jenkinsfile for publishing reference data.
[mikelovesbooks] e4da872501be3f5d6d606f1968467f9b7ffb4229 - use /concept in value_template
[lperryman] 059cf57513ca76bd2edfc58702d4a6204c4a47c3 - Adding column names to colmns.csv file
[lperryman] 3c475e679a4d3d5b959598f4dd4d5223ea7997fc - Add Jenkins fileto DWP-Family-Resources-Survey-Carer
[lperryman] 0002fcdbd2f24d6b9660fcb5af826dd2e3fa9cfe - Changing Main extension to ipynb
[noreply] 7a094bbe548c0fcb93c0f73a70f265b06e58ed94 - Delete main.py
[mikelovesbooks] 534f0934e7d14c81bbec91f4d2f53c145039bbd9 - added PHE mental health specific age codelist
[noreply] af36168d16e3791c9d30f853b93e8322d77c132e - Delete phe-co-occurring-substance-misuse-and-mental-health-issues-age.csv
[lperryman] e0798dda2e2f4c181850d56154be9df02becd98d - CHanged Jenkins file
[mikelovesbooks] 659afb7998d2b69d93731a64f53c7999c71c851d - Add phe age codelist
[lperryman] d40b5d6ea35b06a78883f04f68306f5c87bad63a - CHanged Jenkins file
[mikelovesbooks] 8ff04a992123843da5db60d56eed495132f6a860 - remove temp code and notes, added local source
[lperryman] 8cca084f0c155a0f0e450344a12fd26431ac2e5b - adding main.py
[Alex Tucker] a11b7d0258a71b983debab13be4e978259f2e454 - Move codelist to reference/codelists
[mikelovesbooks] 2e5d8a348d574db9d19335bda313b6b690b11c25 - first stab at components.csv
[Alex Tucker] f19f8ddddafe532fb7caa38db5168a49bdba3058 - Swap notation/label. Add nhs-geographies.csv to list.
[noreply] f3edd1008ce566270d52a7822e3561b90ffdbb5b - Update Jenkinsfile
[mikelovesbooks] 8824f1e1e9ca8c1c36b5411b8a086cef40ecbc8d - update to typical path output conventions
[mikelovesbooks] 3d3e2f03022b702a219d9d0e3eb146dc5653cdcd - correct casing
[noreply] 6d630f3ccc45f348b3c6048d85a39ae1ad1b1063 - Update Jenkinsfile
[noreply] 9d5b15cbdcfe072a2a9967604cad658cbc63ce8c - Update Jenkinsfile
[noreply] 4c0f449081c55185bd7ca5ad02b079ef3a946bcc - Update Jenkinsfile
[noreply] b6b32719db9690130927a39cb7b3e2c646d24f30 - Update Jenkinsfile
[noreply] a60a003012bbf3783658da5e6e28716a8ee7c130 - Update Jenkinsfile
[noreply] 39e7f17f9f8e1287bcf511467c202510c6147ec7 - Update Jenkinsfile
[shannon1995black] d6d5b4111179c453f2008c356fa81ad0da472a55 - update info.json
[noreply] cd1591baa2e288256c701ec19dfa405e4a31817c - Update Jenkinsfile
[noreply] d4d2cdee726a0d253b656787e8fb793750b03e42 - Update Jenkinsfile
[noreply] 7fe955895c704dfed655bc9490c82c127bb6d7bc - Update Jenkinsfile
[noreply] febf6406f11d95d4478d49f7e4d08bd34cc604cc - Update Jenkinsfile
[noreply] 27a4d0665b94d991dc923c4d90e83b9a5de29257 - Update Jenkinsfile
[noreply] bb23d6f3fd6e4a864a11e41eac7c0c686088fad1 - Update Jenkinsfile
[Alex Tucker] 579161c647d95e3cafcd54136a6805ad48f3b39a - Add .DS_Store to ignore list.
[Alex Tucker] 54edcd208b0c7e3d4190eb0b9d06cd43026dd509 - Add NHS geographies column. Re-do some other columns for consistency.
[noreply] 2ff2c83493c1d833f8e3d8466c9442f790f601b2 - Update Jenkinsfile
[noreply] 38a7f55562f0c276372a360454ebbf18a911ca68 - Update Jenkinsfile
[noreply] 0e03166e5bb28d0693d6b605d6905dc72825fe60 - Remove Mac files
[noreply] 2de15466065da2c8605856e10c7465bad4671fc6 - Update Jenkinsfile
[noreply] 42e050a48416b3dae4cf8af651e5513dd89e6477 - Update Jenkinsfile
[noreply] d0dfcf5101b7878e5dd42cd854e52bbeb9ee1ac2 - Update Jenkinsfile
[noreply] 1ba5797427d04641549cda6d8668ccde90955cd0 - Update Jenkinsfile
[Alex Tucker] 01da946fdf72e70dbeb390619cf4f3110a2ffa32 - Remove tabs.
[noreply] 7f0c211f6c1fe86c5a67f8c7dc0ab30836292bcb - Update Jenkinsfile
[shannon1995black] 806748dc362e7ad7445368619df8ae755eb2c38f - update codelist-metadata
[shannon1995black] e3624416fb3c5b5e0166f6277fa1ad7228aa8d78 - Update components.csv
[Alex Tucker] 0bddb1261111bc95352c0b7a4cd50f6a114dc95b - Added missing ,
[Alex Tucker] b11947f1637fc913a1d6ab204045733882999e84 - Add 'ONS Geography' column
[Alex Tucker] 63c8b0b886a3a8286159f69d179ba679cdacdfe4 - Renamed columns to NHS Geography and ONS Geography to coincide with columns.csv.
[Alex Tucker] b74fbaef4bd3b995b22ca0e297a6a29014da14ea - Ignore more files
[Alex Tucker] f313dfd0f4e979985c7931800791bd609259b0c6 - Show tidied table.
[Alex Tucker] f8df83994d022f02ecd05edb1e029dec4962f0ec - Re-do template Jenkinsfile to account for changed directory layout.
[Alex Tucker] c82de2a234aa7041495547d045784ce7b62b33df - Move generic dataset Jenkinsfile to datasets directory, for use with all dataset pipelines.
[vtula2000] 7f2225f7c73d64b2cdba2432446b9fdd4cdd2127 - Tidy data
[noreply] 6d81f64d1d69f039559ee892bc91c66e4613b69a - Delete jenkinsfile
[noreply] ae06f00bb536d5204ba6264fbd8b61e03b1fdb1a - Update columns.csv
[noreply] 66d93a9e02d31f8e2245324327bfec0c68d6c0ab - Add files via upload
[noreply] 91f5d146791e548fca924c25f48bb8a2e15ffda2 - Add files via upload
[noreply] 167078c929ef98933d5fd902a3332314c7994b64 - Add files via upload
[noreply] ede44605bbf84dbb826c89242c5a59834e146ab3 - Add files via upload
[noreply] a943d5a4a9f7404f162fddd0d8c768b44916565c - Add files via upload
[shannon1995black] d8f23000ae5700a9c08d58bfd81adcf6d4ce023a - updated main - tidy data
[shannon1995black] 8ff0ea0f086a2d1e83224875cdf331268240c09d - removed Jenkinsfile
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 243 lines...]
Masking supported pattern matches of $CACHE_USER or $CACHE_PASS
[Pipeline] {
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
Deleting 1 temporary files
[Pipeline] // configFileProvider
[Pipeline] echo
Finding job draft
[Pipeline] configFileProvider
provisioning config files...
copy managed file [JsonConfig] to file:/var/jenkins_home/workspace/GSS_data/Disability/DWP-Family-Resources-Survey-Disability@tmp/config3731717793397296962tmp
[Pipeline] {
[Pipeline] readFile
[Pipeline] readJSON
[Pipeline] withCredentials
Masking supported pattern matches of $USER or $PASS
[Pipeline] {
[Pipeline] withCredentials
Masking supported pattern matches of $CACHE_USER or $CACHE_PASS
[Pipeline] {
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
Deleting 1 temporary files
[Pipeline] // configFileProvider
[Pipeline] }
[Pipeline] // script
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build: No changes No changes
[noreply] ab079e2b34e898c19e2b17b4258205a6fa23550a - Create Jenkinsfile
[noreply] 960faf02e732d8adc36ccb50807dfa2fe9c41710 - Work so far
[Alex Tucker] ab84325e0080c22e9a9edd4d46396dc84b3e17f6 - Add upload.
[shannon1995black] a957bd123fd226c763d0ce8b49c97faae4177671 - removed text not required
[Alex Tucker] bcbd91d7f701da93d7d7c976f095ca78204e75a3 - Point to the right directory.
[Alex Tucker] a788916c1c44553673904fb72be22e8912f77815 - addData() arguments were the wrong way around.
[Alex Tucker] 0ba40c134125fa8f8faa7c7822d1463de19686c6 - Turtle is output in the base directory
[shannon1995black] 7be1e7dcbf2dba47709b612ae36065e6396d41aa - added column, and output observations.csv
[shannon1995black] 3592f9eeb4e041df2c0e059420ecf3485866f317 - update column names to match info.json
[shannon1995black] 7b1018a3fde9570f14d98e3b6d6f199f3d65c07c - Map column names to codelists
[Alex Tucker] 8f8f82c3cce034288148be6a7c6b212600965e25 - Add ${WORKSPACE} to file path. Use text/turtle.
[Alex Tucker] 21d442cc10477d802144d373d18effee097cbc54 - Add 'GP Practice' column definition.
[shannon1995black] c4e814f67a078c1b353178d42976721b6e71389d - Add household-disability-status to columns.csv
[shannon1995black] c1dd2827532008c6a82fbd21ad302e3c6e00cf60 - add workless-household-type to columns.csv
[shannon1995black] b267efd95be68166a494e0cafb76f4fa35f6c8fc - small typo
[Alex Tucker] 72f165d648b16b7f1fbcd2a2b74806795aca1fc0 - Fixed up NHS Scraper, so refactored a bit.
[noreply] e1d22f440042975dd3bfae687eb7fc73cd5ba048 - Add files via upload
[lperryman] cfac3c3424d6391fdd1b992d6e7b658e84a70e9c - Adding main.py file for DWP Survey Carer data
[lperryman] 5f15a5c69180bbb76c3641ba431dcff97e36bae3 - Adding main.py file for DWP Survey Carer data
[lperryman] 6483ab716295e6811facf1ef40b1ad5230aa2cad - Add codelists
[Grace Spitzer-Wong] 7b41f63bdeceb571e2ab89cbee2427a2cd813480 - geographical codelist creation
[Alex Tucker] e2c0b707b5dbdd02dcb3a0269f82b195346aafe9 - Initial Jenkinsfile for publishing reference data.
[mikelovesbooks] e4da872501be3f5d6d606f1968467f9b7ffb4229 - use /concept in value_template
[lperryman] 059cf57513ca76bd2edfc58702d4a6204c4a47c3 - Adding column names to colmns.csv file
[lperryman] 3c475e679a4d3d5b959598f4dd4d5223ea7997fc - Add Jenkins fileto DWP-Family-Resources-Survey-Carer
[lperryman] 0002fcdbd2f24d6b9660fcb5af826dd2e3fa9cfe - Changing Main extension to ipynb
[noreply] 7a094bbe548c0fcb93c0f73a70f265b06e58ed94 - Delete main.py
[mikelovesbooks] 534f0934e7d14c81bbec91f4d2f53c145039bbd9 - added PHE mental health specific age codelist
[noreply] af36168d16e3791c9d30f853b93e8322d77c132e - Delete phe-co-occurring-substance-misuse-and-mental-health-issues-age.csv
[lperryman] e0798dda2e2f4c181850d56154be9df02becd98d - CHanged Jenkins file
[mikelovesbooks] 659afb7998d2b69d93731a64f53c7999c71c851d - Add phe age codelist
[lperryman] d40b5d6ea35b06a78883f04f68306f5c87bad63a - CHanged Jenkins file
[mikelovesbooks] 8ff04a992123843da5db60d56eed495132f6a860 - remove temp code and notes, added local source
[lperryman] 8cca084f0c155a0f0e450344a12fd26431ac2e5b - adding main.py
[Alex Tucker] a11b7d0258a71b983debab13be4e978259f2e454 - Move codelist to reference/codelists
[mikelovesbooks] 2e5d8a348d574db9d19335bda313b6b690b11c25 - first stab at components.csv
[Alex Tucker] f19f8ddddafe532fb7caa38db5168a49bdba3058 - Swap notation/label. Add nhs-geographies.csv to list.
[noreply] f3edd1008ce566270d52a7822e3561b90ffdbb5b - Update Jenkinsfile
[mikelovesbooks] 8824f1e1e9ca8c1c36b5411b8a086cef40ecbc8d - update to typical path output conventions
[mikelovesbooks] 3d3e2f03022b702a219d9d0e3eb146dc5653cdcd - correct casing
[noreply] 6d630f3ccc45f348b3c6048d85a39ae1ad1b1063 - Update Jenkinsfile
[noreply] 9d5b15cbdcfe072a2a9967604cad658cbc63ce8c - Update Jenkinsfile
[noreply] 4c0f449081c55185bd7ca5ad02b079ef3a946bcc - Update Jenkinsfile
[noreply] b6b32719db9690130927a39cb7b3e2c646d24f30 - Update Jenkinsfile
[noreply] a60a003012bbf3783658da5e6e28716a8ee7c130 - Update Jenkinsfile
[noreply] 39e7f17f9f8e1287bcf511467c202510c6147ec7 - Update Jenkinsfile
[shannon1995black] d6d5b4111179c453f2008c356fa81ad0da472a55 - update info.json
[noreply] cd1591baa2e288256c701ec19dfa405e4a31817c - Update Jenkinsfile
[noreply] d4d2cdee726a0d253b656787e8fb793750b03e42 - Update Jenkinsfile
[noreply] 7fe955895c704dfed655bc9490c82c127bb6d7bc - Update Jenkinsfile
[noreply] febf6406f11d95d4478d49f7e4d08bd34cc604cc - Update Jenkinsfile
[noreply] 27a4d0665b94d991dc923c4d90e83b9a5de29257 - Update Jenkinsfile
[noreply] bb23d6f3fd6e4a864a11e41eac7c0c686088fad1 - Update Jenkinsfile
[Alex Tucker] 579161c647d95e3cafcd54136a6805ad48f3b39a - Add .DS_Store to ignore list.
[Alex Tucker] 54edcd208b0c7e3d4190eb0b9d06cd43026dd509 - Add NHS geographies column. Re-do some other columns for consistency.
[noreply] 2ff2c83493c1d833f8e3d8466c9442f790f601b2 - Update Jenkinsfile
[noreply] 38a7f55562f0c276372a360454ebbf18a911ca68 - Update Jenkinsfile
[noreply] 0e03166e5bb28d0693d6b605d6905dc72825fe60 - Remove Mac files
[noreply] 2de15466065da2c8605856e10c7465bad4671fc6 - Update Jenkinsfile
[noreply] 42e050a48416b3dae4cf8af651e5513dd89e6477 - Update Jenkinsfile
[noreply] d0dfcf5101b7878e5dd42cd854e52bbeb9ee1ac2 - Update Jenkinsfile
[noreply] 1ba5797427d04641549cda6d8668ccde90955cd0 - Update Jenkinsfile
[Alex Tucker] 01da946fdf72e70dbeb390619cf4f3110a2ffa32 - Remove tabs.
[noreply] 7f0c211f6c1fe86c5a67f8c7dc0ab30836292bcb - Update Jenkinsfile
[shannon1995black] 806748dc362e7ad7445368619df8ae755eb2c38f - update codelist-metadata
[shannon1995black] e3624416fb3c5b5e0166f6277fa1ad7228aa8d78 - Update components.csv
[Alex Tucker] 0bddb1261111bc95352c0b7a4cd50f6a114dc95b - Added missing ,
[Alex Tucker] b11947f1637fc913a1d6ab204045733882999e84 - Add 'ONS Geography' column
[Alex Tucker] 63c8b0b886a3a8286159f69d179ba679cdacdfe4 - Renamed columns to NHS Geography and ONS Geography to coincide with columns.csv.
[Alex Tucker] b74fbaef4bd3b995b22ca0e297a6a29014da14ea - Ignore more files
[Alex Tucker] f313dfd0f4e979985c7931800791bd609259b0c6 - Show tidied table.
[Alex Tucker] f8df83994d022f02ecd05edb1e029dec4962f0ec - Re-do template Jenkinsfile to account for changed directory layout.
[Alex Tucker] c82de2a234aa7041495547d045784ce7b62b33df - Move generic dataset Jenkinsfile to datasets directory, for use with all dataset pipelines.
[vtula2000] 7f2225f7c73d64b2cdba2432446b9fdd4cdd2127 - Tidy data
[noreply] 6d81f64d1d69f039559ee892bc91c66e4613b69a - Delete jenkinsfile
[noreply] ae06f00bb536d5204ba6264fbd8b61e03b1fdb1a - Update columns.csv
[noreply] 66d93a9e02d31f8e2245324327bfec0c68d6c0ab - Add files via upload
[noreply] 91f5d146791e548fca924c25f48bb8a2e15ffda2 - Add files via upload
[noreply] 167078c929ef98933d5fd902a3332314c7994b64 - Add files via upload
[noreply] ede44605bbf84dbb826c89242c5a59834e146ab3 - Add files via upload
[noreply] a943d5a4a9f7404f162fddd0d8c768b44916565c - Add files via upload
[shannon1995black] d8f23000ae5700a9c08d58bfd81adcf6d4ce023a - updated main - tidy data
[shannon1995black] 8ff0ea0f086a2d1e83224875cdf331268240c09d - removed Jenkinsfile
[shannon1995black] a73318ee261b8f2cd78ee28b254b9b1b68866744 - updated info.json
[shannon1995black] eaccd48042a602dfe01d4c8cf3ed86cf6d1eb46c - converted main.ipynb to main.py
[noreply] 0577cca5163a477ee46ba8608d8bac2de4dbeaa7 - Update main.py
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 241 lines...]
Masking supported pattern matches of $CACHE_USER or $CACHE_PASS
[Pipeline] {
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
Deleting 1 temporary files
[Pipeline] // configFileProvider
[Pipeline] echo
Finding job draft
[Pipeline] configFileProvider
provisioning config files...
copy managed file [JsonConfig] to file:/var/jenkins_home/workspace/GSS_data/Disability/DWP-Family-Resources-Survey-Disability@tmp/config6324906268727432305tmp
[Pipeline] {
[Pipeline] readFile
[Pipeline] readJSON
[Pipeline] withCredentials
Masking supported pattern matches of $USER or $PASS
[Pipeline] {
[Pipeline] withCredentials
Masking supported pattern matches of $CACHE_USER or $CACHE_PASS
[Pipeline] {
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
Deleting 1 temporary files
[Pipeline] // configFileProvider
[Pipeline] }
[Pipeline] // script
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 241 lines...]
Masking supported pattern matches of $CACHE_USER or $CACHE_PASS
[Pipeline] {
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
Deleting 1 temporary files
[Pipeline] // configFileProvider
[Pipeline] echo
Finding job draft
[Pipeline] configFileProvider
provisioning config files...
copy managed file [JsonConfig] to file:/var/jenkins_home/workspace/GSS_data/Disability/DWP-Family-Resources-Survey-Disability@tmp/config7206404138428613726tmp
[Pipeline] {
[Pipeline] readFile
[Pipeline] readJSON
[Pipeline] withCredentials
Masking supported pattern matches of $USER or $PASS
[Pipeline] {
[Pipeline] withCredentials
Masking supported pattern matches of $CACHE_USER or $CACHE_PASS
[Pipeline] {
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
Deleting 1 temporary files
[Pipeline] // configFileProvider
[Pipeline] }
[Pipeline] // script
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 241 lines...]
Masking supported pattern matches of $CACHE_USER or $CACHE_PASS
[Pipeline] {
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
Deleting 1 temporary files
[Pipeline] // configFileProvider
[Pipeline] echo
Finding job draft
[Pipeline] configFileProvider
provisioning config files...
copy managed file [JsonConfig] to file:/var/jenkins_home/workspace/GSS_data/Disability/DWP-Family-Resources-Survey-Disability@tmp/config7715708369322260670tmp
[Pipeline] {
[Pipeline] readFile
[Pipeline] readJSON
[Pipeline] withCredentials
Masking supported pattern matches of $USER or $PASS
[Pipeline] {
[Pipeline] withCredentials
Masking supported pattern matches of $CACHE_USER or $CACHE_PASS
[Pipeline] {
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
Deleting 1 temporary files
[Pipeline] // configFileProvider
[Pipeline] }
[Pipeline] // script
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes No changes
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 243 lines...]
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
Deleting 1 temporary files
[Pipeline] // configFileProvider
[Pipeline] echo
Finding job draft
[Pipeline] configFileProvider
provisioning config files...
copy managed file [JsonConfig] to file:/var/jenkins_home/workspace/GSS_data/Disability/DWP-Family-Resources-Survey-Disability@tmp/config6533479557733130604tmp
[Pipeline] {
[Pipeline] readFile
[Pipeline] readJSON
[Pipeline] withCredentials
Masking supported pattern matches of $USER or $PASS
[Pipeline] {
[Pipeline] withCredentials
Masking supported pattern matches of $CACHE_USER or $CACHE_PASS
[Pipeline] {
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
[Pipeline] // withCredentials
[Pipeline] }
Deleting 1 temporary files
[Pipeline] // configFileProvider
[Pipeline] echo
Uploading datasets/DWP-Family-Resources-Survey-Disability/out/observations.csv
[Pipeline] }
[Pipeline] // script
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes No changes No changes
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 663 lines...]
534. too_many_values. Row: 264. Percent
535. invalid_number. Row: 265,6. Percentage
536. too_many_values. Row: 265. Percent
537. invalid_number. Row: 266,6. Percentage
538. too_many_values. Row: 266. Percent
539. invalid_number. Row: 267,6. Percentage
540. too_many_values. Row: 267. Percent
541. invalid_number. Row: 268,6. Percentage
542. too_many_values. Row: 268. Percent
543. invalid_number. Row: 269,6. Percentage
544. too_many_values. Row: 269. Percent
545. invalid_number. Row: 270,6. Percentage
546. too_many_values. Row: 270. Percent
547. invalid_number. Row: 271,6. Percentage
548. too_many_values. Row: 271. Percent
549. invalid_number. Row: 272,6. Percentage
550. too_many_values. Row: 272. Percent
551. invalid_number. Row: 273,6. Percentage
552. too_many_values. Row: 273. Percent
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 617cfc0a17aced38ff7aae66c7f428316f858bfdea8155c24cf07be52843e4b2
$ docker rm -f 617cfc0a17aced38ff7aae66c7f428316f858bfdea8155c24cf07be52843e4b2
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes No changes No changes
[Alex Tucker] 516eb5ee94da99618bf476c56c3e6517c2482083 - Remove old special case for when out/observations.csv exists.
[Alex Tucker] 6820fef84d1c73bbfb16d07f87259afa096c4cbc - Fix ragged rows. Use DOS line endings as that's what text/* mimetypes should do.
[lperryman] f961b501f993b6801d5d1bbfec841d36350e64a3 - datasets/DWP-Family-Resources-Survey-Carer/main.py had all the wrong formatting for some reason so changed
[lperryman] 22b78bfeee1cd7bcf5833e739f418c8b211490ae - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[lperryman] 1f3e2fec7a6f13c5c0ea02bcf96e77170ac62fd8 - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[mikelovesbooks] 386eaf2559c7547c0ebc252327f160425470eba3 - added temporary manual trig file
[mikelovesbooks] a4e72e6d296eadf60ec9f43ea295284b1617b341 - updated PHE codelists
[mikelovesbooks] 92e9710cf77d6567a2422f330be4da61b8692203 - data from fingertips
[mikelovesbooks] 4dce0948a896af31013ae2554cab5d6a2b918dfe - remove old local data csv
[noreply] cffc20ac58d99cf982d93f417a6b5fc75915d639 - Delete main.ipynb
[noreply] 87ede54c0396e304ac5d372aa71eba0024f0e2d3 - Delete Jenkinsfile
[shannon1995black] be84d9fdec016c03bf7de6c1597c64218621d99a - update naming
[noreply] 928e88d31a7b985e10d265e871871edd92f9aa66 - remove unnecessary time period entry
[lperryman] 4431431355ab317f4d9aa3db8ce695cfb9c130ee - Adding rows to the components csv file
[shannon1995black] b4d0f885f6084447ec8add6ed66d3affc161332d - update main
[lperryman] 037a500fa0ea442f64b9e87949b519ac5c672e43 - Sorting ourt the schema file
[lperryman] d7079738021323d7aba78930006122c17eb2adb9 - Had a capital i one of the column headings when it should have been lower case!
[shannon1995black] 8260ab10b2288609275aa23585d28cc77faff340 - updates
[shannon1995black] 7871ceb8e22f7205829a9ca14da022fa0b86c374 - updated json file
[lperryman] 417d7d297486f1e7780b1ad3d26cfda4a37158f5 - Adding Period to columns.csv
[lperryman] 44e902bc5d106ebfa2eb318e4c64c528c42b5be4 - Getting rid of capital letter in one of the columns
[shannon1995black] af39b43f7fb1c3cbdce95f106bb5c8f81f7e5781 - update column name
[shannon1995black] 3a1135fd0c90a4d0174833f051dd372379ab2c69 - uncomment line to create observations.csv-schema.json
[lperryman] 78c14f03098459533da8df4fb7f970caf2d8f71b - Fixing columns.csv
[lperryman] 74a2b37b464c294dbeb19e5f4e41afdfb39c7ff0 - FIxing columns.csv
[lperryman] cdddeee62af46cccbf93274988364109ffd6e672 - FIxing columns.csv
[lperryman] 632a12b75329e5474b55649a26086f0753e8124a - FIxing columns.csv
[lperryman] 3ce5b581d49b56746c235eb25b055991cc7356da - FIxing columns.csv
[lperryman] bb77f055a6aff4914c2d2652efd5fd1b59149d8a - FIxing columns.csv
[Alex Tucker] 6f1cce14484ed02ddb7103995dd8cdd7c8f33cbe - Output dataset metadata and schema.
[lperryman] da8845089d902d7315ba221997bd3b7e2e087173 - FIxing columns.csv
[shannon1995black] 400c47b3af5219f66d019ca206d93bb598b25ad8 - updated value transformation type
[shannon1995black] b7f3b191dc4995a7ba3e2771a7f2bd00f9879e2d - title to uppercase
[lperryman] 513d057cabaf3c9b6e6297f7ae76f28063793427 - Change Year to period and formatted string to represent for 2 year period
[noreply] 3c54f0603efb9580f0cbd92741e32dda7c7bb283 - Update columns.csv
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 935 lines...]
806. too_many_values. Row: 267. Percent
807. format. Row: 268,3. Social/behavioural
808. invalid_number. Row: 268,6. Percentage
809. too_many_values. Row: 268. Percent
810. format. Row: 269,3. Social/behavioural
811. invalid_number. Row: 269,6. Percentage
812. too_many_values. Row: 269. Percent
813. format. Row: 270,3. Other
814. invalid_number. Row: 270,6. Percentage
815. too_many_values. Row: 270. Percent
816. format. Row: 271,3. Other
817. invalid_number. Row: 271,6. Percentage
818. too_many_values. Row: 271. Percent
819. format. Row: 272,3. Other
820. invalid_number. Row: 272,6. Percentage
821. too_many_values. Row: 272. Percent
822. format. Row: 273,3. Other
823. invalid_number. Row: 273,6. Percentage
824. too_many_values. Row: 273. Percent
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 506209d1b9c0888c3380d70d6f93d6613b76393237b36fcff3acd350f9ae8047
$ docker rm -f 506209d1b9c0888c3380d70d6f93d6613b76393237b36fcff3acd350f9ae8047
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes No changes No changes
[Alex Tucker] 516eb5ee94da99618bf476c56c3e6517c2482083 - Remove old special case for when out/observations.csv exists.
[Alex Tucker] 6820fef84d1c73bbfb16d07f87259afa096c4cbc - Fix ragged rows. Use DOS line endings as that's what text/* mimetypes should do.
[lperryman] f961b501f993b6801d5d1bbfec841d36350e64a3 - datasets/DWP-Family-Resources-Survey-Carer/main.py had all the wrong formatting for some reason so changed
[lperryman] 22b78bfeee1cd7bcf5833e739f418c8b211490ae - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[lperryman] 1f3e2fec7a6f13c5c0ea02bcf96e77170ac62fd8 - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[mikelovesbooks] 386eaf2559c7547c0ebc252327f160425470eba3 - added temporary manual trig file
[mikelovesbooks] a4e72e6d296eadf60ec9f43ea295284b1617b341 - updated PHE codelists
[mikelovesbooks] 92e9710cf77d6567a2422f330be4da61b8692203 - data from fingertips
[mikelovesbooks] 4dce0948a896af31013ae2554cab5d6a2b918dfe - remove old local data csv
[noreply] cffc20ac58d99cf982d93f417a6b5fc75915d639 - Delete main.ipynb
[noreply] 87ede54c0396e304ac5d372aa71eba0024f0e2d3 - Delete Jenkinsfile
[shannon1995black] be84d9fdec016c03bf7de6c1597c64218621d99a - update naming
[noreply] 928e88d31a7b985e10d265e871871edd92f9aa66 - remove unnecessary time period entry
[lperryman] 4431431355ab317f4d9aa3db8ce695cfb9c130ee - Adding rows to the components csv file
[shannon1995black] b4d0f885f6084447ec8add6ed66d3affc161332d - update main
[lperryman] 037a500fa0ea442f64b9e87949b519ac5c672e43 - Sorting ourt the schema file
[lperryman] d7079738021323d7aba78930006122c17eb2adb9 - Had a capital i one of the column headings when it should have been lower case!
[shannon1995black] 8260ab10b2288609275aa23585d28cc77faff340 - updates
[shannon1995black] 7871ceb8e22f7205829a9ca14da022fa0b86c374 - updated json file
[lperryman] 417d7d297486f1e7780b1ad3d26cfda4a37158f5 - Adding Period to columns.csv
[lperryman] 44e902bc5d106ebfa2eb318e4c64c528c42b5be4 - Getting rid of capital letter in one of the columns
[shannon1995black] af39b43f7fb1c3cbdce95f106bb5c8f81f7e5781 - update column name
[shannon1995black] 3a1135fd0c90a4d0174833f051dd372379ab2c69 - uncomment line to create observations.csv-schema.json
[lperryman] 78c14f03098459533da8df4fb7f970caf2d8f71b - Fixing columns.csv
[lperryman] 74a2b37b464c294dbeb19e5f4e41afdfb39c7ff0 - FIxing columns.csv
[lperryman] cdddeee62af46cccbf93274988364109ffd6e672 - FIxing columns.csv
[lperryman] 632a12b75329e5474b55649a26086f0753e8124a - FIxing columns.csv
[lperryman] 3ce5b581d49b56746c235eb25b055991cc7356da - FIxing columns.csv
[lperryman] bb77f055a6aff4914c2d2652efd5fd1b59149d8a - FIxing columns.csv
[Alex Tucker] 6f1cce14484ed02ddb7103995dd8cdd7c8f33cbe - Output dataset metadata and schema.
[lperryman] da8845089d902d7315ba221997bd3b7e2e087173 - FIxing columns.csv
[shannon1995black] 400c47b3af5219f66d019ca206d93bb598b25ad8 - updated value transformation type
[shannon1995black] b7f3b191dc4995a7ba3e2771a7f2bd00f9879e2d - title to uppercase
[lperryman] 513d057cabaf3c9b6e6297f7ae76f28063793427 - Change Year to period and formatted string to represent for 2 year period
[noreply] 3c54f0603efb9580f0cbd92741e32dda7c7bb283 - Update columns.csv
[lperryman] 30c46612e03dd759f8e62f92d5f5b0e880f3a6cb - Adding metadat data to codelists-metadata.json
[noreply] a2a2785da01e4297a272d42e5f8d4bb04f9fcd68 - Update codelists-metadata.json
[lperryman] 38454c78864e493cc8b9e456146933f8f746a75f - Adding trig files to output
[lperryman] d4778471823f9ed5dd602707e52556f97b572a94 - Adding trig files to output
[Alex Tucker] 0ecd7ef459fd07b8a337339d04a9d817502f4f4e - Use "landingPage" and "datasetNotes" for finding datasets/distributions.
[noreply] 3f797e6b294d01511a819e1c33d5116d84fe0024 - Update columns.csv
[lperryman] 86ee83e73743f19fa95788b2592a5c9b5c5302d0 - Adding trig files to output
[lperryman] f39704e62b7304dabe87fe5389c78b82fe57c41a - Replaceing empyt Value columns with 0
[lperryman] 267336c9e6821ecc18596392fa88d6986d9cf70f - Replaceing empyt Value columns with 0
[Grace Spitzer-Wong] aaf7c19ca60b42587a6e1a039d0c4fb2cc3d081f - Created codelist for SEN school types
[Grace Spitzer-Wong] 52e7b36436296f4c8eebebfe292d530f66a596d0 - removing spaces
[Alex Tucker] b2662d587b4af754555899f1ac626e0440ca95aa - Adding FRS Age Group dimension and Percentage of People measure for #10
[noreply] b492ad4b862db862312640ab25cc56db4bbe5ca0 - Update columns.csv
[noreply] 37dc236e927d6900104707f0d2876ecf4b5938c2 - Update columns.csv
[noreply] 8ca2458eee5788fe905e21a191a5c8e4f73d7bb6 - Update columns.csv
[noreply] cd212b405f2bc56b3f2fd07701e71c2fd31b6b84 - Update columns.csv
[noreply] 6e6653590b313072368b37b3dbe7caff64d4c091 - Update columns.csv
[noreply] 6f9391a76c71e50bb39aced28805df7c59f36ed6 - Update columns.csv
[noreply] 13659a5c5674e456e204d6fcfc91b109b1fe09bd - Update columns.csv
[Alex Tucker] ae198a177b6726a760e84b9dc3a06cb0d3aadc74 - Check scraper works from landingPage
[Alex Tucker] 4eabf140b4ee6169608b523db24e14f152d41c1d - Check scraper works from landingPage
[lperryman] 3ea3ab539753e3a60a5eca720a500e8128cef7a7 - Code for changing Sec to M, F,T had disappeared
[lperryman] d2dc8b12a011867fd4650a954d186054b5e7769c - Code for changing Sec to M, F,T had disappeared
[lperryman] 9cabfdb37e5528e356cc5a403da469480abdbc95 - Code for changing Sec to M, F,T had disappeared
[lperryman] 8e4ce46562a729ec80a4cec42ce7fd58455fa62c - Changing Sample Size in columns.csv to a measure and a number
[lperryman] 3c6df49054b927e50726c7fe30e63376cf28c106 - Adding a Measure Type column to my datasets
[vtula2000] 9ad5368fa24ae3a5a54cc107c43165ccaf2a23bb - Tidy data
[lperryman] 708323b3b7eb7182cd26611972370c3d8011b697 - Adding a Marker column to dataset and to columns.csv file
[Alex Tucker] 167ac3bd3b6ba3512c4de29282f8b64f0108d551 - Ignore ipynb notebooks, keep the Python instead.
[noreply] 21e12e901a0c5a4ad10aed35887a7b26b00709aa - Update columns.csv
[lperryman] 0e2c6a47031616dd61777f92258850f26495615b - Adding a Marker column to dataset and to columns.csv file
[noreply] aa434283bd91c9d5ad7be9de2965b521fda2541d - Update columns.csv
[noreply] 50b1dfe507de8c180b70d93628ebae6ce2fc46fa - Update columns.csv
[vtula2000] 7718b7c0ee713db5f231d406db7d97cd20ef8ce0 - url update
[noreply] 315ddf8cbcb9cc73b86831887a80606b176dfdde - Add files via upload
[noreply] 41e921f7bb35d0775135ee5ffb5909f6babbde42 - Add files via upload
[noreply] 5b0c145139019d96fb731f2fd297a0fa9b8c86d9 - Update columns.csv
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 937 lines...]
806. too_many_values. Row: 267. Percent
807. format. Row: 268,3. Social/behavioural
808. invalid_number. Row: 268,6. Percentage
809. too_many_values. Row: 268. Percent
810. format. Row: 269,3. Social/behavioural
811. invalid_number. Row: 269,6. Percentage
812. too_many_values. Row: 269. Percent
813. format. Row: 270,3. Other
814. invalid_number. Row: 270,6. Percentage
815. too_many_values. Row: 270. Percent
816. format. Row: 271,3. Other
817. invalid_number. Row: 271,6. Percentage
818. too_many_values. Row: 271. Percent
819. format. Row: 272,3. Other
820. invalid_number. Row: 272,6. Percentage
821. too_many_values. Row: 272. Percent
822. format. Row: 273,3. Other
823. invalid_number. Row: 273,6. Percentage
824. too_many_values. Row: 273. Percent
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 474f78ea44dce0f2a56e76829f00c7535ac5ded7c9edb120df7135ce51a1b9a3
$ docker rm -f 474f78ea44dce0f2a56e76829f00c7535ac5ded7c9edb120df7135ce51a1b9a3
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes No changes No changes
[Alex Tucker] 516eb5ee94da99618bf476c56c3e6517c2482083 - Remove old special case for when out/observations.csv exists.
[Alex Tucker] 6820fef84d1c73bbfb16d07f87259afa096c4cbc - Fix ragged rows. Use DOS line endings as that's what text/* mimetypes should do.
[lperryman] f961b501f993b6801d5d1bbfec841d36350e64a3 - datasets/DWP-Family-Resources-Survey-Carer/main.py had all the wrong formatting for some reason so changed
[lperryman] 22b78bfeee1cd7bcf5833e739f418c8b211490ae - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[lperryman] 1f3e2fec7a6f13c5c0ea02bcf96e77170ac62fd8 - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[mikelovesbooks] 386eaf2559c7547c0ebc252327f160425470eba3 - added temporary manual trig file
[mikelovesbooks] a4e72e6d296eadf60ec9f43ea295284b1617b341 - updated PHE codelists
[mikelovesbooks] 92e9710cf77d6567a2422f330be4da61b8692203 - data from fingertips
[mikelovesbooks] 4dce0948a896af31013ae2554cab5d6a2b918dfe - remove old local data csv
[noreply] cffc20ac58d99cf982d93f417a6b5fc75915d639 - Delete main.ipynb
[noreply] 87ede54c0396e304ac5d372aa71eba0024f0e2d3 - Delete Jenkinsfile
[shannon1995black] be84d9fdec016c03bf7de6c1597c64218621d99a - update naming
[noreply] 928e88d31a7b985e10d265e871871edd92f9aa66 - remove unnecessary time period entry
[lperryman] 4431431355ab317f4d9aa3db8ce695cfb9c130ee - Adding rows to the components csv file
[shannon1995black] b4d0f885f6084447ec8add6ed66d3affc161332d - update main
[lperryman] 037a500fa0ea442f64b9e87949b519ac5c672e43 - Sorting ourt the schema file
[lperryman] d7079738021323d7aba78930006122c17eb2adb9 - Had a capital i one of the column headings when it should have been lower case!
[shannon1995black] 8260ab10b2288609275aa23585d28cc77faff340 - updates
[shannon1995black] 7871ceb8e22f7205829a9ca14da022fa0b86c374 - updated json file
[lperryman] 417d7d297486f1e7780b1ad3d26cfda4a37158f5 - Adding Period to columns.csv
[lperryman] 44e902bc5d106ebfa2eb318e4c64c528c42b5be4 - Getting rid of capital letter in one of the columns
[shannon1995black] af39b43f7fb1c3cbdce95f106bb5c8f81f7e5781 - update column name
[shannon1995black] 3a1135fd0c90a4d0174833f051dd372379ab2c69 - uncomment line to create observations.csv-schema.json
[lperryman] 78c14f03098459533da8df4fb7f970caf2d8f71b - Fixing columns.csv
[lperryman] 74a2b37b464c294dbeb19e5f4e41afdfb39c7ff0 - FIxing columns.csv
[lperryman] cdddeee62af46cccbf93274988364109ffd6e672 - FIxing columns.csv
[lperryman] 632a12b75329e5474b55649a26086f0753e8124a - FIxing columns.csv
[lperryman] 3ce5b581d49b56746c235eb25b055991cc7356da - FIxing columns.csv
[lperryman] bb77f055a6aff4914c2d2652efd5fd1b59149d8a - FIxing columns.csv
[Alex Tucker] 6f1cce14484ed02ddb7103995dd8cdd7c8f33cbe - Output dataset metadata and schema.
[lperryman] da8845089d902d7315ba221997bd3b7e2e087173 - FIxing columns.csv
[shannon1995black] 400c47b3af5219f66d019ca206d93bb598b25ad8 - updated value transformation type
[shannon1995black] b7f3b191dc4995a7ba3e2771a7f2bd00f9879e2d - title to uppercase
[lperryman] 513d057cabaf3c9b6e6297f7ae76f28063793427 - Change Year to period and formatted string to represent for 2 year period
[noreply] 3c54f0603efb9580f0cbd92741e32dda7c7bb283 - Update columns.csv
[lperryman] 30c46612e03dd759f8e62f92d5f5b0e880f3a6cb - Adding metadat data to codelists-metadata.json
[noreply] a2a2785da01e4297a272d42e5f8d4bb04f9fcd68 - Update codelists-metadata.json
[lperryman] 38454c78864e493cc8b9e456146933f8f746a75f - Adding trig files to output
[lperryman] d4778471823f9ed5dd602707e52556f97b572a94 - Adding trig files to output
[Alex Tucker] 0ecd7ef459fd07b8a337339d04a9d817502f4f4e - Use "landingPage" and "datasetNotes" for finding datasets/distributions.
[noreply] 3f797e6b294d01511a819e1c33d5116d84fe0024 - Update columns.csv
[lperryman] 86ee83e73743f19fa95788b2592a5c9b5c5302d0 - Adding trig files to output
[lperryman] f39704e62b7304dabe87fe5389c78b82fe57c41a - Replaceing empyt Value columns with 0
[lperryman] 267336c9e6821ecc18596392fa88d6986d9cf70f - Replaceing empyt Value columns with 0
[Grace Spitzer-Wong] aaf7c19ca60b42587a6e1a039d0c4fb2cc3d081f - Created codelist for SEN school types
[Grace Spitzer-Wong] 52e7b36436296f4c8eebebfe292d530f66a596d0 - removing spaces
[Alex Tucker] b2662d587b4af754555899f1ac626e0440ca95aa - Adding FRS Age Group dimension and Percentage of People measure for #10
[noreply] b492ad4b862db862312640ab25cc56db4bbe5ca0 - Update columns.csv
[noreply] 37dc236e927d6900104707f0d2876ecf4b5938c2 - Update columns.csv
[noreply] 8ca2458eee5788fe905e21a191a5c8e4f73d7bb6 - Update columns.csv
[noreply] cd212b405f2bc56b3f2fd07701e71c2fd31b6b84 - Update columns.csv
[noreply] 6e6653590b313072368b37b3dbe7caff64d4c091 - Update columns.csv
[noreply] 6f9391a76c71e50bb39aced28805df7c59f36ed6 - Update columns.csv
[noreply] 13659a5c5674e456e204d6fcfc91b109b1fe09bd - Update columns.csv
[Alex Tucker] ae198a177b6726a760e84b9dc3a06cb0d3aadc74 - Check scraper works from landingPage
[Alex Tucker] 4eabf140b4ee6169608b523db24e14f152d41c1d - Check scraper works from landingPage
[lperryman] 3ea3ab539753e3a60a5eca720a500e8128cef7a7 - Code for changing Sec to M, F,T had disappeared
[lperryman] d2dc8b12a011867fd4650a954d186054b5e7769c - Code for changing Sec to M, F,T had disappeared
[lperryman] 9cabfdb37e5528e356cc5a403da469480abdbc95 - Code for changing Sec to M, F,T had disappeared
[lperryman] 8e4ce46562a729ec80a4cec42ce7fd58455fa62c - Changing Sample Size in columns.csv to a measure and a number
[lperryman] 3c6df49054b927e50726c7fe30e63376cf28c106 - Adding a Measure Type column to my datasets
[vtula2000] 9ad5368fa24ae3a5a54cc107c43165ccaf2a23bb - Tidy data
[lperryman] 708323b3b7eb7182cd26611972370c3d8011b697 - Adding a Marker column to dataset and to columns.csv file
[Alex Tucker] 167ac3bd3b6ba3512c4de29282f8b64f0108d551 - Ignore ipynb notebooks, keep the Python instead.
[noreply] 21e12e901a0c5a4ad10aed35887a7b26b00709aa - Update columns.csv
[lperryman] 0e2c6a47031616dd61777f92258850f26495615b - Adding a Marker column to dataset and to columns.csv file
[noreply] aa434283bd91c9d5ad7be9de2965b521fda2541d - Update columns.csv
[noreply] 50b1dfe507de8c180b70d93628ebae6ce2fc46fa - Update columns.csv
[vtula2000] 7718b7c0ee713db5f231d406db7d97cd20ef8ce0 - url update
[noreply] 315ddf8cbcb9cc73b86831887a80606b176dfdde - Add files via upload
[noreply] 41e921f7bb35d0775135ee5ffb5909f6babbde42 - Add files via upload
[noreply] 5b0c145139019d96fb731f2fd297a0fa9b8c86d9 - Update columns.csv
[noreply] 3f64f2919b1f30b0b56e1f3fa0b4cf65efcb5dd5 - Update columns.csv
[Alex Tucker] aef10226c53c5e8a5e401a950b5f2c56dba4066c - Add some validation for columns.csv
[lperryman] fdb28502bdb82b76a6f9d6638953c2a56322ce7c - Adding Marker to comnponents.csv file
[lperryman] b9c55f7d948c14b24a649b2a3aa18a523efa5c16 - Adding Marker codelist file
[noreply] fcc1e1e5b7c9e4cfc5fcdb5e6730543977197d8d - Update codelists-metadata.json
[noreply] 14c69f2bb386d89338c4f87512bc43062cf4f9ba - Update main.py
[Grace Spitzer-Wong] a2cec17e509749a9352d326dd5fe7abdb703e2e9 - codelist renamed
[Alex Tucker] 991666338c05dfeae4e8aaa1b33044a03136b8b2 - Cleaned up some (, ), _, - and space chars.
[Alex Tucker] c80bf8f6082cb498f5db45163dedef67ef4d8850 - Removed some double hyphens for compatibility with the way gssutils pathify() turns labels into URL paths.
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 937 lines...]
806. too_many_values. Row: 267. Percent
807. format. Row: 268,3. Social/behavioural
808. invalid_number. Row: 268,6. Percentage
809. too_many_values. Row: 268. Percent
810. format. Row: 269,3. Social/behavioural
811. invalid_number. Row: 269,6. Percentage
812. too_many_values. Row: 269. Percent
813. format. Row: 270,3. Other
814. invalid_number. Row: 270,6. Percentage
815. too_many_values. Row: 270. Percent
816. format. Row: 271,3. Other
817. invalid_number. Row: 271,6. Percentage
818. too_many_values. Row: 271. Percent
819. format. Row: 272,3. Other
820. invalid_number. Row: 272,6. Percentage
821. too_many_values. Row: 272. Percent
822. format. Row: 273,3. Other
823. invalid_number. Row: 273,6. Percentage
824. too_many_values. Row: 273. Percent
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 5fd156bd3f1899b9d8975883e95bbd249d7a3972a85b0c96693c18d6862175cc
$ docker rm -f 5fd156bd3f1899b9d8975883e95bbd249d7a3972a85b0c96693c18d6862175cc
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes No changes No changes
[Alex Tucker] 516eb5ee94da99618bf476c56c3e6517c2482083 - Remove old special case for when out/observations.csv exists.
[Alex Tucker] 6820fef84d1c73bbfb16d07f87259afa096c4cbc - Fix ragged rows. Use DOS line endings as that's what text/* mimetypes should do.
[lperryman] f961b501f993b6801d5d1bbfec841d36350e64a3 - datasets/DWP-Family-Resources-Survey-Carer/main.py had all the wrong formatting for some reason so changed
[lperryman] 22b78bfeee1cd7bcf5833e739f418c8b211490ae - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[lperryman] 1f3e2fec7a6f13c5c0ea02bcf96e77170ac62fd8 - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[mikelovesbooks] 386eaf2559c7547c0ebc252327f160425470eba3 - added temporary manual trig file
[mikelovesbooks] a4e72e6d296eadf60ec9f43ea295284b1617b341 - updated PHE codelists
[mikelovesbooks] 92e9710cf77d6567a2422f330be4da61b8692203 - data from fingertips
[mikelovesbooks] 4dce0948a896af31013ae2554cab5d6a2b918dfe - remove old local data csv
[noreply] cffc20ac58d99cf982d93f417a6b5fc75915d639 - Delete main.ipynb
[noreply] 87ede54c0396e304ac5d372aa71eba0024f0e2d3 - Delete Jenkinsfile
[shannon1995black] be84d9fdec016c03bf7de6c1597c64218621d99a - update naming
[noreply] 928e88d31a7b985e10d265e871871edd92f9aa66 - remove unnecessary time period entry
[lperryman] 4431431355ab317f4d9aa3db8ce695cfb9c130ee - Adding rows to the components csv file
[shannon1995black] b4d0f885f6084447ec8add6ed66d3affc161332d - update main
[lperryman] 037a500fa0ea442f64b9e87949b519ac5c672e43 - Sorting ourt the schema file
[lperryman] d7079738021323d7aba78930006122c17eb2adb9 - Had a capital i one of the column headings when it should have been lower case!
[shannon1995black] 8260ab10b2288609275aa23585d28cc77faff340 - updates
[shannon1995black] 7871ceb8e22f7205829a9ca14da022fa0b86c374 - updated json file
[lperryman] 417d7d297486f1e7780b1ad3d26cfda4a37158f5 - Adding Period to columns.csv
[lperryman] 44e902bc5d106ebfa2eb318e4c64c528c42b5be4 - Getting rid of capital letter in one of the columns
[shannon1995black] af39b43f7fb1c3cbdce95f106bb5c8f81f7e5781 - update column name
[shannon1995black] 3a1135fd0c90a4d0174833f051dd372379ab2c69 - uncomment line to create observations.csv-schema.json
[lperryman] 78c14f03098459533da8df4fb7f970caf2d8f71b - Fixing columns.csv
[lperryman] 74a2b37b464c294dbeb19e5f4e41afdfb39c7ff0 - FIxing columns.csv
[lperryman] cdddeee62af46cccbf93274988364109ffd6e672 - FIxing columns.csv
[lperryman] 632a12b75329e5474b55649a26086f0753e8124a - FIxing columns.csv
[lperryman] 3ce5b581d49b56746c235eb25b055991cc7356da - FIxing columns.csv
[lperryman] bb77f055a6aff4914c2d2652efd5fd1b59149d8a - FIxing columns.csv
[Alex Tucker] 6f1cce14484ed02ddb7103995dd8cdd7c8f33cbe - Output dataset metadata and schema.
[lperryman] da8845089d902d7315ba221997bd3b7e2e087173 - FIxing columns.csv
[shannon1995black] 400c47b3af5219f66d019ca206d93bb598b25ad8 - updated value transformation type
[shannon1995black] b7f3b191dc4995a7ba3e2771a7f2bd00f9879e2d - title to uppercase
[lperryman] 513d057cabaf3c9b6e6297f7ae76f28063793427 - Change Year to period and formatted string to represent for 2 year period
[noreply] 3c54f0603efb9580f0cbd92741e32dda7c7bb283 - Update columns.csv
[lperryman] 30c46612e03dd759f8e62f92d5f5b0e880f3a6cb - Adding metadat data to codelists-metadata.json
[noreply] a2a2785da01e4297a272d42e5f8d4bb04f9fcd68 - Update codelists-metadata.json
[lperryman] 38454c78864e493cc8b9e456146933f8f746a75f - Adding trig files to output
[lperryman] d4778471823f9ed5dd602707e52556f97b572a94 - Adding trig files to output
[Alex Tucker] 0ecd7ef459fd07b8a337339d04a9d817502f4f4e - Use "landingPage" and "datasetNotes" for finding datasets/distributions.
[noreply] 3f797e6b294d01511a819e1c33d5116d84fe0024 - Update columns.csv
[lperryman] 86ee83e73743f19fa95788b2592a5c9b5c5302d0 - Adding trig files to output
[lperryman] f39704e62b7304dabe87fe5389c78b82fe57c41a - Replaceing empyt Value columns with 0
[lperryman] 267336c9e6821ecc18596392fa88d6986d9cf70f - Replaceing empyt Value columns with 0
[Grace Spitzer-Wong] aaf7c19ca60b42587a6e1a039d0c4fb2cc3d081f - Created codelist for SEN school types
[Grace Spitzer-Wong] 52e7b36436296f4c8eebebfe292d530f66a596d0 - removing spaces
[Alex Tucker] b2662d587b4af754555899f1ac626e0440ca95aa - Adding FRS Age Group dimension and Percentage of People measure for #10
[noreply] b492ad4b862db862312640ab25cc56db4bbe5ca0 - Update columns.csv
[noreply] 37dc236e927d6900104707f0d2876ecf4b5938c2 - Update columns.csv
[noreply] 8ca2458eee5788fe905e21a191a5c8e4f73d7bb6 - Update columns.csv
[noreply] cd212b405f2bc56b3f2fd07701e71c2fd31b6b84 - Update columns.csv
[noreply] 6e6653590b313072368b37b3dbe7caff64d4c091 - Update columns.csv
[noreply] 6f9391a76c71e50bb39aced28805df7c59f36ed6 - Update columns.csv
[noreply] 13659a5c5674e456e204d6fcfc91b109b1fe09bd - Update columns.csv
[Alex Tucker] ae198a177b6726a760e84b9dc3a06cb0d3aadc74 - Check scraper works from landingPage
[Alex Tucker] 4eabf140b4ee6169608b523db24e14f152d41c1d - Check scraper works from landingPage
[lperryman] 3ea3ab539753e3a60a5eca720a500e8128cef7a7 - Code for changing Sec to M, F,T had disappeared
[lperryman] d2dc8b12a011867fd4650a954d186054b5e7769c - Code for changing Sec to M, F,T had disappeared
[lperryman] 9cabfdb37e5528e356cc5a403da469480abdbc95 - Code for changing Sec to M, F,T had disappeared
[lperryman] 8e4ce46562a729ec80a4cec42ce7fd58455fa62c - Changing Sample Size in columns.csv to a measure and a number
[lperryman] 3c6df49054b927e50726c7fe30e63376cf28c106 - Adding a Measure Type column to my datasets
[vtula2000] 9ad5368fa24ae3a5a54cc107c43165ccaf2a23bb - Tidy data
[lperryman] 708323b3b7eb7182cd26611972370c3d8011b697 - Adding a Marker column to dataset and to columns.csv file
[Alex Tucker] 167ac3bd3b6ba3512c4de29282f8b64f0108d551 - Ignore ipynb notebooks, keep the Python instead.
[noreply] 21e12e901a0c5a4ad10aed35887a7b26b00709aa - Update columns.csv
[lperryman] 0e2c6a47031616dd61777f92258850f26495615b - Adding a Marker column to dataset and to columns.csv file
[noreply] aa434283bd91c9d5ad7be9de2965b521fda2541d - Update columns.csv
[noreply] 50b1dfe507de8c180b70d93628ebae6ce2fc46fa - Update columns.csv
[vtula2000] 7718b7c0ee713db5f231d406db7d97cd20ef8ce0 - url update
[noreply] 315ddf8cbcb9cc73b86831887a80606b176dfdde - Add files via upload
[noreply] 41e921f7bb35d0775135ee5ffb5909f6babbde42 - Add files via upload
[noreply] 5b0c145139019d96fb731f2fd297a0fa9b8c86d9 - Update columns.csv
[noreply] 3f64f2919b1f30b0b56e1f3fa0b4cf65efcb5dd5 - Update columns.csv
[Alex Tucker] aef10226c53c5e8a5e401a950b5f2c56dba4066c - Add some validation for columns.csv
[lperryman] fdb28502bdb82b76a6f9d6638953c2a56322ce7c - Adding Marker to comnponents.csv file
[lperryman] b9c55f7d948c14b24a649b2a3aa18a523efa5c16 - Adding Marker codelist file
[noreply] fcc1e1e5b7c9e4cfc5fcdb5e6730543977197d8d - Update codelists-metadata.json
[noreply] 14c69f2bb386d89338c4f87512bc43062cf4f9ba - Update main.py
[Grace Spitzer-Wong] a2cec17e509749a9352d326dd5fe7abdb703e2e9 - codelist renamed
[Alex Tucker] 991666338c05dfeae4e8aaa1b33044a03136b8b2 - Cleaned up some (, ), _, - and space chars.
[Alex Tucker] c80bf8f6082cb498f5db45163dedef67ef4d8850 - Removed some double hyphens for compatibility with the way gssutils pathify() turns labels into URL paths.
No changes
[Alex Tucker] 1f3bc6a4192a314eebb538fb3df22f48ab10c488 - Fix csvlints in codelists-metadata.json
[Alex Tucker] c3ed524eefafe973fa79e7e1efcced6d98bd463c - Unix filenames are case sensitive. Make codes consistent with gssutils pathify() function.
[Alex Tucker] 6502a4f6bb75498fe85c4aeb4d0bc9be2479d2df - Ensure CSV files have CRLF line endings.
[Alex Tucker] b943367c13180b1303686d63185390b505ddfae6 - Remove duplicate list. Re-order codelists metadata to check that all the codelists are listed and add any missing.
[Alex Tucker] c5192a273390881515405d7ce7367896cd09000f - Check columns.csv against schema.
[Alex Tucker] e73ae1f8138834830da9923f4f00cb7f3586424b - Add schema for components.csv and update tests.
[Alex Tucker] 6a14b50dbb530df024cb1cb056ad3fef09ce979c - Try putting hard quotes around filename to cope with special shell chars.
[Alex Tucker] efba49cceef190108778c71654b7137627362eaf - Add 'Count' measure type.
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 937 lines...]
806. too_many_values. Row: 267. Percent
807. format. Row: 268,3. Social/behavioural
808. invalid_number. Row: 268,6. Percentage
809. too_many_values. Row: 268. Percent
810. format. Row: 269,3. Social/behavioural
811. invalid_number. Row: 269,6. Percentage
812. too_many_values. Row: 269. Percent
813. format. Row: 270,3. Other
814. invalid_number. Row: 270,6. Percentage
815. too_many_values. Row: 270. Percent
816. format. Row: 271,3. Other
817. invalid_number. Row: 271,6. Percentage
818. too_many_values. Row: 271. Percent
819. format. Row: 272,3. Other
820. invalid_number. Row: 272,6. Percentage
821. too_many_values. Row: 272. Percent
822. format. Row: 273,3. Other
823. invalid_number. Row: 273,6. Percentage
824. too_many_values. Row: 273. Percent
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 dc708e7a9ef2b552ab6f340b838dd3df4b2d02b1dd6fc76a248e8d3517915525
$ docker rm -f dc708e7a9ef2b552ab6f340b838dd3df4b2d02b1dd6fc76a248e8d3517915525
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes No changes No changes
[Alex Tucker] 516eb5ee94da99618bf476c56c3e6517c2482083 - Remove old special case for when out/observations.csv exists.
[Alex Tucker] 6820fef84d1c73bbfb16d07f87259afa096c4cbc - Fix ragged rows. Use DOS line endings as that's what text/* mimetypes should do.
[lperryman] f961b501f993b6801d5d1bbfec841d36350e64a3 - datasets/DWP-Family-Resources-Survey-Carer/main.py had all the wrong formatting for some reason so changed
[lperryman] 22b78bfeee1cd7bcf5833e739f418c8b211490ae - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[lperryman] 1f3e2fec7a6f13c5c0ea02bcf96e77170ac62fd8 - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[mikelovesbooks] 386eaf2559c7547c0ebc252327f160425470eba3 - added temporary manual trig file
[mikelovesbooks] a4e72e6d296eadf60ec9f43ea295284b1617b341 - updated PHE codelists
[mikelovesbooks] 92e9710cf77d6567a2422f330be4da61b8692203 - data from fingertips
[mikelovesbooks] 4dce0948a896af31013ae2554cab5d6a2b918dfe - remove old local data csv
[noreply] cffc20ac58d99cf982d93f417a6b5fc75915d639 - Delete main.ipynb
[noreply] 87ede54c0396e304ac5d372aa71eba0024f0e2d3 - Delete Jenkinsfile
[shannon1995black] be84d9fdec016c03bf7de6c1597c64218621d99a - update naming
[noreply] 928e88d31a7b985e10d265e871871edd92f9aa66 - remove unnecessary time period entry
[lperryman] 4431431355ab317f4d9aa3db8ce695cfb9c130ee - Adding rows to the components csv file
[shannon1995black] b4d0f885f6084447ec8add6ed66d3affc161332d - update main
[lperryman] 037a500fa0ea442f64b9e87949b519ac5c672e43 - Sorting ourt the schema file
[lperryman] d7079738021323d7aba78930006122c17eb2adb9 - Had a capital i one of the column headings when it should have been lower case!
[shannon1995black] 8260ab10b2288609275aa23585d28cc77faff340 - updates
[shannon1995black] 7871ceb8e22f7205829a9ca14da022fa0b86c374 - updated json file
[lperryman] 417d7d297486f1e7780b1ad3d26cfda4a37158f5 - Adding Period to columns.csv
[lperryman] 44e902bc5d106ebfa2eb318e4c64c528c42b5be4 - Getting rid of capital letter in one of the columns
[shannon1995black] af39b43f7fb1c3cbdce95f106bb5c8f81f7e5781 - update column name
[shannon1995black] 3a1135fd0c90a4d0174833f051dd372379ab2c69 - uncomment line to create observations.csv-schema.json
[lperryman] 78c14f03098459533da8df4fb7f970caf2d8f71b - Fixing columns.csv
[lperryman] 74a2b37b464c294dbeb19e5f4e41afdfb39c7ff0 - FIxing columns.csv
[lperryman] cdddeee62af46cccbf93274988364109ffd6e672 - FIxing columns.csv
[lperryman] 632a12b75329e5474b55649a26086f0753e8124a - FIxing columns.csv
[lperryman] 3ce5b581d49b56746c235eb25b055991cc7356da - FIxing columns.csv
[lperryman] bb77f055a6aff4914c2d2652efd5fd1b59149d8a - FIxing columns.csv
[Alex Tucker] 6f1cce14484ed02ddb7103995dd8cdd7c8f33cbe - Output dataset metadata and schema.
[lperryman] da8845089d902d7315ba221997bd3b7e2e087173 - FIxing columns.csv
[shannon1995black] 400c47b3af5219f66d019ca206d93bb598b25ad8 - updated value transformation type
[shannon1995black] b7f3b191dc4995a7ba3e2771a7f2bd00f9879e2d - title to uppercase
[lperryman] 513d057cabaf3c9b6e6297f7ae76f28063793427 - Change Year to period and formatted string to represent for 2 year period
[noreply] 3c54f0603efb9580f0cbd92741e32dda7c7bb283 - Update columns.csv
[lperryman] 30c46612e03dd759f8e62f92d5f5b0e880f3a6cb - Adding metadat data to codelists-metadata.json
[noreply] a2a2785da01e4297a272d42e5f8d4bb04f9fcd68 - Update codelists-metadata.json
[lperryman] 38454c78864e493cc8b9e456146933f8f746a75f - Adding trig files to output
[lperryman] d4778471823f9ed5dd602707e52556f97b572a94 - Adding trig files to output
[Alex Tucker] 0ecd7ef459fd07b8a337339d04a9d817502f4f4e - Use "landingPage" and "datasetNotes" for finding datasets/distributions.
[noreply] 3f797e6b294d01511a819e1c33d5116d84fe0024 - Update columns.csv
[lperryman] 86ee83e73743f19fa95788b2592a5c9b5c5302d0 - Adding trig files to output
[lperryman] f39704e62b7304dabe87fe5389c78b82fe57c41a - Replaceing empyt Value columns with 0
[lperryman] 267336c9e6821ecc18596392fa88d6986d9cf70f - Replaceing empyt Value columns with 0
[Grace Spitzer-Wong] aaf7c19ca60b42587a6e1a039d0c4fb2cc3d081f - Created codelist for SEN school types
[Grace Spitzer-Wong] 52e7b36436296f4c8eebebfe292d530f66a596d0 - removing spaces
[Alex Tucker] b2662d587b4af754555899f1ac626e0440ca95aa - Adding FRS Age Group dimension and Percentage of People measure for #10
[noreply] b492ad4b862db862312640ab25cc56db4bbe5ca0 - Update columns.csv
[noreply] 37dc236e927d6900104707f0d2876ecf4b5938c2 - Update columns.csv
[noreply] 8ca2458eee5788fe905e21a191a5c8e4f73d7bb6 - Update columns.csv
[noreply] cd212b405f2bc56b3f2fd07701e71c2fd31b6b84 - Update columns.csv
[noreply] 6e6653590b313072368b37b3dbe7caff64d4c091 - Update columns.csv
[noreply] 6f9391a76c71e50bb39aced28805df7c59f36ed6 - Update columns.csv
[noreply] 13659a5c5674e456e204d6fcfc91b109b1fe09bd - Update columns.csv
[Alex Tucker] ae198a177b6726a760e84b9dc3a06cb0d3aadc74 - Check scraper works from landingPage
[Alex Tucker] 4eabf140b4ee6169608b523db24e14f152d41c1d - Check scraper works from landingPage
[lperryman] 3ea3ab539753e3a60a5eca720a500e8128cef7a7 - Code for changing Sec to M, F,T had disappeared
[lperryman] d2dc8b12a011867fd4650a954d186054b5e7769c - Code for changing Sec to M, F,T had disappeared
[lperryman] 9cabfdb37e5528e356cc5a403da469480abdbc95 - Code for changing Sec to M, F,T had disappeared
[lperryman] 8e4ce46562a729ec80a4cec42ce7fd58455fa62c - Changing Sample Size in columns.csv to a measure and a number
[lperryman] 3c6df49054b927e50726c7fe30e63376cf28c106 - Adding a Measure Type column to my datasets
[vtula2000] 9ad5368fa24ae3a5a54cc107c43165ccaf2a23bb - Tidy data
[lperryman] 708323b3b7eb7182cd26611972370c3d8011b697 - Adding a Marker column to dataset and to columns.csv file
[Alex Tucker] 167ac3bd3b6ba3512c4de29282f8b64f0108d551 - Ignore ipynb notebooks, keep the Python instead.
[noreply] 21e12e901a0c5a4ad10aed35887a7b26b00709aa - Update columns.csv
[lperryman] 0e2c6a47031616dd61777f92258850f26495615b - Adding a Marker column to dataset and to columns.csv file
[noreply] aa434283bd91c9d5ad7be9de2965b521fda2541d - Update columns.csv
[noreply] 50b1dfe507de8c180b70d93628ebae6ce2fc46fa - Update columns.csv
[vtula2000] 7718b7c0ee713db5f231d406db7d97cd20ef8ce0 - url update
[noreply] 315ddf8cbcb9cc73b86831887a80606b176dfdde - Add files via upload
[noreply] 41e921f7bb35d0775135ee5ffb5909f6babbde42 - Add files via upload
[noreply] 5b0c145139019d96fb731f2fd297a0fa9b8c86d9 - Update columns.csv
[noreply] 3f64f2919b1f30b0b56e1f3fa0b4cf65efcb5dd5 - Update columns.csv
[Alex Tucker] aef10226c53c5e8a5e401a950b5f2c56dba4066c - Add some validation for columns.csv
[lperryman] fdb28502bdb82b76a6f9d6638953c2a56322ce7c - Adding Marker to comnponents.csv file
[lperryman] b9c55f7d948c14b24a649b2a3aa18a523efa5c16 - Adding Marker codelist file
[noreply] fcc1e1e5b7c9e4cfc5fcdb5e6730543977197d8d - Update codelists-metadata.json
[noreply] 14c69f2bb386d89338c4f87512bc43062cf4f9ba - Update main.py
[Grace Spitzer-Wong] a2cec17e509749a9352d326dd5fe7abdb703e2e9 - codelist renamed
[Alex Tucker] 991666338c05dfeae4e8aaa1b33044a03136b8b2 - Cleaned up some (, ), _, - and space chars.
[Alex Tucker] c80bf8f6082cb498f5db45163dedef67ef4d8850 - Removed some double hyphens for compatibility with the way gssutils pathify() turns labels into URL paths.
No changes
[Alex Tucker] 1f3bc6a4192a314eebb538fb3df22f48ab10c488 - Fix csvlints in codelists-metadata.json
[Alex Tucker] c3ed524eefafe973fa79e7e1efcced6d98bd463c - Unix filenames are case sensitive. Make codes consistent with gssutils pathify() function.
[Alex Tucker] 6502a4f6bb75498fe85c4aeb4d0bc9be2479d2df - Ensure CSV files have CRLF line endings.
[Alex Tucker] b943367c13180b1303686d63185390b505ddfae6 - Remove duplicate list. Re-order codelists metadata to check that all the codelists are listed and add any missing.
[Alex Tucker] c5192a273390881515405d7ce7367896cd09000f - Check columns.csv against schema.
[Alex Tucker] e73ae1f8138834830da9923f4f00cb7f3586424b - Add schema for components.csv and update tests.
[Alex Tucker] 6a14b50dbb530df024cb1cb056ad3fef09ce979c - Try putting hard quotes around filename to cope with special shell chars.
[Alex Tucker] efba49cceef190108778c71654b7137627362eaf - Add 'Count' measure type.
[noreply] 250cc46bdc95c5fc5affa612c3ca1c3042f579da - Update columns.csv
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 937 lines...]
806. too_many_values. Row: 267. Percent
807. format. Row: 268,3. Social/behavioural
808. invalid_number. Row: 268,6. Percentage
809. too_many_values. Row: 268. Percent
810. format. Row: 269,3. Social/behavioural
811. invalid_number. Row: 269,6. Percentage
812. too_many_values. Row: 269. Percent
813. format. Row: 270,3. Other
814. invalid_number. Row: 270,6. Percentage
815. too_many_values. Row: 270. Percent
816. format. Row: 271,3. Other
817. invalid_number. Row: 271,6. Percentage
818. too_many_values. Row: 271. Percent
819. format. Row: 272,3. Other
820. invalid_number. Row: 272,6. Percentage
821. too_many_values. Row: 272. Percent
822. format. Row: 273,3. Other
823. invalid_number. Row: 273,6. Percentage
824. too_many_values. Row: 273. Percent
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 2bf3fc0d16ed06a6deb877c0b48e951e95782fd26aeaa721f0d3e51c03a6f2f7
$ docker rm -f 2bf3fc0d16ed06a6deb877c0b48e951e95782fd26aeaa721f0d3e51c03a6f2f7
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes No changes No changes
[Alex Tucker] 516eb5ee94da99618bf476c56c3e6517c2482083 - Remove old special case for when out/observations.csv exists.
[Alex Tucker] 6820fef84d1c73bbfb16d07f87259afa096c4cbc - Fix ragged rows. Use DOS line endings as that's what text/* mimetypes should do.
[lperryman] f961b501f993b6801d5d1bbfec841d36350e64a3 - datasets/DWP-Family-Resources-Survey-Carer/main.py had all the wrong formatting for some reason so changed
[lperryman] 22b78bfeee1cd7bcf5833e739f418c8b211490ae - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[lperryman] 1f3e2fec7a6f13c5c0ea02bcf96e77170ac62fd8 - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[mikelovesbooks] 386eaf2559c7547c0ebc252327f160425470eba3 - added temporary manual trig file
[mikelovesbooks] a4e72e6d296eadf60ec9f43ea295284b1617b341 - updated PHE codelists
[mikelovesbooks] 92e9710cf77d6567a2422f330be4da61b8692203 - data from fingertips
[mikelovesbooks] 4dce0948a896af31013ae2554cab5d6a2b918dfe - remove old local data csv
[noreply] cffc20ac58d99cf982d93f417a6b5fc75915d639 - Delete main.ipynb
[noreply] 87ede54c0396e304ac5d372aa71eba0024f0e2d3 - Delete Jenkinsfile
[shannon1995black] be84d9fdec016c03bf7de6c1597c64218621d99a - update naming
[noreply] 928e88d31a7b985e10d265e871871edd92f9aa66 - remove unnecessary time period entry
[lperryman] 4431431355ab317f4d9aa3db8ce695cfb9c130ee - Adding rows to the components csv file
[shannon1995black] b4d0f885f6084447ec8add6ed66d3affc161332d - update main
[lperryman] 037a500fa0ea442f64b9e87949b519ac5c672e43 - Sorting ourt the schema file
[lperryman] d7079738021323d7aba78930006122c17eb2adb9 - Had a capital i one of the column headings when it should have been lower case!
[shannon1995black] 8260ab10b2288609275aa23585d28cc77faff340 - updates
[shannon1995black] 7871ceb8e22f7205829a9ca14da022fa0b86c374 - updated json file
[lperryman] 417d7d297486f1e7780b1ad3d26cfda4a37158f5 - Adding Period to columns.csv
[lperryman] 44e902bc5d106ebfa2eb318e4c64c528c42b5be4 - Getting rid of capital letter in one of the columns
[shannon1995black] af39b43f7fb1c3cbdce95f106bb5c8f81f7e5781 - update column name
[shannon1995black] 3a1135fd0c90a4d0174833f051dd372379ab2c69 - uncomment line to create observations.csv-schema.json
[lperryman] 78c14f03098459533da8df4fb7f970caf2d8f71b - Fixing columns.csv
[lperryman] 74a2b37b464c294dbeb19e5f4e41afdfb39c7ff0 - FIxing columns.csv
[lperryman] cdddeee62af46cccbf93274988364109ffd6e672 - FIxing columns.csv
[lperryman] 632a12b75329e5474b55649a26086f0753e8124a - FIxing columns.csv
[lperryman] 3ce5b581d49b56746c235eb25b055991cc7356da - FIxing columns.csv
[lperryman] bb77f055a6aff4914c2d2652efd5fd1b59149d8a - FIxing columns.csv
[Alex Tucker] 6f1cce14484ed02ddb7103995dd8cdd7c8f33cbe - Output dataset metadata and schema.
[lperryman] da8845089d902d7315ba221997bd3b7e2e087173 - FIxing columns.csv
[shannon1995black] 400c47b3af5219f66d019ca206d93bb598b25ad8 - updated value transformation type
[shannon1995black] b7f3b191dc4995a7ba3e2771a7f2bd00f9879e2d - title to uppercase
[lperryman] 513d057cabaf3c9b6e6297f7ae76f28063793427 - Change Year to period and formatted string to represent for 2 year period
[noreply] 3c54f0603efb9580f0cbd92741e32dda7c7bb283 - Update columns.csv
[lperryman] 30c46612e03dd759f8e62f92d5f5b0e880f3a6cb - Adding metadat data to codelists-metadata.json
[noreply] a2a2785da01e4297a272d42e5f8d4bb04f9fcd68 - Update codelists-metadata.json
[lperryman] 38454c78864e493cc8b9e456146933f8f746a75f - Adding trig files to output
[lperryman] d4778471823f9ed5dd602707e52556f97b572a94 - Adding trig files to output
[Alex Tucker] 0ecd7ef459fd07b8a337339d04a9d817502f4f4e - Use "landingPage" and "datasetNotes" for finding datasets/distributions.
[noreply] 3f797e6b294d01511a819e1c33d5116d84fe0024 - Update columns.csv
[lperryman] 86ee83e73743f19fa95788b2592a5c9b5c5302d0 - Adding trig files to output
[lperryman] f39704e62b7304dabe87fe5389c78b82fe57c41a - Replaceing empyt Value columns with 0
[lperryman] 267336c9e6821ecc18596392fa88d6986d9cf70f - Replaceing empyt Value columns with 0
[Grace Spitzer-Wong] aaf7c19ca60b42587a6e1a039d0c4fb2cc3d081f - Created codelist for SEN school types
[Grace Spitzer-Wong] 52e7b36436296f4c8eebebfe292d530f66a596d0 - removing spaces
[Alex Tucker] b2662d587b4af754555899f1ac626e0440ca95aa - Adding FRS Age Group dimension and Percentage of People measure for #10
[noreply] b492ad4b862db862312640ab25cc56db4bbe5ca0 - Update columns.csv
[noreply] 37dc236e927d6900104707f0d2876ecf4b5938c2 - Update columns.csv
[noreply] 8ca2458eee5788fe905e21a191a5c8e4f73d7bb6 - Update columns.csv
[noreply] cd212b405f2bc56b3f2fd07701e71c2fd31b6b84 - Update columns.csv
[noreply] 6e6653590b313072368b37b3dbe7caff64d4c091 - Update columns.csv
[noreply] 6f9391a76c71e50bb39aced28805df7c59f36ed6 - Update columns.csv
[noreply] 13659a5c5674e456e204d6fcfc91b109b1fe09bd - Update columns.csv
[Alex Tucker] ae198a177b6726a760e84b9dc3a06cb0d3aadc74 - Check scraper works from landingPage
[Alex Tucker] 4eabf140b4ee6169608b523db24e14f152d41c1d - Check scraper works from landingPage
[lperryman] 3ea3ab539753e3a60a5eca720a500e8128cef7a7 - Code for changing Sec to M, F,T had disappeared
[lperryman] d2dc8b12a011867fd4650a954d186054b5e7769c - Code for changing Sec to M, F,T had disappeared
[lperryman] 9cabfdb37e5528e356cc5a403da469480abdbc95 - Code for changing Sec to M, F,T had disappeared
[lperryman] 8e4ce46562a729ec80a4cec42ce7fd58455fa62c - Changing Sample Size in columns.csv to a measure and a number
[lperryman] 3c6df49054b927e50726c7fe30e63376cf28c106 - Adding a Measure Type column to my datasets
[vtula2000] 9ad5368fa24ae3a5a54cc107c43165ccaf2a23bb - Tidy data
[lperryman] 708323b3b7eb7182cd26611972370c3d8011b697 - Adding a Marker column to dataset and to columns.csv file
[Alex Tucker] 167ac3bd3b6ba3512c4de29282f8b64f0108d551 - Ignore ipynb notebooks, keep the Python instead.
[noreply] 21e12e901a0c5a4ad10aed35887a7b26b00709aa - Update columns.csv
[lperryman] 0e2c6a47031616dd61777f92258850f26495615b - Adding a Marker column to dataset and to columns.csv file
[noreply] aa434283bd91c9d5ad7be9de2965b521fda2541d - Update columns.csv
[noreply] 50b1dfe507de8c180b70d93628ebae6ce2fc46fa - Update columns.csv
[vtula2000] 7718b7c0ee713db5f231d406db7d97cd20ef8ce0 - url update
[noreply] 315ddf8cbcb9cc73b86831887a80606b176dfdde - Add files via upload
[noreply] 41e921f7bb35d0775135ee5ffb5909f6babbde42 - Add files via upload
[noreply] 5b0c145139019d96fb731f2fd297a0fa9b8c86d9 - Update columns.csv
[noreply] 3f64f2919b1f30b0b56e1f3fa0b4cf65efcb5dd5 - Update columns.csv
[Alex Tucker] aef10226c53c5e8a5e401a950b5f2c56dba4066c - Add some validation for columns.csv
[lperryman] fdb28502bdb82b76a6f9d6638953c2a56322ce7c - Adding Marker to comnponents.csv file
[lperryman] b9c55f7d948c14b24a649b2a3aa18a523efa5c16 - Adding Marker codelist file
[noreply] fcc1e1e5b7c9e4cfc5fcdb5e6730543977197d8d - Update codelists-metadata.json
[noreply] 14c69f2bb386d89338c4f87512bc43062cf4f9ba - Update main.py
[Grace Spitzer-Wong] a2cec17e509749a9352d326dd5fe7abdb703e2e9 - codelist renamed
[Alex Tucker] 991666338c05dfeae4e8aaa1b33044a03136b8b2 - Cleaned up some (, ), _, - and space chars.
[Alex Tucker] c80bf8f6082cb498f5db45163dedef67ef4d8850 - Removed some double hyphens for compatibility with the way gssutils pathify() turns labels into URL paths.
No changes
[Alex Tucker] 1f3bc6a4192a314eebb538fb3df22f48ab10c488 - Fix csvlints in codelists-metadata.json
[Alex Tucker] c3ed524eefafe973fa79e7e1efcced6d98bd463c - Unix filenames are case sensitive. Make codes consistent with gssutils pathify() function.
[Alex Tucker] 6502a4f6bb75498fe85c4aeb4d0bc9be2479d2df - Ensure CSV files have CRLF line endings.
[Alex Tucker] b943367c13180b1303686d63185390b505ddfae6 - Remove duplicate list. Re-order codelists metadata to check that all the codelists are listed and add any missing.
[Alex Tucker] c5192a273390881515405d7ce7367896cd09000f - Check columns.csv against schema.
[Alex Tucker] e73ae1f8138834830da9923f4f00cb7f3586424b - Add schema for components.csv and update tests.
[Alex Tucker] 6a14b50dbb530df024cb1cb056ad3fef09ce979c - Try putting hard quotes around filename to cope with special shell chars.
[Alex Tucker] efba49cceef190108778c71654b7137627362eaf - Add 'Count' measure type.
[noreply] 250cc46bdc95c5fc5affa612c3ca1c3042f579da - Update columns.csv
[lperryman] f7b973736f5aa1149844059185b2052425df292b - Removing spaces in column Measure Type
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 935 lines...]
806. too_many_values. Row: 267. Percent
807. format. Row: 268,3. Social/behavioural
808. invalid_number. Row: 268,6. Percentage
809. too_many_values. Row: 268. Percent
810. format. Row: 269,3. Social/behavioural
811. invalid_number. Row: 269,6. Percentage
812. too_many_values. Row: 269. Percent
813. format. Row: 270,3. Other
814. invalid_number. Row: 270,6. Percentage
815. too_many_values. Row: 270. Percent
816. format. Row: 271,3. Other
817. invalid_number. Row: 271,6. Percentage
818. too_many_values. Row: 271. Percent
819. format. Row: 272,3. Other
820. invalid_number. Row: 272,6. Percentage
821. too_many_values. Row: 272. Percent
822. format. Row: 273,3. Other
823. invalid_number. Row: 273,6. Percentage
824. too_many_values. Row: 273. Percent
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 70be0a496de2f16216e7aa0c103dff58d1f63f4f8bb2c577058a7ebff292bb82
$ docker rm -f 70be0a496de2f16216e7aa0c103dff58d1f63f4f8bb2c577058a7ebff292bb82
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes No changes No changes
[Alex Tucker] 516eb5ee94da99618bf476c56c3e6517c2482083 - Remove old special case for when out/observations.csv exists.
[Alex Tucker] 6820fef84d1c73bbfb16d07f87259afa096c4cbc - Fix ragged rows. Use DOS line endings as that's what text/* mimetypes should do.
[lperryman] f961b501f993b6801d5d1bbfec841d36350e64a3 - datasets/DWP-Family-Resources-Survey-Carer/main.py had all the wrong formatting for some reason so changed
[lperryman] 22b78bfeee1cd7bcf5833e739f418c8b211490ae - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[lperryman] 1f3e2fec7a6f13c5c0ea02bcf96e77170ac62fd8 - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[mikelovesbooks] 386eaf2559c7547c0ebc252327f160425470eba3 - added temporary manual trig file
[mikelovesbooks] a4e72e6d296eadf60ec9f43ea295284b1617b341 - updated PHE codelists
[mikelovesbooks] 92e9710cf77d6567a2422f330be4da61b8692203 - data from fingertips
[mikelovesbooks] 4dce0948a896af31013ae2554cab5d6a2b918dfe - remove old local data csv
[noreply] cffc20ac58d99cf982d93f417a6b5fc75915d639 - Delete main.ipynb
[noreply] 87ede54c0396e304ac5d372aa71eba0024f0e2d3 - Delete Jenkinsfile
[shannon1995black] be84d9fdec016c03bf7de6c1597c64218621d99a - update naming
[noreply] 928e88d31a7b985e10d265e871871edd92f9aa66 - remove unnecessary time period entry
[lperryman] 4431431355ab317f4d9aa3db8ce695cfb9c130ee - Adding rows to the components csv file
[shannon1995black] b4d0f885f6084447ec8add6ed66d3affc161332d - update main
[lperryman] 037a500fa0ea442f64b9e87949b519ac5c672e43 - Sorting ourt the schema file
[lperryman] d7079738021323d7aba78930006122c17eb2adb9 - Had a capital i one of the column headings when it should have been lower case!
[shannon1995black] 8260ab10b2288609275aa23585d28cc77faff340 - updates
[shannon1995black] 7871ceb8e22f7205829a9ca14da022fa0b86c374 - updated json file
[lperryman] 417d7d297486f1e7780b1ad3d26cfda4a37158f5 - Adding Period to columns.csv
[lperryman] 44e902bc5d106ebfa2eb318e4c64c528c42b5be4 - Getting rid of capital letter in one of the columns
[shannon1995black] af39b43f7fb1c3cbdce95f106bb5c8f81f7e5781 - update column name
[shannon1995black] 3a1135fd0c90a4d0174833f051dd372379ab2c69 - uncomment line to create observations.csv-schema.json
[lperryman] 78c14f03098459533da8df4fb7f970caf2d8f71b - Fixing columns.csv
[lperryman] 74a2b37b464c294dbeb19e5f4e41afdfb39c7ff0 - FIxing columns.csv
[lperryman] cdddeee62af46cccbf93274988364109ffd6e672 - FIxing columns.csv
[lperryman] 632a12b75329e5474b55649a26086f0753e8124a - FIxing columns.csv
[lperryman] 3ce5b581d49b56746c235eb25b055991cc7356da - FIxing columns.csv
[lperryman] bb77f055a6aff4914c2d2652efd5fd1b59149d8a - FIxing columns.csv
[Alex Tucker] 6f1cce14484ed02ddb7103995dd8cdd7c8f33cbe - Output dataset metadata and schema.
[lperryman] da8845089d902d7315ba221997bd3b7e2e087173 - FIxing columns.csv
[shannon1995black] 400c47b3af5219f66d019ca206d93bb598b25ad8 - updated value transformation type
[shannon1995black] b7f3b191dc4995a7ba3e2771a7f2bd00f9879e2d - title to uppercase
[lperryman] 513d057cabaf3c9b6e6297f7ae76f28063793427 - Change Year to period and formatted string to represent for 2 year period
[noreply] 3c54f0603efb9580f0cbd92741e32dda7c7bb283 - Update columns.csv
[lperryman] 30c46612e03dd759f8e62f92d5f5b0e880f3a6cb - Adding metadat data to codelists-metadata.json
[noreply] a2a2785da01e4297a272d42e5f8d4bb04f9fcd68 - Update codelists-metadata.json
[lperryman] 38454c78864e493cc8b9e456146933f8f746a75f - Adding trig files to output
[lperryman] d4778471823f9ed5dd602707e52556f97b572a94 - Adding trig files to output
[Alex Tucker] 0ecd7ef459fd07b8a337339d04a9d817502f4f4e - Use "landingPage" and "datasetNotes" for finding datasets/distributions.
[noreply] 3f797e6b294d01511a819e1c33d5116d84fe0024 - Update columns.csv
[lperryman] 86ee83e73743f19fa95788b2592a5c9b5c5302d0 - Adding trig files to output
[lperryman] f39704e62b7304dabe87fe5389c78b82fe57c41a - Replaceing empyt Value columns with 0
[lperryman] 267336c9e6821ecc18596392fa88d6986d9cf70f - Replaceing empyt Value columns with 0
[Grace Spitzer-Wong] aaf7c19ca60b42587a6e1a039d0c4fb2cc3d081f - Created codelist for SEN school types
[Grace Spitzer-Wong] 52e7b36436296f4c8eebebfe292d530f66a596d0 - removing spaces
[Alex Tucker] b2662d587b4af754555899f1ac626e0440ca95aa - Adding FRS Age Group dimension and Percentage of People measure for #10
[noreply] b492ad4b862db862312640ab25cc56db4bbe5ca0 - Update columns.csv
[noreply] 37dc236e927d6900104707f0d2876ecf4b5938c2 - Update columns.csv
[noreply] 8ca2458eee5788fe905e21a191a5c8e4f73d7bb6 - Update columns.csv
[noreply] cd212b405f2bc56b3f2fd07701e71c2fd31b6b84 - Update columns.csv
[noreply] 6e6653590b313072368b37b3dbe7caff64d4c091 - Update columns.csv
[noreply] 6f9391a76c71e50bb39aced28805df7c59f36ed6 - Update columns.csv
[noreply] 13659a5c5674e456e204d6fcfc91b109b1fe09bd - Update columns.csv
[Alex Tucker] ae198a177b6726a760e84b9dc3a06cb0d3aadc74 - Check scraper works from landingPage
[Alex Tucker] 4eabf140b4ee6169608b523db24e14f152d41c1d - Check scraper works from landingPage
[lperryman] 3ea3ab539753e3a60a5eca720a500e8128cef7a7 - Code for changing Sec to M, F,T had disappeared
[lperryman] d2dc8b12a011867fd4650a954d186054b5e7769c - Code for changing Sec to M, F,T had disappeared
[lperryman] 9cabfdb37e5528e356cc5a403da469480abdbc95 - Code for changing Sec to M, F,T had disappeared
[lperryman] 8e4ce46562a729ec80a4cec42ce7fd58455fa62c - Changing Sample Size in columns.csv to a measure and a number
[lperryman] 3c6df49054b927e50726c7fe30e63376cf28c106 - Adding a Measure Type column to my datasets
[vtula2000] 9ad5368fa24ae3a5a54cc107c43165ccaf2a23bb - Tidy data
[lperryman] 708323b3b7eb7182cd26611972370c3d8011b697 - Adding a Marker column to dataset and to columns.csv file
[Alex Tucker] 167ac3bd3b6ba3512c4de29282f8b64f0108d551 - Ignore ipynb notebooks, keep the Python instead.
[noreply] 21e12e901a0c5a4ad10aed35887a7b26b00709aa - Update columns.csv
[lperryman] 0e2c6a47031616dd61777f92258850f26495615b - Adding a Marker column to dataset and to columns.csv file
[noreply] aa434283bd91c9d5ad7be9de2965b521fda2541d - Update columns.csv
[noreply] 50b1dfe507de8c180b70d93628ebae6ce2fc46fa - Update columns.csv
[vtula2000] 7718b7c0ee713db5f231d406db7d97cd20ef8ce0 - url update
[noreply] 315ddf8cbcb9cc73b86831887a80606b176dfdde - Add files via upload
[noreply] 41e921f7bb35d0775135ee5ffb5909f6babbde42 - Add files via upload
[noreply] 5b0c145139019d96fb731f2fd297a0fa9b8c86d9 - Update columns.csv
[noreply] 3f64f2919b1f30b0b56e1f3fa0b4cf65efcb5dd5 - Update columns.csv
[Alex Tucker] aef10226c53c5e8a5e401a950b5f2c56dba4066c - Add some validation for columns.csv
[lperryman] fdb28502bdb82b76a6f9d6638953c2a56322ce7c - Adding Marker to comnponents.csv file
[lperryman] b9c55f7d948c14b24a649b2a3aa18a523efa5c16 - Adding Marker codelist file
[noreply] fcc1e1e5b7c9e4cfc5fcdb5e6730543977197d8d - Update codelists-metadata.json
[noreply] 14c69f2bb386d89338c4f87512bc43062cf4f9ba - Update main.py
[Grace Spitzer-Wong] a2cec17e509749a9352d326dd5fe7abdb703e2e9 - codelist renamed
[Alex Tucker] 991666338c05dfeae4e8aaa1b33044a03136b8b2 - Cleaned up some (, ), _, - and space chars.
[Alex Tucker] c80bf8f6082cb498f5db45163dedef67ef4d8850 - Removed some double hyphens for compatibility with the way gssutils pathify() turns labels into URL paths.
No changes
[Alex Tucker] 1f3bc6a4192a314eebb538fb3df22f48ab10c488 - Fix csvlints in codelists-metadata.json
[Alex Tucker] c3ed524eefafe973fa79e7e1efcced6d98bd463c - Unix filenames are case sensitive. Make codes consistent with gssutils pathify() function.
[Alex Tucker] 6502a4f6bb75498fe85c4aeb4d0bc9be2479d2df - Ensure CSV files have CRLF line endings.
[Alex Tucker] b943367c13180b1303686d63185390b505ddfae6 - Remove duplicate list. Re-order codelists metadata to check that all the codelists are listed and add any missing.
[Alex Tucker] c5192a273390881515405d7ce7367896cd09000f - Check columns.csv against schema.
[Alex Tucker] e73ae1f8138834830da9923f4f00cb7f3586424b - Add schema for components.csv and update tests.
[Alex Tucker] 6a14b50dbb530df024cb1cb056ad3fef09ce979c - Try putting hard quotes around filename to cope with special shell chars.
[Alex Tucker] efba49cceef190108778c71654b7137627362eaf - Add 'Count' measure type.
[noreply] 250cc46bdc95c5fc5affa612c3ca1c3042f579da - Update columns.csv
[lperryman] f7b973736f5aa1149844059185b2052425df292b - Removing spaces in column Measure Type
[noreply] 9e759c863fa0d8fa1ba058c4cdbb599bc0b4f47e - Update codelists-metadata.json
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 937 lines...]
806. too_many_values. Row: 267. Percent
807. format. Row: 268,3. Social/behavioural
808. invalid_number. Row: 268,6. Percentage
809. too_many_values. Row: 268. Percent
810. format. Row: 269,3. Social/behavioural
811. invalid_number. Row: 269,6. Percentage
812. too_many_values. Row: 269. Percent
813. format. Row: 270,3. Other
814. invalid_number. Row: 270,6. Percentage
815. too_many_values. Row: 270. Percent
816. format. Row: 271,3. Other
817. invalid_number. Row: 271,6. Percentage
818. too_many_values. Row: 271. Percent
819. format. Row: 272,3. Other
820. invalid_number. Row: 272,6. Percentage
821. too_many_values. Row: 272. Percent
822. format. Row: 273,3. Other
823. invalid_number. Row: 273,6. Percentage
824. too_many_values. Row: 273. Percent
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 10347689bccdc1fa668100f7a24b18e12ef36d270d40b0d0ae3ebae562db76c8
$ docker rm -f 10347689bccdc1fa668100f7a24b18e12ef36d270d40b0d0ae3ebae562db76c8
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes No changes No changes
[Alex Tucker] 516eb5ee94da99618bf476c56c3e6517c2482083 - Remove old special case for when out/observations.csv exists.
[Alex Tucker] 6820fef84d1c73bbfb16d07f87259afa096c4cbc - Fix ragged rows. Use DOS line endings as that's what text/* mimetypes should do.
[lperryman] f961b501f993b6801d5d1bbfec841d36350e64a3 - datasets/DWP-Family-Resources-Survey-Carer/main.py had all the wrong formatting for some reason so changed
[lperryman] 22b78bfeee1cd7bcf5833e739f418c8b211490ae - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[lperryman] 1f3e2fec7a6f13c5c0ea02bcf96e77170ac62fd8 - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[mikelovesbooks] 386eaf2559c7547c0ebc252327f160425470eba3 - added temporary manual trig file
[mikelovesbooks] a4e72e6d296eadf60ec9f43ea295284b1617b341 - updated PHE codelists
[mikelovesbooks] 92e9710cf77d6567a2422f330be4da61b8692203 - data from fingertips
[mikelovesbooks] 4dce0948a896af31013ae2554cab5d6a2b918dfe - remove old local data csv
[noreply] cffc20ac58d99cf982d93f417a6b5fc75915d639 - Delete main.ipynb
[noreply] 87ede54c0396e304ac5d372aa71eba0024f0e2d3 - Delete Jenkinsfile
[shannon1995black] be84d9fdec016c03bf7de6c1597c64218621d99a - update naming
[noreply] 928e88d31a7b985e10d265e871871edd92f9aa66 - remove unnecessary time period entry
[lperryman] 4431431355ab317f4d9aa3db8ce695cfb9c130ee - Adding rows to the components csv file
[shannon1995black] b4d0f885f6084447ec8add6ed66d3affc161332d - update main
[lperryman] 037a500fa0ea442f64b9e87949b519ac5c672e43 - Sorting ourt the schema file
[lperryman] d7079738021323d7aba78930006122c17eb2adb9 - Had a capital i one of the column headings when it should have been lower case!
[shannon1995black] 8260ab10b2288609275aa23585d28cc77faff340 - updates
[shannon1995black] 7871ceb8e22f7205829a9ca14da022fa0b86c374 - updated json file
[lperryman] 417d7d297486f1e7780b1ad3d26cfda4a37158f5 - Adding Period to columns.csv
[lperryman] 44e902bc5d106ebfa2eb318e4c64c528c42b5be4 - Getting rid of capital letter in one of the columns
[shannon1995black] af39b43f7fb1c3cbdce95f106bb5c8f81f7e5781 - update column name
[shannon1995black] 3a1135fd0c90a4d0174833f051dd372379ab2c69 - uncomment line to create observations.csv-schema.json
[lperryman] 78c14f03098459533da8df4fb7f970caf2d8f71b - Fixing columns.csv
[lperryman] 74a2b37b464c294dbeb19e5f4e41afdfb39c7ff0 - FIxing columns.csv
[lperryman] cdddeee62af46cccbf93274988364109ffd6e672 - FIxing columns.csv
[lperryman] 632a12b75329e5474b55649a26086f0753e8124a - FIxing columns.csv
[lperryman] 3ce5b581d49b56746c235eb25b055991cc7356da - FIxing columns.csv
[lperryman] bb77f055a6aff4914c2d2652efd5fd1b59149d8a - FIxing columns.csv
[Alex Tucker] 6f1cce14484ed02ddb7103995dd8cdd7c8f33cbe - Output dataset metadata and schema.
[lperryman] da8845089d902d7315ba221997bd3b7e2e087173 - FIxing columns.csv
[shannon1995black] 400c47b3af5219f66d019ca206d93bb598b25ad8 - updated value transformation type
[shannon1995black] b7f3b191dc4995a7ba3e2771a7f2bd00f9879e2d - title to uppercase
[lperryman] 513d057cabaf3c9b6e6297f7ae76f28063793427 - Change Year to period and formatted string to represent for 2 year period
[noreply] 3c54f0603efb9580f0cbd92741e32dda7c7bb283 - Update columns.csv
[lperryman] 30c46612e03dd759f8e62f92d5f5b0e880f3a6cb - Adding metadat data to codelists-metadata.json
[noreply] a2a2785da01e4297a272d42e5f8d4bb04f9fcd68 - Update codelists-metadata.json
[lperryman] 38454c78864e493cc8b9e456146933f8f746a75f - Adding trig files to output
[lperryman] d4778471823f9ed5dd602707e52556f97b572a94 - Adding trig files to output
[Alex Tucker] 0ecd7ef459fd07b8a337339d04a9d817502f4f4e - Use "landingPage" and "datasetNotes" for finding datasets/distributions.
[noreply] 3f797e6b294d01511a819e1c33d5116d84fe0024 - Update columns.csv
[lperryman] 86ee83e73743f19fa95788b2592a5c9b5c5302d0 - Adding trig files to output
[lperryman] f39704e62b7304dabe87fe5389c78b82fe57c41a - Replaceing empyt Value columns with 0
[lperryman] 267336c9e6821ecc18596392fa88d6986d9cf70f - Replaceing empyt Value columns with 0
[Grace Spitzer-Wong] aaf7c19ca60b42587a6e1a039d0c4fb2cc3d081f - Created codelist for SEN school types
[Grace Spitzer-Wong] 52e7b36436296f4c8eebebfe292d530f66a596d0 - removing spaces
[Alex Tucker] b2662d587b4af754555899f1ac626e0440ca95aa - Adding FRS Age Group dimension and Percentage of People measure for #10
[noreply] b492ad4b862db862312640ab25cc56db4bbe5ca0 - Update columns.csv
[noreply] 37dc236e927d6900104707f0d2876ecf4b5938c2 - Update columns.csv
[noreply] 8ca2458eee5788fe905e21a191a5c8e4f73d7bb6 - Update columns.csv
[noreply] cd212b405f2bc56b3f2fd07701e71c2fd31b6b84 - Update columns.csv
[noreply] 6e6653590b313072368b37b3dbe7caff64d4c091 - Update columns.csv
[noreply] 6f9391a76c71e50bb39aced28805df7c59f36ed6 - Update columns.csv
[noreply] 13659a5c5674e456e204d6fcfc91b109b1fe09bd - Update columns.csv
[Alex Tucker] ae198a177b6726a760e84b9dc3a06cb0d3aadc74 - Check scraper works from landingPage
[Alex Tucker] 4eabf140b4ee6169608b523db24e14f152d41c1d - Check scraper works from landingPage
[lperryman] 3ea3ab539753e3a60a5eca720a500e8128cef7a7 - Code for changing Sec to M, F,T had disappeared
[lperryman] d2dc8b12a011867fd4650a954d186054b5e7769c - Code for changing Sec to M, F,T had disappeared
[lperryman] 9cabfdb37e5528e356cc5a403da469480abdbc95 - Code for changing Sec to M, F,T had disappeared
[lperryman] 8e4ce46562a729ec80a4cec42ce7fd58455fa62c - Changing Sample Size in columns.csv to a measure and a number
[lperryman] 3c6df49054b927e50726c7fe30e63376cf28c106 - Adding a Measure Type column to my datasets
[vtula2000] 9ad5368fa24ae3a5a54cc107c43165ccaf2a23bb - Tidy data
[lperryman] 708323b3b7eb7182cd26611972370c3d8011b697 - Adding a Marker column to dataset and to columns.csv file
[Alex Tucker] 167ac3bd3b6ba3512c4de29282f8b64f0108d551 - Ignore ipynb notebooks, keep the Python instead.
[noreply] 21e12e901a0c5a4ad10aed35887a7b26b00709aa - Update columns.csv
[lperryman] 0e2c6a47031616dd61777f92258850f26495615b - Adding a Marker column to dataset and to columns.csv file
[noreply] aa434283bd91c9d5ad7be9de2965b521fda2541d - Update columns.csv
[noreply] 50b1dfe507de8c180b70d93628ebae6ce2fc46fa - Update columns.csv
[vtula2000] 7718b7c0ee713db5f231d406db7d97cd20ef8ce0 - url update
[noreply] 315ddf8cbcb9cc73b86831887a80606b176dfdde - Add files via upload
[noreply] 41e921f7bb35d0775135ee5ffb5909f6babbde42 - Add files via upload
[noreply] 5b0c145139019d96fb731f2fd297a0fa9b8c86d9 - Update columns.csv
[noreply] 3f64f2919b1f30b0b56e1f3fa0b4cf65efcb5dd5 - Update columns.csv
[Alex Tucker] aef10226c53c5e8a5e401a950b5f2c56dba4066c - Add some validation for columns.csv
[lperryman] fdb28502bdb82b76a6f9d6638953c2a56322ce7c - Adding Marker to comnponents.csv file
[lperryman] b9c55f7d948c14b24a649b2a3aa18a523efa5c16 - Adding Marker codelist file
[noreply] fcc1e1e5b7c9e4cfc5fcdb5e6730543977197d8d - Update codelists-metadata.json
[noreply] 14c69f2bb386d89338c4f87512bc43062cf4f9ba - Update main.py
[Grace Spitzer-Wong] a2cec17e509749a9352d326dd5fe7abdb703e2e9 - codelist renamed
[Alex Tucker] 991666338c05dfeae4e8aaa1b33044a03136b8b2 - Cleaned up some (, ), _, - and space chars.
[Alex Tucker] c80bf8f6082cb498f5db45163dedef67ef4d8850 - Removed some double hyphens for compatibility with the way gssutils pathify() turns labels into URL paths.
No changes
[Alex Tucker] 1f3bc6a4192a314eebb538fb3df22f48ab10c488 - Fix csvlints in codelists-metadata.json
[Alex Tucker] c3ed524eefafe973fa79e7e1efcced6d98bd463c - Unix filenames are case sensitive. Make codes consistent with gssutils pathify() function.
[Alex Tucker] 6502a4f6bb75498fe85c4aeb4d0bc9be2479d2df - Ensure CSV files have CRLF line endings.
[Alex Tucker] b943367c13180b1303686d63185390b505ddfae6 - Remove duplicate list. Re-order codelists metadata to check that all the codelists are listed and add any missing.
[Alex Tucker] c5192a273390881515405d7ce7367896cd09000f - Check columns.csv against schema.
[Alex Tucker] e73ae1f8138834830da9923f4f00cb7f3586424b - Add schema for components.csv and update tests.
[Alex Tucker] 6a14b50dbb530df024cb1cb056ad3fef09ce979c - Try putting hard quotes around filename to cope with special shell chars.
[Alex Tucker] efba49cceef190108778c71654b7137627362eaf - Add 'Count' measure type.
[noreply] 250cc46bdc95c5fc5affa612c3ca1c3042f579da - Update columns.csv
[lperryman] f7b973736f5aa1149844059185b2052425df292b - Removing spaces in column Measure Type
[noreply] 9e759c863fa0d8fa1ba058c4cdbb599bc0b4f47e - Update codelists-metadata.json
[noreply] a452dfcf68b6dfdddb429ae7550637f8a62c40db - Update codelists-metadata.json
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 937 lines...]
806. too_many_values. Row: 267. Percent
807. format. Row: 268,3. Social/behavioural
808. invalid_number. Row: 268,6. Percentage
809. too_many_values. Row: 268. Percent
810. format. Row: 269,3. Social/behavioural
811. invalid_number. Row: 269,6. Percentage
812. too_many_values. Row: 269. Percent
813. format. Row: 270,3. Other
814. invalid_number. Row: 270,6. Percentage
815. too_many_values. Row: 270. Percent
816. format. Row: 271,3. Other
817. invalid_number. Row: 271,6. Percentage
818. too_many_values. Row: 271. Percent
819. format. Row: 272,3. Other
820. invalid_number. Row: 272,6. Percentage
821. too_many_values. Row: 272. Percent
822. format. Row: 273,3. Other
823. invalid_number. Row: 273,6. Percentage
824. too_many_values. Row: 273. Percent
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 edbbbf59b7677b4dcac8ebeec3b6592fafa2326cc3ef6dbb0ae7b83bdb5b28bd
$ docker rm -f edbbbf59b7677b4dcac8ebeec3b6592fafa2326cc3ef6dbb0ae7b83bdb5b28bd
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes No changes No changes
[Alex Tucker] 516eb5ee94da99618bf476c56c3e6517c2482083 - Remove old special case for when out/observations.csv exists.
[Alex Tucker] 6820fef84d1c73bbfb16d07f87259afa096c4cbc - Fix ragged rows. Use DOS line endings as that's what text/* mimetypes should do.
[lperryman] f961b501f993b6801d5d1bbfec841d36350e64a3 - datasets/DWP-Family-Resources-Survey-Carer/main.py had all the wrong formatting for some reason so changed
[lperryman] 22b78bfeee1cd7bcf5833e739f418c8b211490ae - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[lperryman] 1f3e2fec7a6f13c5c0ea02bcf96e77170ac62fd8 - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[mikelovesbooks] 386eaf2559c7547c0ebc252327f160425470eba3 - added temporary manual trig file
[mikelovesbooks] a4e72e6d296eadf60ec9f43ea295284b1617b341 - updated PHE codelists
[mikelovesbooks] 92e9710cf77d6567a2422f330be4da61b8692203 - data from fingertips
[mikelovesbooks] 4dce0948a896af31013ae2554cab5d6a2b918dfe - remove old local data csv
[noreply] cffc20ac58d99cf982d93f417a6b5fc75915d639 - Delete main.ipynb
[noreply] 87ede54c0396e304ac5d372aa71eba0024f0e2d3 - Delete Jenkinsfile
[shannon1995black] be84d9fdec016c03bf7de6c1597c64218621d99a - update naming
[noreply] 928e88d31a7b985e10d265e871871edd92f9aa66 - remove unnecessary time period entry
[lperryman] 4431431355ab317f4d9aa3db8ce695cfb9c130ee - Adding rows to the components csv file
[shannon1995black] b4d0f885f6084447ec8add6ed66d3affc161332d - update main
[lperryman] 037a500fa0ea442f64b9e87949b519ac5c672e43 - Sorting ourt the schema file
[lperryman] d7079738021323d7aba78930006122c17eb2adb9 - Had a capital i one of the column headings when it should have been lower case!
[shannon1995black] 8260ab10b2288609275aa23585d28cc77faff340 - updates
[shannon1995black] 7871ceb8e22f7205829a9ca14da022fa0b86c374 - updated json file
[lperryman] 417d7d297486f1e7780b1ad3d26cfda4a37158f5 - Adding Period to columns.csv
[lperryman] 44e902bc5d106ebfa2eb318e4c64c528c42b5be4 - Getting rid of capital letter in one of the columns
[shannon1995black] af39b43f7fb1c3cbdce95f106bb5c8f81f7e5781 - update column name
[shannon1995black] 3a1135fd0c90a4d0174833f051dd372379ab2c69 - uncomment line to create observations.csv-schema.json
[lperryman] 78c14f03098459533da8df4fb7f970caf2d8f71b - Fixing columns.csv
[lperryman] 74a2b37b464c294dbeb19e5f4e41afdfb39c7ff0 - FIxing columns.csv
[lperryman] cdddeee62af46cccbf93274988364109ffd6e672 - FIxing columns.csv
[lperryman] 632a12b75329e5474b55649a26086f0753e8124a - FIxing columns.csv
[lperryman] 3ce5b581d49b56746c235eb25b055991cc7356da - FIxing columns.csv
[lperryman] bb77f055a6aff4914c2d2652efd5fd1b59149d8a - FIxing columns.csv
[Alex Tucker] 6f1cce14484ed02ddb7103995dd8cdd7c8f33cbe - Output dataset metadata and schema.
[lperryman] da8845089d902d7315ba221997bd3b7e2e087173 - FIxing columns.csv
[shannon1995black] 400c47b3af5219f66d019ca206d93bb598b25ad8 - updated value transformation type
[shannon1995black] b7f3b191dc4995a7ba3e2771a7f2bd00f9879e2d - title to uppercase
[lperryman] 513d057cabaf3c9b6e6297f7ae76f28063793427 - Change Year to period and formatted string to represent for 2 year period
[noreply] 3c54f0603efb9580f0cbd92741e32dda7c7bb283 - Update columns.csv
[lperryman] 30c46612e03dd759f8e62f92d5f5b0e880f3a6cb - Adding metadat data to codelists-metadata.json
[noreply] a2a2785da01e4297a272d42e5f8d4bb04f9fcd68 - Update codelists-metadata.json
[lperryman] 38454c78864e493cc8b9e456146933f8f746a75f - Adding trig files to output
[lperryman] d4778471823f9ed5dd602707e52556f97b572a94 - Adding trig files to output
[Alex Tucker] 0ecd7ef459fd07b8a337339d04a9d817502f4f4e - Use "landingPage" and "datasetNotes" for finding datasets/distributions.
[noreply] 3f797e6b294d01511a819e1c33d5116d84fe0024 - Update columns.csv
[lperryman] 86ee83e73743f19fa95788b2592a5c9b5c5302d0 - Adding trig files to output
[lperryman] f39704e62b7304dabe87fe5389c78b82fe57c41a - Replaceing empyt Value columns with 0
[lperryman] 267336c9e6821ecc18596392fa88d6986d9cf70f - Replaceing empyt Value columns with 0
[Grace Spitzer-Wong] aaf7c19ca60b42587a6e1a039d0c4fb2cc3d081f - Created codelist for SEN school types
[Grace Spitzer-Wong] 52e7b36436296f4c8eebebfe292d530f66a596d0 - removing spaces
[Alex Tucker] b2662d587b4af754555899f1ac626e0440ca95aa - Adding FRS Age Group dimension and Percentage of People measure for #10
[noreply] b492ad4b862db862312640ab25cc56db4bbe5ca0 - Update columns.csv
[noreply] 37dc236e927d6900104707f0d2876ecf4b5938c2 - Update columns.csv
[noreply] 8ca2458eee5788fe905e21a191a5c8e4f73d7bb6 - Update columns.csv
[noreply] cd212b405f2bc56b3f2fd07701e71c2fd31b6b84 - Update columns.csv
[noreply] 6e6653590b313072368b37b3dbe7caff64d4c091 - Update columns.csv
[noreply] 6f9391a76c71e50bb39aced28805df7c59f36ed6 - Update columns.csv
[noreply] 13659a5c5674e456e204d6fcfc91b109b1fe09bd - Update columns.csv
[Alex Tucker] ae198a177b6726a760e84b9dc3a06cb0d3aadc74 - Check scraper works from landingPage
[Alex Tucker] 4eabf140b4ee6169608b523db24e14f152d41c1d - Check scraper works from landingPage
[lperryman] 3ea3ab539753e3a60a5eca720a500e8128cef7a7 - Code for changing Sec to M, F,T had disappeared
[lperryman] d2dc8b12a011867fd4650a954d186054b5e7769c - Code for changing Sec to M, F,T had disappeared
[lperryman] 9cabfdb37e5528e356cc5a403da469480abdbc95 - Code for changing Sec to M, F,T had disappeared
[lperryman] 8e4ce46562a729ec80a4cec42ce7fd58455fa62c - Changing Sample Size in columns.csv to a measure and a number
[lperryman] 3c6df49054b927e50726c7fe30e63376cf28c106 - Adding a Measure Type column to my datasets
[vtula2000] 9ad5368fa24ae3a5a54cc107c43165ccaf2a23bb - Tidy data
[lperryman] 708323b3b7eb7182cd26611972370c3d8011b697 - Adding a Marker column to dataset and to columns.csv file
[Alex Tucker] 167ac3bd3b6ba3512c4de29282f8b64f0108d551 - Ignore ipynb notebooks, keep the Python instead.
[noreply] 21e12e901a0c5a4ad10aed35887a7b26b00709aa - Update columns.csv
[lperryman] 0e2c6a47031616dd61777f92258850f26495615b - Adding a Marker column to dataset and to columns.csv file
[noreply] aa434283bd91c9d5ad7be9de2965b521fda2541d - Update columns.csv
[noreply] 50b1dfe507de8c180b70d93628ebae6ce2fc46fa - Update columns.csv
[vtula2000] 7718b7c0ee713db5f231d406db7d97cd20ef8ce0 - url update
[noreply] 315ddf8cbcb9cc73b86831887a80606b176dfdde - Add files via upload
[noreply] 41e921f7bb35d0775135ee5ffb5909f6babbde42 - Add files via upload
[noreply] 5b0c145139019d96fb731f2fd297a0fa9b8c86d9 - Update columns.csv
[noreply] 3f64f2919b1f30b0b56e1f3fa0b4cf65efcb5dd5 - Update columns.csv
[Alex Tucker] aef10226c53c5e8a5e401a950b5f2c56dba4066c - Add some validation for columns.csv
[lperryman] fdb28502bdb82b76a6f9d6638953c2a56322ce7c - Adding Marker to comnponents.csv file
[lperryman] b9c55f7d948c14b24a649b2a3aa18a523efa5c16 - Adding Marker codelist file
[noreply] fcc1e1e5b7c9e4cfc5fcdb5e6730543977197d8d - Update codelists-metadata.json
[noreply] 14c69f2bb386d89338c4f87512bc43062cf4f9ba - Update main.py
[Grace Spitzer-Wong] a2cec17e509749a9352d326dd5fe7abdb703e2e9 - codelist renamed
[Alex Tucker] 991666338c05dfeae4e8aaa1b33044a03136b8b2 - Cleaned up some (, ), _, - and space chars.
[Alex Tucker] c80bf8f6082cb498f5db45163dedef67ef4d8850 - Removed some double hyphens for compatibility with the way gssutils pathify() turns labels into URL paths.
No changes
[Alex Tucker] 1f3bc6a4192a314eebb538fb3df22f48ab10c488 - Fix csvlints in codelists-metadata.json
[Alex Tucker] c3ed524eefafe973fa79e7e1efcced6d98bd463c - Unix filenames are case sensitive. Make codes consistent with gssutils pathify() function.
[Alex Tucker] 6502a4f6bb75498fe85c4aeb4d0bc9be2479d2df - Ensure CSV files have CRLF line endings.
[Alex Tucker] b943367c13180b1303686d63185390b505ddfae6 - Remove duplicate list. Re-order codelists metadata to check that all the codelists are listed and add any missing.
[Alex Tucker] c5192a273390881515405d7ce7367896cd09000f - Check columns.csv against schema.
[Alex Tucker] e73ae1f8138834830da9923f4f00cb7f3586424b - Add schema for components.csv and update tests.
[Alex Tucker] 6a14b50dbb530df024cb1cb056ad3fef09ce979c - Try putting hard quotes around filename to cope with special shell chars.
[Alex Tucker] efba49cceef190108778c71654b7137627362eaf - Add 'Count' measure type.
[noreply] 250cc46bdc95c5fc5affa612c3ca1c3042f579da - Update columns.csv
[lperryman] f7b973736f5aa1149844059185b2052425df292b - Removing spaces in column Measure Type
[noreply] 9e759c863fa0d8fa1ba058c4cdbb599bc0b4f47e - Update codelists-metadata.json
[noreply] a452dfcf68b6dfdddb429ae7550637f8a62c40db - Update codelists-metadata.json
[lperryman] 5f6c118b551b51545dc35b2b48acb8876519ad2b - Removing spaces in column Measure Type
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 937 lines...]
806. too_many_values. Row: 267. Percent
807. format. Row: 268,3. Social/behavioural
808. invalid_number. Row: 268,6. Percentage
809. too_many_values. Row: 268. Percent
810. format. Row: 269,3. Social/behavioural
811. invalid_number. Row: 269,6. Percentage
812. too_many_values. Row: 269. Percent
813. format. Row: 270,3. Other
814. invalid_number. Row: 270,6. Percentage
815. too_many_values. Row: 270. Percent
816. format. Row: 271,3. Other
817. invalid_number. Row: 271,6. Percentage
818. too_many_values. Row: 271. Percent
819. format. Row: 272,3. Other
820. invalid_number. Row: 272,6. Percentage
821. too_many_values. Row: 272. Percent
822. format. Row: 273,3. Other
823. invalid_number. Row: 273,6. Percentage
824. too_many_values. Row: 273. Percent
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 48444e3e3c3f7fba701ebc16168b8359c6f42c9c1836fd47da251daa9414dd7a
$ docker rm -f 48444e3e3c3f7fba701ebc16168b8359c6f42c9c1836fd47da251daa9414dd7a
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes No changes No changes
[Alex Tucker] 516eb5ee94da99618bf476c56c3e6517c2482083 - Remove old special case for when out/observations.csv exists.
[Alex Tucker] 6820fef84d1c73bbfb16d07f87259afa096c4cbc - Fix ragged rows. Use DOS line endings as that's what text/* mimetypes should do.
[lperryman] f961b501f993b6801d5d1bbfec841d36350e64a3 - datasets/DWP-Family-Resources-Survey-Carer/main.py had all the wrong formatting for some reason so changed
[lperryman] 22b78bfeee1cd7bcf5833e739f418c8b211490ae - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[lperryman] 1f3e2fec7a6f13c5c0ea02bcf96e77170ac62fd8 - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[mikelovesbooks] 386eaf2559c7547c0ebc252327f160425470eba3 - added temporary manual trig file
[mikelovesbooks] a4e72e6d296eadf60ec9f43ea295284b1617b341 - updated PHE codelists
[mikelovesbooks] 92e9710cf77d6567a2422f330be4da61b8692203 - data from fingertips
[mikelovesbooks] 4dce0948a896af31013ae2554cab5d6a2b918dfe - remove old local data csv
[noreply] cffc20ac58d99cf982d93f417a6b5fc75915d639 - Delete main.ipynb
[noreply] 87ede54c0396e304ac5d372aa71eba0024f0e2d3 - Delete Jenkinsfile
[shannon1995black] be84d9fdec016c03bf7de6c1597c64218621d99a - update naming
[noreply] 928e88d31a7b985e10d265e871871edd92f9aa66 - remove unnecessary time period entry
[lperryman] 4431431355ab317f4d9aa3db8ce695cfb9c130ee - Adding rows to the components csv file
[shannon1995black] b4d0f885f6084447ec8add6ed66d3affc161332d - update main
[lperryman] 037a500fa0ea442f64b9e87949b519ac5c672e43 - Sorting ourt the schema file
[lperryman] d7079738021323d7aba78930006122c17eb2adb9 - Had a capital i one of the column headings when it should have been lower case!
[shannon1995black] 8260ab10b2288609275aa23585d28cc77faff340 - updates
[shannon1995black] 7871ceb8e22f7205829a9ca14da022fa0b86c374 - updated json file
[lperryman] 417d7d297486f1e7780b1ad3d26cfda4a37158f5 - Adding Period to columns.csv
[lperryman] 44e902bc5d106ebfa2eb318e4c64c528c42b5be4 - Getting rid of capital letter in one of the columns
[shannon1995black] af39b43f7fb1c3cbdce95f106bb5c8f81f7e5781 - update column name
[shannon1995black] 3a1135fd0c90a4d0174833f051dd372379ab2c69 - uncomment line to create observations.csv-schema.json
[lperryman] 78c14f03098459533da8df4fb7f970caf2d8f71b - Fixing columns.csv
[lperryman] 74a2b37b464c294dbeb19e5f4e41afdfb39c7ff0 - FIxing columns.csv
[lperryman] cdddeee62af46cccbf93274988364109ffd6e672 - FIxing columns.csv
[lperryman] 632a12b75329e5474b55649a26086f0753e8124a - FIxing columns.csv
[lperryman] 3ce5b581d49b56746c235eb25b055991cc7356da - FIxing columns.csv
[lperryman] bb77f055a6aff4914c2d2652efd5fd1b59149d8a - FIxing columns.csv
[Alex Tucker] 6f1cce14484ed02ddb7103995dd8cdd7c8f33cbe - Output dataset metadata and schema.
[lperryman] da8845089d902d7315ba221997bd3b7e2e087173 - FIxing columns.csv
[shannon1995black] 400c47b3af5219f66d019ca206d93bb598b25ad8 - updated value transformation type
[shannon1995black] b7f3b191dc4995a7ba3e2771a7f2bd00f9879e2d - title to uppercase
[lperryman] 513d057cabaf3c9b6e6297f7ae76f28063793427 - Change Year to period and formatted string to represent for 2 year period
[noreply] 3c54f0603efb9580f0cbd92741e32dda7c7bb283 - Update columns.csv
[lperryman] 30c46612e03dd759f8e62f92d5f5b0e880f3a6cb - Adding metadat data to codelists-metadata.json
[noreply] a2a2785da01e4297a272d42e5f8d4bb04f9fcd68 - Update codelists-metadata.json
[lperryman] 38454c78864e493cc8b9e456146933f8f746a75f - Adding trig files to output
[lperryman] d4778471823f9ed5dd602707e52556f97b572a94 - Adding trig files to output
[Alex Tucker] 0ecd7ef459fd07b8a337339d04a9d817502f4f4e - Use "landingPage" and "datasetNotes" for finding datasets/distributions.
[noreply] 3f797e6b294d01511a819e1c33d5116d84fe0024 - Update columns.csv
[lperryman] 86ee83e73743f19fa95788b2592a5c9b5c5302d0 - Adding trig files to output
[lperryman] f39704e62b7304dabe87fe5389c78b82fe57c41a - Replaceing empyt Value columns with 0
[lperryman] 267336c9e6821ecc18596392fa88d6986d9cf70f - Replaceing empyt Value columns with 0
[Grace Spitzer-Wong] aaf7c19ca60b42587a6e1a039d0c4fb2cc3d081f - Created codelist for SEN school types
[Grace Spitzer-Wong] 52e7b36436296f4c8eebebfe292d530f66a596d0 - removing spaces
[Alex Tucker] b2662d587b4af754555899f1ac626e0440ca95aa - Adding FRS Age Group dimension and Percentage of People measure for #10
[noreply] b492ad4b862db862312640ab25cc56db4bbe5ca0 - Update columns.csv
[noreply] 37dc236e927d6900104707f0d2876ecf4b5938c2 - Update columns.csv
[noreply] 8ca2458eee5788fe905e21a191a5c8e4f73d7bb6 - Update columns.csv
[noreply] cd212b405f2bc56b3f2fd07701e71c2fd31b6b84 - Update columns.csv
[noreply] 6e6653590b313072368b37b3dbe7caff64d4c091 - Update columns.csv
[noreply] 6f9391a76c71e50bb39aced28805df7c59f36ed6 - Update columns.csv
[noreply] 13659a5c5674e456e204d6fcfc91b109b1fe09bd - Update columns.csv
[Alex Tucker] ae198a177b6726a760e84b9dc3a06cb0d3aadc74 - Check scraper works from landingPage
[Alex Tucker] 4eabf140b4ee6169608b523db24e14f152d41c1d - Check scraper works from landingPage
[lperryman] 3ea3ab539753e3a60a5eca720a500e8128cef7a7 - Code for changing Sec to M, F,T had disappeared
[lperryman] d2dc8b12a011867fd4650a954d186054b5e7769c - Code for changing Sec to M, F,T had disappeared
[lperryman] 9cabfdb37e5528e356cc5a403da469480abdbc95 - Code for changing Sec to M, F,T had disappeared
[lperryman] 8e4ce46562a729ec80a4cec42ce7fd58455fa62c - Changing Sample Size in columns.csv to a measure and a number
[lperryman] 3c6df49054b927e50726c7fe30e63376cf28c106 - Adding a Measure Type column to my datasets
[vtula2000] 9ad5368fa24ae3a5a54cc107c43165ccaf2a23bb - Tidy data
[lperryman] 708323b3b7eb7182cd26611972370c3d8011b697 - Adding a Marker column to dataset and to columns.csv file
[Alex Tucker] 167ac3bd3b6ba3512c4de29282f8b64f0108d551 - Ignore ipynb notebooks, keep the Python instead.
[noreply] 21e12e901a0c5a4ad10aed35887a7b26b00709aa - Update columns.csv
[lperryman] 0e2c6a47031616dd61777f92258850f26495615b - Adding a Marker column to dataset and to columns.csv file
[noreply] aa434283bd91c9d5ad7be9de2965b521fda2541d - Update columns.csv
[noreply] 50b1dfe507de8c180b70d93628ebae6ce2fc46fa - Update columns.csv
[vtula2000] 7718b7c0ee713db5f231d406db7d97cd20ef8ce0 - url update
[noreply] 315ddf8cbcb9cc73b86831887a80606b176dfdde - Add files via upload
[noreply] 41e921f7bb35d0775135ee5ffb5909f6babbde42 - Add files via upload
[noreply] 5b0c145139019d96fb731f2fd297a0fa9b8c86d9 - Update columns.csv
[noreply] 3f64f2919b1f30b0b56e1f3fa0b4cf65efcb5dd5 - Update columns.csv
[Alex Tucker] aef10226c53c5e8a5e401a950b5f2c56dba4066c - Add some validation for columns.csv
[lperryman] fdb28502bdb82b76a6f9d6638953c2a56322ce7c - Adding Marker to comnponents.csv file
[lperryman] b9c55f7d948c14b24a649b2a3aa18a523efa5c16 - Adding Marker codelist file
[noreply] fcc1e1e5b7c9e4cfc5fcdb5e6730543977197d8d - Update codelists-metadata.json
[noreply] 14c69f2bb386d89338c4f87512bc43062cf4f9ba - Update main.py
[Grace Spitzer-Wong] a2cec17e509749a9352d326dd5fe7abdb703e2e9 - codelist renamed
[Alex Tucker] 991666338c05dfeae4e8aaa1b33044a03136b8b2 - Cleaned up some (, ), _, - and space chars.
[Alex Tucker] c80bf8f6082cb498f5db45163dedef67ef4d8850 - Removed some double hyphens for compatibility with the way gssutils pathify() turns labels into URL paths.
No changes
[Alex Tucker] 1f3bc6a4192a314eebb538fb3df22f48ab10c488 - Fix csvlints in codelists-metadata.json
[Alex Tucker] c3ed524eefafe973fa79e7e1efcced6d98bd463c - Unix filenames are case sensitive. Make codes consistent with gssutils pathify() function.
[Alex Tucker] 6502a4f6bb75498fe85c4aeb4d0bc9be2479d2df - Ensure CSV files have CRLF line endings.
[Alex Tucker] b943367c13180b1303686d63185390b505ddfae6 - Remove duplicate list. Re-order codelists metadata to check that all the codelists are listed and add any missing.
[Alex Tucker] c5192a273390881515405d7ce7367896cd09000f - Check columns.csv against schema.
[Alex Tucker] e73ae1f8138834830da9923f4f00cb7f3586424b - Add schema for components.csv and update tests.
[Alex Tucker] 6a14b50dbb530df024cb1cb056ad3fef09ce979c - Try putting hard quotes around filename to cope with special shell chars.
[Alex Tucker] efba49cceef190108778c71654b7137627362eaf - Add 'Count' measure type.
[noreply] 250cc46bdc95c5fc5affa612c3ca1c3042f579da - Update columns.csv
[lperryman] f7b973736f5aa1149844059185b2052425df292b - Removing spaces in column Measure Type
[noreply] 9e759c863fa0d8fa1ba058c4cdbb599bc0b4f47e - Update codelists-metadata.json
[noreply] a452dfcf68b6dfdddb429ae7550637f8a62c40db - Update codelists-metadata.json
[lperryman] 5f6c118b551b51545dc35b2b48acb8876519ad2b - Removing spaces in column Measure Type
[Alex Tucker] 181d7de5f1ccae6d03169a68bda82bc46c7984e9 - Value column needs a special definition as it gets 'pivotted'.
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 935 lines...]
806. too_many_values. Row: 267. Percent
807. format. Row: 268,3. Social/behavioural
808. invalid_number. Row: 268,6. Percentage
809. too_many_values. Row: 268. Percent
810. format. Row: 269,3. Social/behavioural
811. invalid_number. Row: 269,6. Percentage
812. too_many_values. Row: 269. Percent
813. format. Row: 270,3. Other
814. invalid_number. Row: 270,6. Percentage
815. too_many_values. Row: 270. Percent
816. format. Row: 271,3. Other
817. invalid_number. Row: 271,6. Percentage
818. too_many_values. Row: 271. Percent
819. format. Row: 272,3. Other
820. invalid_number. Row: 272,6. Percentage
821. too_many_values. Row: 272. Percent
822. format. Row: 273,3. Other
823. invalid_number. Row: 273,6. Percentage
824. too_many_values. Row: 273. Percent
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 b331038c88a268765babc4233d0dc30d692dbc1b1ad0d8e68a4daaf034fa51f6
$ docker rm -f b331038c88a268765babc4233d0dc30d692dbc1b1ad0d8e68a4daaf034fa51f6
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes No changes No changes
[Alex Tucker] 516eb5ee94da99618bf476c56c3e6517c2482083 - Remove old special case for when out/observations.csv exists.
[Alex Tucker] 6820fef84d1c73bbfb16d07f87259afa096c4cbc - Fix ragged rows. Use DOS line endings as that's what text/* mimetypes should do.
[lperryman] f961b501f993b6801d5d1bbfec841d36350e64a3 - datasets/DWP-Family-Resources-Survey-Carer/main.py had all the wrong formatting for some reason so changed
[lperryman] 22b78bfeee1cd7bcf5833e739f418c8b211490ae - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[lperryman] 1f3e2fec7a6f13c5c0ea02bcf96e77170ac62fd8 - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[mikelovesbooks] 386eaf2559c7547c0ebc252327f160425470eba3 - added temporary manual trig file
[mikelovesbooks] a4e72e6d296eadf60ec9f43ea295284b1617b341 - updated PHE codelists
[mikelovesbooks] 92e9710cf77d6567a2422f330be4da61b8692203 - data from fingertips
[mikelovesbooks] 4dce0948a896af31013ae2554cab5d6a2b918dfe - remove old local data csv
[noreply] cffc20ac58d99cf982d93f417a6b5fc75915d639 - Delete main.ipynb
[noreply] 87ede54c0396e304ac5d372aa71eba0024f0e2d3 - Delete Jenkinsfile
[shannon1995black] be84d9fdec016c03bf7de6c1597c64218621d99a - update naming
[noreply] 928e88d31a7b985e10d265e871871edd92f9aa66 - remove unnecessary time period entry
[lperryman] 4431431355ab317f4d9aa3db8ce695cfb9c130ee - Adding rows to the components csv file
[shannon1995black] b4d0f885f6084447ec8add6ed66d3affc161332d - update main
[lperryman] 037a500fa0ea442f64b9e87949b519ac5c672e43 - Sorting ourt the schema file
[lperryman] d7079738021323d7aba78930006122c17eb2adb9 - Had a capital i one of the column headings when it should have been lower case!
[shannon1995black] 8260ab10b2288609275aa23585d28cc77faff340 - updates
[shannon1995black] 7871ceb8e22f7205829a9ca14da022fa0b86c374 - updated json file
[lperryman] 417d7d297486f1e7780b1ad3d26cfda4a37158f5 - Adding Period to columns.csv
[lperryman] 44e902bc5d106ebfa2eb318e4c64c528c42b5be4 - Getting rid of capital letter in one of the columns
[shannon1995black] af39b43f7fb1c3cbdce95f106bb5c8f81f7e5781 - update column name
[shannon1995black] 3a1135fd0c90a4d0174833f051dd372379ab2c69 - uncomment line to create observations.csv-schema.json
[lperryman] 78c14f03098459533da8df4fb7f970caf2d8f71b - Fixing columns.csv
[lperryman] 74a2b37b464c294dbeb19e5f4e41afdfb39c7ff0 - FIxing columns.csv
[lperryman] cdddeee62af46cccbf93274988364109ffd6e672 - FIxing columns.csv
[lperryman] 632a12b75329e5474b55649a26086f0753e8124a - FIxing columns.csv
[lperryman] 3ce5b581d49b56746c235eb25b055991cc7356da - FIxing columns.csv
[lperryman] bb77f055a6aff4914c2d2652efd5fd1b59149d8a - FIxing columns.csv
[Alex Tucker] 6f1cce14484ed02ddb7103995dd8cdd7c8f33cbe - Output dataset metadata and schema.
[lperryman] da8845089d902d7315ba221997bd3b7e2e087173 - FIxing columns.csv
[shannon1995black] 400c47b3af5219f66d019ca206d93bb598b25ad8 - updated value transformation type
[shannon1995black] b7f3b191dc4995a7ba3e2771a7f2bd00f9879e2d - title to uppercase
[lperryman] 513d057cabaf3c9b6e6297f7ae76f28063793427 - Change Year to period and formatted string to represent for 2 year period
[noreply] 3c54f0603efb9580f0cbd92741e32dda7c7bb283 - Update columns.csv
[lperryman] 30c46612e03dd759f8e62f92d5f5b0e880f3a6cb - Adding metadat data to codelists-metadata.json
[noreply] a2a2785da01e4297a272d42e5f8d4bb04f9fcd68 - Update codelists-metadata.json
[lperryman] 38454c78864e493cc8b9e456146933f8f746a75f - Adding trig files to output
[lperryman] d4778471823f9ed5dd602707e52556f97b572a94 - Adding trig files to output
[Alex Tucker] 0ecd7ef459fd07b8a337339d04a9d817502f4f4e - Use "landingPage" and "datasetNotes" for finding datasets/distributions.
[noreply] 3f797e6b294d01511a819e1c33d5116d84fe0024 - Update columns.csv
[lperryman] 86ee83e73743f19fa95788b2592a5c9b5c5302d0 - Adding trig files to output
[lperryman] f39704e62b7304dabe87fe5389c78b82fe57c41a - Replaceing empyt Value columns with 0
[lperryman] 267336c9e6821ecc18596392fa88d6986d9cf70f - Replaceing empyt Value columns with 0
[Grace Spitzer-Wong] aaf7c19ca60b42587a6e1a039d0c4fb2cc3d081f - Created codelist for SEN school types
[Grace Spitzer-Wong] 52e7b36436296f4c8eebebfe292d530f66a596d0 - removing spaces
[Alex Tucker] b2662d587b4af754555899f1ac626e0440ca95aa - Adding FRS Age Group dimension and Percentage of People measure for #10
[noreply] b492ad4b862db862312640ab25cc56db4bbe5ca0 - Update columns.csv
[noreply] 37dc236e927d6900104707f0d2876ecf4b5938c2 - Update columns.csv
[noreply] 8ca2458eee5788fe905e21a191a5c8e4f73d7bb6 - Update columns.csv
[noreply] cd212b405f2bc56b3f2fd07701e71c2fd31b6b84 - Update columns.csv
[noreply] 6e6653590b313072368b37b3dbe7caff64d4c091 - Update columns.csv
[noreply] 6f9391a76c71e50bb39aced28805df7c59f36ed6 - Update columns.csv
[noreply] 13659a5c5674e456e204d6fcfc91b109b1fe09bd - Update columns.csv
[Alex Tucker] ae198a177b6726a760e84b9dc3a06cb0d3aadc74 - Check scraper works from landingPage
[Alex Tucker] 4eabf140b4ee6169608b523db24e14f152d41c1d - Check scraper works from landingPage
[lperryman] 3ea3ab539753e3a60a5eca720a500e8128cef7a7 - Code for changing Sec to M, F,T had disappeared
[lperryman] d2dc8b12a011867fd4650a954d186054b5e7769c - Code for changing Sec to M, F,T had disappeared
[lperryman] 9cabfdb37e5528e356cc5a403da469480abdbc95 - Code for changing Sec to M, F,T had disappeared
[lperryman] 8e4ce46562a729ec80a4cec42ce7fd58455fa62c - Changing Sample Size in columns.csv to a measure and a number
[lperryman] 3c6df49054b927e50726c7fe30e63376cf28c106 - Adding a Measure Type column to my datasets
[vtula2000] 9ad5368fa24ae3a5a54cc107c43165ccaf2a23bb - Tidy data
[lperryman] 708323b3b7eb7182cd26611972370c3d8011b697 - Adding a Marker column to dataset and to columns.csv file
[Alex Tucker] 167ac3bd3b6ba3512c4de29282f8b64f0108d551 - Ignore ipynb notebooks, keep the Python instead.
[noreply] 21e12e901a0c5a4ad10aed35887a7b26b00709aa - Update columns.csv
[lperryman] 0e2c6a47031616dd61777f92258850f26495615b - Adding a Marker column to dataset and to columns.csv file
[noreply] aa434283bd91c9d5ad7be9de2965b521fda2541d - Update columns.csv
[noreply] 50b1dfe507de8c180b70d93628ebae6ce2fc46fa - Update columns.csv
[vtula2000] 7718b7c0ee713db5f231d406db7d97cd20ef8ce0 - url update
[noreply] 315ddf8cbcb9cc73b86831887a80606b176dfdde - Add files via upload
[noreply] 41e921f7bb35d0775135ee5ffb5909f6babbde42 - Add files via upload
[noreply] 5b0c145139019d96fb731f2fd297a0fa9b8c86d9 - Update columns.csv
[noreply] 3f64f2919b1f30b0b56e1f3fa0b4cf65efcb5dd5 - Update columns.csv
[Alex Tucker] aef10226c53c5e8a5e401a950b5f2c56dba4066c - Add some validation for columns.csv
[lperryman] fdb28502bdb82b76a6f9d6638953c2a56322ce7c - Adding Marker to comnponents.csv file
[lperryman] b9c55f7d948c14b24a649b2a3aa18a523efa5c16 - Adding Marker codelist file
[noreply] fcc1e1e5b7c9e4cfc5fcdb5e6730543977197d8d - Update codelists-metadata.json
[noreply] 14c69f2bb386d89338c4f87512bc43062cf4f9ba - Update main.py
[Grace Spitzer-Wong] a2cec17e509749a9352d326dd5fe7abdb703e2e9 - codelist renamed
[Alex Tucker] 991666338c05dfeae4e8aaa1b33044a03136b8b2 - Cleaned up some (, ), _, - and space chars.
[Alex Tucker] c80bf8f6082cb498f5db45163dedef67ef4d8850 - Removed some double hyphens for compatibility with the way gssutils pathify() turns labels into URL paths.
No changes
[Alex Tucker] 1f3bc6a4192a314eebb538fb3df22f48ab10c488 - Fix csvlints in codelists-metadata.json
[Alex Tucker] c3ed524eefafe973fa79e7e1efcced6d98bd463c - Unix filenames are case sensitive. Make codes consistent with gssutils pathify() function.
[Alex Tucker] 6502a4f6bb75498fe85c4aeb4d0bc9be2479d2df - Ensure CSV files have CRLF line endings.
[Alex Tucker] b943367c13180b1303686d63185390b505ddfae6 - Remove duplicate list. Re-order codelists metadata to check that all the codelists are listed and add any missing.
[Alex Tucker] c5192a273390881515405d7ce7367896cd09000f - Check columns.csv against schema.
[Alex Tucker] e73ae1f8138834830da9923f4f00cb7f3586424b - Add schema for components.csv and update tests.
[Alex Tucker] 6a14b50dbb530df024cb1cb056ad3fef09ce979c - Try putting hard quotes around filename to cope with special shell chars.
[Alex Tucker] efba49cceef190108778c71654b7137627362eaf - Add 'Count' measure type.
[noreply] 250cc46bdc95c5fc5affa612c3ca1c3042f579da - Update columns.csv
[lperryman] f7b973736f5aa1149844059185b2052425df292b - Removing spaces in column Measure Type
[noreply] 9e759c863fa0d8fa1ba058c4cdbb599bc0b4f47e - Update codelists-metadata.json
[noreply] a452dfcf68b6dfdddb429ae7550637f8a62c40db - Update codelists-metadata.json
[lperryman] 5f6c118b551b51545dc35b2b48acb8876519ad2b - Removing spaces in column Measure Type
[Alex Tucker] 181d7de5f1ccae6d03169a68bda82bc46c7984e9 - Value column needs a special definition as it gets 'pivotted'.
[noreply] 31bf0ad1fb9fd1d4302992f3287d69d3e9d4e19b - Pathify Value column of Identified-Support-Needs-of-Homeless-Households-2018-19 table
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 937 lines...]
806. too_many_values. Row: 267. Percent
807. format. Row: 268,3. Social/behavioural
808. invalid_number. Row: 268,6. Percentage
809. too_many_values. Row: 268. Percent
810. format. Row: 269,3. Social/behavioural
811. invalid_number. Row: 269,6. Percentage
812. too_many_values. Row: 269. Percent
813. format. Row: 270,3. Other
814. invalid_number. Row: 270,6. Percentage
815. too_many_values. Row: 270. Percent
816. format. Row: 271,3. Other
817. invalid_number. Row: 271,6. Percentage
818. too_many_values. Row: 271. Percent
819. format. Row: 272,3. Other
820. invalid_number. Row: 272,6. Percentage
821. too_many_values. Row: 272. Percent
822. format. Row: 273,3. Other
823. invalid_number. Row: 273,6. Percentage
824. too_many_values. Row: 273. Percent
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 889a9183258cf3311148492cab79cc04ec5a52eb31ddc54191eaf1a703260f33
$ docker rm -f 889a9183258cf3311148492cab79cc04ec5a52eb31ddc54191eaf1a703260f33
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes No changes No changes
[Alex Tucker] 516eb5ee94da99618bf476c56c3e6517c2482083 - Remove old special case for when out/observations.csv exists.
[Alex Tucker] 6820fef84d1c73bbfb16d07f87259afa096c4cbc - Fix ragged rows. Use DOS line endings as that's what text/* mimetypes should do.
[lperryman] f961b501f993b6801d5d1bbfec841d36350e64a3 - datasets/DWP-Family-Resources-Survey-Carer/main.py had all the wrong formatting for some reason so changed
[lperryman] 22b78bfeee1cd7bcf5833e739f418c8b211490ae - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[lperryman] 1f3e2fec7a6f13c5c0ea02bcf96e77170ac62fd8 - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[mikelovesbooks] 386eaf2559c7547c0ebc252327f160425470eba3 - added temporary manual trig file
[mikelovesbooks] a4e72e6d296eadf60ec9f43ea295284b1617b341 - updated PHE codelists
[mikelovesbooks] 92e9710cf77d6567a2422f330be4da61b8692203 - data from fingertips
[mikelovesbooks] 4dce0948a896af31013ae2554cab5d6a2b918dfe - remove old local data csv
[noreply] cffc20ac58d99cf982d93f417a6b5fc75915d639 - Delete main.ipynb
[noreply] 87ede54c0396e304ac5d372aa71eba0024f0e2d3 - Delete Jenkinsfile
[shannon1995black] be84d9fdec016c03bf7de6c1597c64218621d99a - update naming
[noreply] 928e88d31a7b985e10d265e871871edd92f9aa66 - remove unnecessary time period entry
[lperryman] 4431431355ab317f4d9aa3db8ce695cfb9c130ee - Adding rows to the components csv file
[shannon1995black] b4d0f885f6084447ec8add6ed66d3affc161332d - update main
[lperryman] 037a500fa0ea442f64b9e87949b519ac5c672e43 - Sorting ourt the schema file
[lperryman] d7079738021323d7aba78930006122c17eb2adb9 - Had a capital i one of the column headings when it should have been lower case!
[shannon1995black] 8260ab10b2288609275aa23585d28cc77faff340 - updates
[shannon1995black] 7871ceb8e22f7205829a9ca14da022fa0b86c374 - updated json file
[lperryman] 417d7d297486f1e7780b1ad3d26cfda4a37158f5 - Adding Period to columns.csv
[lperryman] 44e902bc5d106ebfa2eb318e4c64c528c42b5be4 - Getting rid of capital letter in one of the columns
[shannon1995black] af39b43f7fb1c3cbdce95f106bb5c8f81f7e5781 - update column name
[shannon1995black] 3a1135fd0c90a4d0174833f051dd372379ab2c69 - uncomment line to create observations.csv-schema.json
[lperryman] 78c14f03098459533da8df4fb7f970caf2d8f71b - Fixing columns.csv
[lperryman] 74a2b37b464c294dbeb19e5f4e41afdfb39c7ff0 - FIxing columns.csv
[lperryman] cdddeee62af46cccbf93274988364109ffd6e672 - FIxing columns.csv
[lperryman] 632a12b75329e5474b55649a26086f0753e8124a - FIxing columns.csv
[lperryman] 3ce5b581d49b56746c235eb25b055991cc7356da - FIxing columns.csv
[lperryman] bb77f055a6aff4914c2d2652efd5fd1b59149d8a - FIxing columns.csv
[Alex Tucker] 6f1cce14484ed02ddb7103995dd8cdd7c8f33cbe - Output dataset metadata and schema.
[lperryman] da8845089d902d7315ba221997bd3b7e2e087173 - FIxing columns.csv
[shannon1995black] 400c47b3af5219f66d019ca206d93bb598b25ad8 - updated value transformation type
[shannon1995black] b7f3b191dc4995a7ba3e2771a7f2bd00f9879e2d - title to uppercase
[lperryman] 513d057cabaf3c9b6e6297f7ae76f28063793427 - Change Year to period and formatted string to represent for 2 year period
[noreply] 3c54f0603efb9580f0cbd92741e32dda7c7bb283 - Update columns.csv
[lperryman] 30c46612e03dd759f8e62f92d5f5b0e880f3a6cb - Adding metadat data to codelists-metadata.json
[noreply] a2a2785da01e4297a272d42e5f8d4bb04f9fcd68 - Update codelists-metadata.json
[lperryman] 38454c78864e493cc8b9e456146933f8f746a75f - Adding trig files to output
[lperryman] d4778471823f9ed5dd602707e52556f97b572a94 - Adding trig files to output
[Alex Tucker] 0ecd7ef459fd07b8a337339d04a9d817502f4f4e - Use "landingPage" and "datasetNotes" for finding datasets/distributions.
[noreply] 3f797e6b294d01511a819e1c33d5116d84fe0024 - Update columns.csv
[lperryman] 86ee83e73743f19fa95788b2592a5c9b5c5302d0 - Adding trig files to output
[lperryman] f39704e62b7304dabe87fe5389c78b82fe57c41a - Replaceing empyt Value columns with 0
[lperryman] 267336c9e6821ecc18596392fa88d6986d9cf70f - Replaceing empyt Value columns with 0
[Grace Spitzer-Wong] aaf7c19ca60b42587a6e1a039d0c4fb2cc3d081f - Created codelist for SEN school types
[Grace Spitzer-Wong] 52e7b36436296f4c8eebebfe292d530f66a596d0 - removing spaces
[Alex Tucker] b2662d587b4af754555899f1ac626e0440ca95aa - Adding FRS Age Group dimension and Percentage of People measure for #10
[noreply] b492ad4b862db862312640ab25cc56db4bbe5ca0 - Update columns.csv
[noreply] 37dc236e927d6900104707f0d2876ecf4b5938c2 - Update columns.csv
[noreply] 8ca2458eee5788fe905e21a191a5c8e4f73d7bb6 - Update columns.csv
[noreply] cd212b405f2bc56b3f2fd07701e71c2fd31b6b84 - Update columns.csv
[noreply] 6e6653590b313072368b37b3dbe7caff64d4c091 - Update columns.csv
[noreply] 6f9391a76c71e50bb39aced28805df7c59f36ed6 - Update columns.csv
[noreply] 13659a5c5674e456e204d6fcfc91b109b1fe09bd - Update columns.csv
[Alex Tucker] ae198a177b6726a760e84b9dc3a06cb0d3aadc74 - Check scraper works from landingPage
[Alex Tucker] 4eabf140b4ee6169608b523db24e14f152d41c1d - Check scraper works from landingPage
[lperryman] 3ea3ab539753e3a60a5eca720a500e8128cef7a7 - Code for changing Sec to M, F,T had disappeared
[lperryman] d2dc8b12a011867fd4650a954d186054b5e7769c - Code for changing Sec to M, F,T had disappeared
[lperryman] 9cabfdb37e5528e356cc5a403da469480abdbc95 - Code for changing Sec to M, F,T had disappeared
[lperryman] 8e4ce46562a729ec80a4cec42ce7fd58455fa62c - Changing Sample Size in columns.csv to a measure and a number
[lperryman] 3c6df49054b927e50726c7fe30e63376cf28c106 - Adding a Measure Type column to my datasets
[vtula2000] 9ad5368fa24ae3a5a54cc107c43165ccaf2a23bb - Tidy data
[lperryman] 708323b3b7eb7182cd26611972370c3d8011b697 - Adding a Marker column to dataset and to columns.csv file
[Alex Tucker] 167ac3bd3b6ba3512c4de29282f8b64f0108d551 - Ignore ipynb notebooks, keep the Python instead.
[noreply] 21e12e901a0c5a4ad10aed35887a7b26b00709aa - Update columns.csv
[lperryman] 0e2c6a47031616dd61777f92258850f26495615b - Adding a Marker column to dataset and to columns.csv file
[noreply] aa434283bd91c9d5ad7be9de2965b521fda2541d - Update columns.csv
[noreply] 50b1dfe507de8c180b70d93628ebae6ce2fc46fa - Update columns.csv
[vtula2000] 7718b7c0ee713db5f231d406db7d97cd20ef8ce0 - url update
[noreply] 315ddf8cbcb9cc73b86831887a80606b176dfdde - Add files via upload
[noreply] 41e921f7bb35d0775135ee5ffb5909f6babbde42 - Add files via upload
[noreply] 5b0c145139019d96fb731f2fd297a0fa9b8c86d9 - Update columns.csv
[noreply] 3f64f2919b1f30b0b56e1f3fa0b4cf65efcb5dd5 - Update columns.csv
[Alex Tucker] aef10226c53c5e8a5e401a950b5f2c56dba4066c - Add some validation for columns.csv
[lperryman] fdb28502bdb82b76a6f9d6638953c2a56322ce7c - Adding Marker to comnponents.csv file
[lperryman] b9c55f7d948c14b24a649b2a3aa18a523efa5c16 - Adding Marker codelist file
[noreply] fcc1e1e5b7c9e4cfc5fcdb5e6730543977197d8d - Update codelists-metadata.json
[noreply] 14c69f2bb386d89338c4f87512bc43062cf4f9ba - Update main.py
[Grace Spitzer-Wong] a2cec17e509749a9352d326dd5fe7abdb703e2e9 - codelist renamed
[Alex Tucker] 991666338c05dfeae4e8aaa1b33044a03136b8b2 - Cleaned up some (, ), _, - and space chars.
[Alex Tucker] c80bf8f6082cb498f5db45163dedef67ef4d8850 - Removed some double hyphens for compatibility with the way gssutils pathify() turns labels into URL paths.
No changes
[Alex Tucker] 1f3bc6a4192a314eebb538fb3df22f48ab10c488 - Fix csvlints in codelists-metadata.json
[Alex Tucker] c3ed524eefafe973fa79e7e1efcced6d98bd463c - Unix filenames are case sensitive. Make codes consistent with gssutils pathify() function.
[Alex Tucker] 6502a4f6bb75498fe85c4aeb4d0bc9be2479d2df - Ensure CSV files have CRLF line endings.
[Alex Tucker] b943367c13180b1303686d63185390b505ddfae6 - Remove duplicate list. Re-order codelists metadata to check that all the codelists are listed and add any missing.
[Alex Tucker] c5192a273390881515405d7ce7367896cd09000f - Check columns.csv against schema.
[Alex Tucker] e73ae1f8138834830da9923f4f00cb7f3586424b - Add schema for components.csv and update tests.
[Alex Tucker] 6a14b50dbb530df024cb1cb056ad3fef09ce979c - Try putting hard quotes around filename to cope with special shell chars.
[Alex Tucker] efba49cceef190108778c71654b7137627362eaf - Add 'Count' measure type.
[noreply] 250cc46bdc95c5fc5affa612c3ca1c3042f579da - Update columns.csv
[lperryman] f7b973736f5aa1149844059185b2052425df292b - Removing spaces in column Measure Type
[noreply] 9e759c863fa0d8fa1ba058c4cdbb599bc0b4f47e - Update codelists-metadata.json
[noreply] a452dfcf68b6dfdddb429ae7550637f8a62c40db - Update codelists-metadata.json
[lperryman] 5f6c118b551b51545dc35b2b48acb8876519ad2b - Removing spaces in column Measure Type
[Alex Tucker] 181d7de5f1ccae6d03169a68bda82bc46c7984e9 - Value column needs a special definition as it gets 'pivotted'.
[noreply] 31bf0ad1fb9fd1d4302992f3287d69d3e9d4e19b - Pathify Value column of Identified-Support-Needs-of-Homeless-Households-2018-19 table
[noreply] 0c94c2c7be7d9817f85574a3761d21d405f98a18 - Update Charts.py
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 937 lines...]
806. too_many_values. Row: 267. Percent
807. format. Row: 268,3. Social/behavioural
808. invalid_number. Row: 268,6. Percentage
809. too_many_values. Row: 268. Percent
810. format. Row: 269,3. Social/behavioural
811. invalid_number. Row: 269,6. Percentage
812. too_many_values. Row: 269. Percent
813. format. Row: 270,3. Other
814. invalid_number. Row: 270,6. Percentage
815. too_many_values. Row: 270. Percent
816. format. Row: 271,3. Other
817. invalid_number. Row: 271,6. Percentage
818. too_many_values. Row: 271. Percent
819. format. Row: 272,3. Other
820. invalid_number. Row: 272,6. Percentage
821. too_many_values. Row: 272. Percent
822. format. Row: 273,3. Other
823. invalid_number. Row: 273,6. Percentage
824. too_many_values. Row: 273. Percent
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 eb05ac4a28c00364c950144eb7a8d7e9933e27a9b21c44316d90b573a5b02892
$ docker rm -f eb05ac4a28c00364c950144eb7a8d7e9933e27a9b21c44316d90b573a5b02892
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes No changes No changes
[Alex Tucker] 516eb5ee94da99618bf476c56c3e6517c2482083 - Remove old special case for when out/observations.csv exists.
[Alex Tucker] 6820fef84d1c73bbfb16d07f87259afa096c4cbc - Fix ragged rows. Use DOS line endings as that's what text/* mimetypes should do.
[lperryman] f961b501f993b6801d5d1bbfec841d36350e64a3 - datasets/DWP-Family-Resources-Survey-Carer/main.py had all the wrong formatting for some reason so changed
[lperryman] 22b78bfeee1cd7bcf5833e739f418c8b211490ae - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[lperryman] 1f3e2fec7a6f13c5c0ea02bcf96e77170ac62fd8 - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[mikelovesbooks] 386eaf2559c7547c0ebc252327f160425470eba3 - added temporary manual trig file
[mikelovesbooks] a4e72e6d296eadf60ec9f43ea295284b1617b341 - updated PHE codelists
[mikelovesbooks] 92e9710cf77d6567a2422f330be4da61b8692203 - data from fingertips
[mikelovesbooks] 4dce0948a896af31013ae2554cab5d6a2b918dfe - remove old local data csv
[noreply] cffc20ac58d99cf982d93f417a6b5fc75915d639 - Delete main.ipynb
[noreply] 87ede54c0396e304ac5d372aa71eba0024f0e2d3 - Delete Jenkinsfile
[shannon1995black] be84d9fdec016c03bf7de6c1597c64218621d99a - update naming
[noreply] 928e88d31a7b985e10d265e871871edd92f9aa66 - remove unnecessary time period entry
[lperryman] 4431431355ab317f4d9aa3db8ce695cfb9c130ee - Adding rows to the components csv file
[shannon1995black] b4d0f885f6084447ec8add6ed66d3affc161332d - update main
[lperryman] 037a500fa0ea442f64b9e87949b519ac5c672e43 - Sorting ourt the schema file
[lperryman] d7079738021323d7aba78930006122c17eb2adb9 - Had a capital i one of the column headings when it should have been lower case!
[shannon1995black] 8260ab10b2288609275aa23585d28cc77faff340 - updates
[shannon1995black] 7871ceb8e22f7205829a9ca14da022fa0b86c374 - updated json file
[lperryman] 417d7d297486f1e7780b1ad3d26cfda4a37158f5 - Adding Period to columns.csv
[lperryman] 44e902bc5d106ebfa2eb318e4c64c528c42b5be4 - Getting rid of capital letter in one of the columns
[shannon1995black] af39b43f7fb1c3cbdce95f106bb5c8f81f7e5781 - update column name
[shannon1995black] 3a1135fd0c90a4d0174833f051dd372379ab2c69 - uncomment line to create observations.csv-schema.json
[lperryman] 78c14f03098459533da8df4fb7f970caf2d8f71b - Fixing columns.csv
[lperryman] 74a2b37b464c294dbeb19e5f4e41afdfb39c7ff0 - FIxing columns.csv
[lperryman] cdddeee62af46cccbf93274988364109ffd6e672 - FIxing columns.csv
[lperryman] 632a12b75329e5474b55649a26086f0753e8124a - FIxing columns.csv
[lperryman] 3ce5b581d49b56746c235eb25b055991cc7356da - FIxing columns.csv
[lperryman] bb77f055a6aff4914c2d2652efd5fd1b59149d8a - FIxing columns.csv
[Alex Tucker] 6f1cce14484ed02ddb7103995dd8cdd7c8f33cbe - Output dataset metadata and schema.
[lperryman] da8845089d902d7315ba221997bd3b7e2e087173 - FIxing columns.csv
[shannon1995black] 400c47b3af5219f66d019ca206d93bb598b25ad8 - updated value transformation type
[shannon1995black] b7f3b191dc4995a7ba3e2771a7f2bd00f9879e2d - title to uppercase
[lperryman] 513d057cabaf3c9b6e6297f7ae76f28063793427 - Change Year to period and formatted string to represent for 2 year period
[noreply] 3c54f0603efb9580f0cbd92741e32dda7c7bb283 - Update columns.csv
[lperryman] 30c46612e03dd759f8e62f92d5f5b0e880f3a6cb - Adding metadat data to codelists-metadata.json
[noreply] a2a2785da01e4297a272d42e5f8d4bb04f9fcd68 - Update codelists-metadata.json
[lperryman] 38454c78864e493cc8b9e456146933f8f746a75f - Adding trig files to output
[lperryman] d4778471823f9ed5dd602707e52556f97b572a94 - Adding trig files to output
[Alex Tucker] 0ecd7ef459fd07b8a337339d04a9d817502f4f4e - Use "landingPage" and "datasetNotes" for finding datasets/distributions.
[noreply] 3f797e6b294d01511a819e1c33d5116d84fe0024 - Update columns.csv
[lperryman] 86ee83e73743f19fa95788b2592a5c9b5c5302d0 - Adding trig files to output
[lperryman] f39704e62b7304dabe87fe5389c78b82fe57c41a - Replaceing empyt Value columns with 0
[lperryman] 267336c9e6821ecc18596392fa88d6986d9cf70f - Replaceing empyt Value columns with 0
[Grace Spitzer-Wong] aaf7c19ca60b42587a6e1a039d0c4fb2cc3d081f - Created codelist for SEN school types
[Grace Spitzer-Wong] 52e7b36436296f4c8eebebfe292d530f66a596d0 - removing spaces
[Alex Tucker] b2662d587b4af754555899f1ac626e0440ca95aa - Adding FRS Age Group dimension and Percentage of People measure for #10
[noreply] b492ad4b862db862312640ab25cc56db4bbe5ca0 - Update columns.csv
[noreply] 37dc236e927d6900104707f0d2876ecf4b5938c2 - Update columns.csv
[noreply] 8ca2458eee5788fe905e21a191a5c8e4f73d7bb6 - Update columns.csv
[noreply] cd212b405f2bc56b3f2fd07701e71c2fd31b6b84 - Update columns.csv
[noreply] 6e6653590b313072368b37b3dbe7caff64d4c091 - Update columns.csv
[noreply] 6f9391a76c71e50bb39aced28805df7c59f36ed6 - Update columns.csv
[noreply] 13659a5c5674e456e204d6fcfc91b109b1fe09bd - Update columns.csv
[Alex Tucker] ae198a177b6726a760e84b9dc3a06cb0d3aadc74 - Check scraper works from landingPage
[Alex Tucker] 4eabf140b4ee6169608b523db24e14f152d41c1d - Check scraper works from landingPage
[lperryman] 3ea3ab539753e3a60a5eca720a500e8128cef7a7 - Code for changing Sec to M, F,T had disappeared
[lperryman] d2dc8b12a011867fd4650a954d186054b5e7769c - Code for changing Sec to M, F,T had disappeared
[lperryman] 9cabfdb37e5528e356cc5a403da469480abdbc95 - Code for changing Sec to M, F,T had disappeared
[lperryman] 8e4ce46562a729ec80a4cec42ce7fd58455fa62c - Changing Sample Size in columns.csv to a measure and a number
[lperryman] 3c6df49054b927e50726c7fe30e63376cf28c106 - Adding a Measure Type column to my datasets
[vtula2000] 9ad5368fa24ae3a5a54cc107c43165ccaf2a23bb - Tidy data
[lperryman] 708323b3b7eb7182cd26611972370c3d8011b697 - Adding a Marker column to dataset and to columns.csv file
[Alex Tucker] 167ac3bd3b6ba3512c4de29282f8b64f0108d551 - Ignore ipynb notebooks, keep the Python instead.
[noreply] 21e12e901a0c5a4ad10aed35887a7b26b00709aa - Update columns.csv
[lperryman] 0e2c6a47031616dd61777f92258850f26495615b - Adding a Marker column to dataset and to columns.csv file
[noreply] aa434283bd91c9d5ad7be9de2965b521fda2541d - Update columns.csv
[noreply] 50b1dfe507de8c180b70d93628ebae6ce2fc46fa - Update columns.csv
[vtula2000] 7718b7c0ee713db5f231d406db7d97cd20ef8ce0 - url update
[noreply] 315ddf8cbcb9cc73b86831887a80606b176dfdde - Add files via upload
[noreply] 41e921f7bb35d0775135ee5ffb5909f6babbde42 - Add files via upload
[noreply] 5b0c145139019d96fb731f2fd297a0fa9b8c86d9 - Update columns.csv
[noreply] 3f64f2919b1f30b0b56e1f3fa0b4cf65efcb5dd5 - Update columns.csv
[Alex Tucker] aef10226c53c5e8a5e401a950b5f2c56dba4066c - Add some validation for columns.csv
[lperryman] fdb28502bdb82b76a6f9d6638953c2a56322ce7c - Adding Marker to comnponents.csv file
[lperryman] b9c55f7d948c14b24a649b2a3aa18a523efa5c16 - Adding Marker codelist file
[noreply] fcc1e1e5b7c9e4cfc5fcdb5e6730543977197d8d - Update codelists-metadata.json
[noreply] 14c69f2bb386d89338c4f87512bc43062cf4f9ba - Update main.py
[Grace Spitzer-Wong] a2cec17e509749a9352d326dd5fe7abdb703e2e9 - codelist renamed
[Alex Tucker] 991666338c05dfeae4e8aaa1b33044a03136b8b2 - Cleaned up some (, ), _, - and space chars.
[Alex Tucker] c80bf8f6082cb498f5db45163dedef67ef4d8850 - Removed some double hyphens for compatibility with the way gssutils pathify() turns labels into URL paths.
No changes
[Alex Tucker] 1f3bc6a4192a314eebb538fb3df22f48ab10c488 - Fix csvlints in codelists-metadata.json
[Alex Tucker] c3ed524eefafe973fa79e7e1efcced6d98bd463c - Unix filenames are case sensitive. Make codes consistent with gssutils pathify() function.
[Alex Tucker] 6502a4f6bb75498fe85c4aeb4d0bc9be2479d2df - Ensure CSV files have CRLF line endings.
[Alex Tucker] b943367c13180b1303686d63185390b505ddfae6 - Remove duplicate list. Re-order codelists metadata to check that all the codelists are listed and add any missing.
[Alex Tucker] c5192a273390881515405d7ce7367896cd09000f - Check columns.csv against schema.
[Alex Tucker] e73ae1f8138834830da9923f4f00cb7f3586424b - Add schema for components.csv and update tests.
[Alex Tucker] 6a14b50dbb530df024cb1cb056ad3fef09ce979c - Try putting hard quotes around filename to cope with special shell chars.
[Alex Tucker] efba49cceef190108778c71654b7137627362eaf - Add 'Count' measure type.
[noreply] 250cc46bdc95c5fc5affa612c3ca1c3042f579da - Update columns.csv
[lperryman] f7b973736f5aa1149844059185b2052425df292b - Removing spaces in column Measure Type
[noreply] 9e759c863fa0d8fa1ba058c4cdbb599bc0b4f47e - Update codelists-metadata.json
[noreply] a452dfcf68b6dfdddb429ae7550637f8a62c40db - Update codelists-metadata.json
[lperryman] 5f6c118b551b51545dc35b2b48acb8876519ad2b - Removing spaces in column Measure Type
[Alex Tucker] 181d7de5f1ccae6d03169a68bda82bc46c7984e9 - Value column needs a special definition as it gets 'pivotted'.
[noreply] 31bf0ad1fb9fd1d4302992f3287d69d3e9d4e19b - Pathify Value column of Identified-Support-Needs-of-Homeless-Households-2018-19 table
[noreply] 0c94c2c7be7d9817f85574a3761d21d405f98a18 - Update Charts.py
[noreply] 2bdefdfb31038d53be0412c45f3322615394e438 - Pathify-ing columns
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 935 lines...]
806. too_many_values. Row: 267. Percent
807. format. Row: 268,3. Social/behavioural
808. invalid_number. Row: 268,6. Percentage
809. too_many_values. Row: 268. Percent
810. format. Row: 269,3. Social/behavioural
811. invalid_number. Row: 269,6. Percentage
812. too_many_values. Row: 269. Percent
813. format. Row: 270,3. Other
814. invalid_number. Row: 270,6. Percentage
815. too_many_values. Row: 270. Percent
816. format. Row: 271,3. Other
817. invalid_number. Row: 271,6. Percentage
818. too_many_values. Row: 271. Percent
819. format. Row: 272,3. Other
820. invalid_number. Row: 272,6. Percentage
821. too_many_values. Row: 272. Percent
822. format. Row: 273,3. Other
823. invalid_number. Row: 273,6. Percentage
824. too_many_values. Row: 273. Percent
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 2f8b5967106408b3c56cc62f9d5f9fea3e3e718661f3844cc3ec1eebd1004ef7
$ docker rm -f 2f8b5967106408b3c56cc62f9d5f9fea3e3e718661f3844cc3ec1eebd1004ef7
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes No changes No changes
[Alex Tucker] 516eb5ee94da99618bf476c56c3e6517c2482083 - Remove old special case for when out/observations.csv exists.
[Alex Tucker] 6820fef84d1c73bbfb16d07f87259afa096c4cbc - Fix ragged rows. Use DOS line endings as that's what text/* mimetypes should do.
[lperryman] f961b501f993b6801d5d1bbfec841d36350e64a3 - datasets/DWP-Family-Resources-Survey-Carer/main.py had all the wrong formatting for some reason so changed
[lperryman] 22b78bfeee1cd7bcf5833e739f418c8b211490ae - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[lperryman] 1f3e2fec7a6f13c5c0ea02bcf96e77170ac62fd8 - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[mikelovesbooks] 386eaf2559c7547c0ebc252327f160425470eba3 - added temporary manual trig file
[mikelovesbooks] a4e72e6d296eadf60ec9f43ea295284b1617b341 - updated PHE codelists
[mikelovesbooks] 92e9710cf77d6567a2422f330be4da61b8692203 - data from fingertips
[mikelovesbooks] 4dce0948a896af31013ae2554cab5d6a2b918dfe - remove old local data csv
[noreply] cffc20ac58d99cf982d93f417a6b5fc75915d639 - Delete main.ipynb
[noreply] 87ede54c0396e304ac5d372aa71eba0024f0e2d3 - Delete Jenkinsfile
[shannon1995black] be84d9fdec016c03bf7de6c1597c64218621d99a - update naming
[noreply] 928e88d31a7b985e10d265e871871edd92f9aa66 - remove unnecessary time period entry
[lperryman] 4431431355ab317f4d9aa3db8ce695cfb9c130ee - Adding rows to the components csv file
[shannon1995black] b4d0f885f6084447ec8add6ed66d3affc161332d - update main
[lperryman] 037a500fa0ea442f64b9e87949b519ac5c672e43 - Sorting ourt the schema file
[lperryman] d7079738021323d7aba78930006122c17eb2adb9 - Had a capital i one of the column headings when it should have been lower case!
[shannon1995black] 8260ab10b2288609275aa23585d28cc77faff340 - updates
[shannon1995black] 7871ceb8e22f7205829a9ca14da022fa0b86c374 - updated json file
[lperryman] 417d7d297486f1e7780b1ad3d26cfda4a37158f5 - Adding Period to columns.csv
[lperryman] 44e902bc5d106ebfa2eb318e4c64c528c42b5be4 - Getting rid of capital letter in one of the columns
[shannon1995black] af39b43f7fb1c3cbdce95f106bb5c8f81f7e5781 - update column name
[shannon1995black] 3a1135fd0c90a4d0174833f051dd372379ab2c69 - uncomment line to create observations.csv-schema.json
[lperryman] 78c14f03098459533da8df4fb7f970caf2d8f71b - Fixing columns.csv
[lperryman] 74a2b37b464c294dbeb19e5f4e41afdfb39c7ff0 - FIxing columns.csv
[lperryman] cdddeee62af46cccbf93274988364109ffd6e672 - FIxing columns.csv
[lperryman] 632a12b75329e5474b55649a26086f0753e8124a - FIxing columns.csv
[lperryman] 3ce5b581d49b56746c235eb25b055991cc7356da - FIxing columns.csv
[lperryman] bb77f055a6aff4914c2d2652efd5fd1b59149d8a - FIxing columns.csv
[Alex Tucker] 6f1cce14484ed02ddb7103995dd8cdd7c8f33cbe - Output dataset metadata and schema.
[lperryman] da8845089d902d7315ba221997bd3b7e2e087173 - FIxing columns.csv
[shannon1995black] 400c47b3af5219f66d019ca206d93bb598b25ad8 - updated value transformation type
[shannon1995black] b7f3b191dc4995a7ba3e2771a7f2bd00f9879e2d - title to uppercase
[lperryman] 513d057cabaf3c9b6e6297f7ae76f28063793427 - Change Year to period and formatted string to represent for 2 year period
[noreply] 3c54f0603efb9580f0cbd92741e32dda7c7bb283 - Update columns.csv
[lperryman] 30c46612e03dd759f8e62f92d5f5b0e880f3a6cb - Adding metadat data to codelists-metadata.json
[noreply] a2a2785da01e4297a272d42e5f8d4bb04f9fcd68 - Update codelists-metadata.json
[lperryman] 38454c78864e493cc8b9e456146933f8f746a75f - Adding trig files to output
[lperryman] d4778471823f9ed5dd602707e52556f97b572a94 - Adding trig files to output
[Alex Tucker] 0ecd7ef459fd07b8a337339d04a9d817502f4f4e - Use "landingPage" and "datasetNotes" for finding datasets/distributions.
[noreply] 3f797e6b294d01511a819e1c33d5116d84fe0024 - Update columns.csv
[lperryman] 86ee83e73743f19fa95788b2592a5c9b5c5302d0 - Adding trig files to output
[lperryman] f39704e62b7304dabe87fe5389c78b82fe57c41a - Replaceing empyt Value columns with 0
[lperryman] 267336c9e6821ecc18596392fa88d6986d9cf70f - Replaceing empyt Value columns with 0
[Grace Spitzer-Wong] aaf7c19ca60b42587a6e1a039d0c4fb2cc3d081f - Created codelist for SEN school types
[Grace Spitzer-Wong] 52e7b36436296f4c8eebebfe292d530f66a596d0 - removing spaces
[Alex Tucker] b2662d587b4af754555899f1ac626e0440ca95aa - Adding FRS Age Group dimension and Percentage of People measure for #10
[noreply] b492ad4b862db862312640ab25cc56db4bbe5ca0 - Update columns.csv
[noreply] 37dc236e927d6900104707f0d2876ecf4b5938c2 - Update columns.csv
[noreply] 8ca2458eee5788fe905e21a191a5c8e4f73d7bb6 - Update columns.csv
[noreply] cd212b405f2bc56b3f2fd07701e71c2fd31b6b84 - Update columns.csv
[noreply] 6e6653590b313072368b37b3dbe7caff64d4c091 - Update columns.csv
[noreply] 6f9391a76c71e50bb39aced28805df7c59f36ed6 - Update columns.csv
[noreply] 13659a5c5674e456e204d6fcfc91b109b1fe09bd - Update columns.csv
[Alex Tucker] ae198a177b6726a760e84b9dc3a06cb0d3aadc74 - Check scraper works from landingPage
[Alex Tucker] 4eabf140b4ee6169608b523db24e14f152d41c1d - Check scraper works from landingPage
[lperryman] 3ea3ab539753e3a60a5eca720a500e8128cef7a7 - Code for changing Sec to M, F,T had disappeared
[lperryman] d2dc8b12a011867fd4650a954d186054b5e7769c - Code for changing Sec to M, F,T had disappeared
[lperryman] 9cabfdb37e5528e356cc5a403da469480abdbc95 - Code for changing Sec to M, F,T had disappeared
[lperryman] 8e4ce46562a729ec80a4cec42ce7fd58455fa62c - Changing Sample Size in columns.csv to a measure and a number
[lperryman] 3c6df49054b927e50726c7fe30e63376cf28c106 - Adding a Measure Type column to my datasets
[vtula2000] 9ad5368fa24ae3a5a54cc107c43165ccaf2a23bb - Tidy data
[lperryman] 708323b3b7eb7182cd26611972370c3d8011b697 - Adding a Marker column to dataset and to columns.csv file
[Alex Tucker] 167ac3bd3b6ba3512c4de29282f8b64f0108d551 - Ignore ipynb notebooks, keep the Python instead.
[noreply] 21e12e901a0c5a4ad10aed35887a7b26b00709aa - Update columns.csv
[lperryman] 0e2c6a47031616dd61777f92258850f26495615b - Adding a Marker column to dataset and to columns.csv file
[noreply] aa434283bd91c9d5ad7be9de2965b521fda2541d - Update columns.csv
[noreply] 50b1dfe507de8c180b70d93628ebae6ce2fc46fa - Update columns.csv
[vtula2000] 7718b7c0ee713db5f231d406db7d97cd20ef8ce0 - url update
[noreply] 315ddf8cbcb9cc73b86831887a80606b176dfdde - Add files via upload
[noreply] 41e921f7bb35d0775135ee5ffb5909f6babbde42 - Add files via upload
[noreply] 5b0c145139019d96fb731f2fd297a0fa9b8c86d9 - Update columns.csv
[noreply] 3f64f2919b1f30b0b56e1f3fa0b4cf65efcb5dd5 - Update columns.csv
[Alex Tucker] aef10226c53c5e8a5e401a950b5f2c56dba4066c - Add some validation for columns.csv
[lperryman] fdb28502bdb82b76a6f9d6638953c2a56322ce7c - Adding Marker to comnponents.csv file
[lperryman] b9c55f7d948c14b24a649b2a3aa18a523efa5c16 - Adding Marker codelist file
[noreply] fcc1e1e5b7c9e4cfc5fcdb5e6730543977197d8d - Update codelists-metadata.json
[noreply] 14c69f2bb386d89338c4f87512bc43062cf4f9ba - Update main.py
[Grace Spitzer-Wong] a2cec17e509749a9352d326dd5fe7abdb703e2e9 - codelist renamed
[Alex Tucker] 991666338c05dfeae4e8aaa1b33044a03136b8b2 - Cleaned up some (, ), _, - and space chars.
[Alex Tucker] c80bf8f6082cb498f5db45163dedef67ef4d8850 - Removed some double hyphens for compatibility with the way gssutils pathify() turns labels into URL paths.
No changes
[Alex Tucker] 1f3bc6a4192a314eebb538fb3df22f48ab10c488 - Fix csvlints in codelists-metadata.json
[Alex Tucker] c3ed524eefafe973fa79e7e1efcced6d98bd463c - Unix filenames are case sensitive. Make codes consistent with gssutils pathify() function.
[Alex Tucker] 6502a4f6bb75498fe85c4aeb4d0bc9be2479d2df - Ensure CSV files have CRLF line endings.
[Alex Tucker] b943367c13180b1303686d63185390b505ddfae6 - Remove duplicate list. Re-order codelists metadata to check that all the codelists are listed and add any missing.
[Alex Tucker] c5192a273390881515405d7ce7367896cd09000f - Check columns.csv against schema.
[Alex Tucker] e73ae1f8138834830da9923f4f00cb7f3586424b - Add schema for components.csv and update tests.
[Alex Tucker] 6a14b50dbb530df024cb1cb056ad3fef09ce979c - Try putting hard quotes around filename to cope with special shell chars.
[Alex Tucker] efba49cceef190108778c71654b7137627362eaf - Add 'Count' measure type.
[noreply] 250cc46bdc95c5fc5affa612c3ca1c3042f579da - Update columns.csv
[lperryman] f7b973736f5aa1149844059185b2052425df292b - Removing spaces in column Measure Type
[noreply] 9e759c863fa0d8fa1ba058c4cdbb599bc0b4f47e - Update codelists-metadata.json
[noreply] a452dfcf68b6dfdddb429ae7550637f8a62c40db - Update codelists-metadata.json
[lperryman] 5f6c118b551b51545dc35b2b48acb8876519ad2b - Removing spaces in column Measure Type
[Alex Tucker] 181d7de5f1ccae6d03169a68bda82bc46c7984e9 - Value column needs a special definition as it gets 'pivotted'.
[noreply] 31bf0ad1fb9fd1d4302992f3287d69d3e9d4e19b - Pathify Value column of Identified-Support-Needs-of-Homeless-Households-2018-19 table
[noreply] 0c94c2c7be7d9817f85574a3761d21d405f98a18 - Update Charts.py
[noreply] 2bdefdfb31038d53be0412c45f3322615394e438 - Pathify-ing columns
[noreply] eb63def56680cbf4b2dc8c3940fc1d4cb62b53a6 - Create Reason(s) for failing to maintain accommodation
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 937 lines...]
806. too_many_values. Row: 267. Percent
807. format. Row: 268,3. Social/behavioural
808. invalid_number. Row: 268,6. Percentage
809. too_many_values. Row: 268. Percent
810. format. Row: 269,3. Social/behavioural
811. invalid_number. Row: 269,6. Percentage
812. too_many_values. Row: 269. Percent
813. format. Row: 270,3. Other
814. invalid_number. Row: 270,6. Percentage
815. too_many_values. Row: 270. Percent
816. format. Row: 271,3. Other
817. invalid_number. Row: 271,6. Percentage
818. too_many_values. Row: 271. Percent
819. format. Row: 272,3. Other
820. invalid_number. Row: 272,6. Percentage
821. too_many_values. Row: 272. Percent
822. format. Row: 273,3. Other
823. invalid_number. Row: 273,6. Percentage
824. too_many_values. Row: 273. Percent
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 55692716d4dcf3bd0f0ab105d578abc5c3b9744c21b14a1704bf7d8d53878cf4
$ docker rm -f 55692716d4dcf3bd0f0ab105d578abc5c3b9744c21b14a1704bf7d8d53878cf4
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes No changes No changes
[Alex Tucker] 516eb5ee94da99618bf476c56c3e6517c2482083 - Remove old special case for when out/observations.csv exists.
[Alex Tucker] 6820fef84d1c73bbfb16d07f87259afa096c4cbc - Fix ragged rows. Use DOS line endings as that's what text/* mimetypes should do.
[lperryman] f961b501f993b6801d5d1bbfec841d36350e64a3 - datasets/DWP-Family-Resources-Survey-Carer/main.py had all the wrong formatting for some reason so changed
[lperryman] 22b78bfeee1cd7bcf5833e739f418c8b211490ae - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[lperryman] 1f3e2fec7a6f13c5c0ea02bcf96e77170ac62fd8 - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[mikelovesbooks] 386eaf2559c7547c0ebc252327f160425470eba3 - added temporary manual trig file
[mikelovesbooks] a4e72e6d296eadf60ec9f43ea295284b1617b341 - updated PHE codelists
[mikelovesbooks] 92e9710cf77d6567a2422f330be4da61b8692203 - data from fingertips
[mikelovesbooks] 4dce0948a896af31013ae2554cab5d6a2b918dfe - remove old local data csv
[noreply] cffc20ac58d99cf982d93f417a6b5fc75915d639 - Delete main.ipynb
[noreply] 87ede54c0396e304ac5d372aa71eba0024f0e2d3 - Delete Jenkinsfile
[shannon1995black] be84d9fdec016c03bf7de6c1597c64218621d99a - update naming
[noreply] 928e88d31a7b985e10d265e871871edd92f9aa66 - remove unnecessary time period entry
[lperryman] 4431431355ab317f4d9aa3db8ce695cfb9c130ee - Adding rows to the components csv file
[shannon1995black] b4d0f885f6084447ec8add6ed66d3affc161332d - update main
[lperryman] 037a500fa0ea442f64b9e87949b519ac5c672e43 - Sorting ourt the schema file
[lperryman] d7079738021323d7aba78930006122c17eb2adb9 - Had a capital i one of the column headings when it should have been lower case!
[shannon1995black] 8260ab10b2288609275aa23585d28cc77faff340 - updates
[shannon1995black] 7871ceb8e22f7205829a9ca14da022fa0b86c374 - updated json file
[lperryman] 417d7d297486f1e7780b1ad3d26cfda4a37158f5 - Adding Period to columns.csv
[lperryman] 44e902bc5d106ebfa2eb318e4c64c528c42b5be4 - Getting rid of capital letter in one of the columns
[shannon1995black] af39b43f7fb1c3cbdce95f106bb5c8f81f7e5781 - update column name
[shannon1995black] 3a1135fd0c90a4d0174833f051dd372379ab2c69 - uncomment line to create observations.csv-schema.json
[lperryman] 78c14f03098459533da8df4fb7f970caf2d8f71b - Fixing columns.csv
[lperryman] 74a2b37b464c294dbeb19e5f4e41afdfb39c7ff0 - FIxing columns.csv
[lperryman] cdddeee62af46cccbf93274988364109ffd6e672 - FIxing columns.csv
[lperryman] 632a12b75329e5474b55649a26086f0753e8124a - FIxing columns.csv
[lperryman] 3ce5b581d49b56746c235eb25b055991cc7356da - FIxing columns.csv
[lperryman] bb77f055a6aff4914c2d2652efd5fd1b59149d8a - FIxing columns.csv
[Alex Tucker] 6f1cce14484ed02ddb7103995dd8cdd7c8f33cbe - Output dataset metadata and schema.
[lperryman] da8845089d902d7315ba221997bd3b7e2e087173 - FIxing columns.csv
[shannon1995black] 400c47b3af5219f66d019ca206d93bb598b25ad8 - updated value transformation type
[shannon1995black] b7f3b191dc4995a7ba3e2771a7f2bd00f9879e2d - title to uppercase
[lperryman] 513d057cabaf3c9b6e6297f7ae76f28063793427 - Change Year to period and formatted string to represent for 2 year period
[noreply] 3c54f0603efb9580f0cbd92741e32dda7c7bb283 - Update columns.csv
[lperryman] 30c46612e03dd759f8e62f92d5f5b0e880f3a6cb - Adding metadat data to codelists-metadata.json
[noreply] a2a2785da01e4297a272d42e5f8d4bb04f9fcd68 - Update codelists-metadata.json
[lperryman] 38454c78864e493cc8b9e456146933f8f746a75f - Adding trig files to output
[lperryman] d4778471823f9ed5dd602707e52556f97b572a94 - Adding trig files to output
[Alex Tucker] 0ecd7ef459fd07b8a337339d04a9d817502f4f4e - Use "landingPage" and "datasetNotes" for finding datasets/distributions.
[noreply] 3f797e6b294d01511a819e1c33d5116d84fe0024 - Update columns.csv
[lperryman] 86ee83e73743f19fa95788b2592a5c9b5c5302d0 - Adding trig files to output
[lperryman] f39704e62b7304dabe87fe5389c78b82fe57c41a - Replaceing empyt Value columns with 0
[lperryman] 267336c9e6821ecc18596392fa88d6986d9cf70f - Replaceing empyt Value columns with 0
[Grace Spitzer-Wong] aaf7c19ca60b42587a6e1a039d0c4fb2cc3d081f - Created codelist for SEN school types
[Grace Spitzer-Wong] 52e7b36436296f4c8eebebfe292d530f66a596d0 - removing spaces
[Alex Tucker] b2662d587b4af754555899f1ac626e0440ca95aa - Adding FRS Age Group dimension and Percentage of People measure for #10
[noreply] b492ad4b862db862312640ab25cc56db4bbe5ca0 - Update columns.csv
[noreply] 37dc236e927d6900104707f0d2876ecf4b5938c2 - Update columns.csv
[noreply] 8ca2458eee5788fe905e21a191a5c8e4f73d7bb6 - Update columns.csv
[noreply] cd212b405f2bc56b3f2fd07701e71c2fd31b6b84 - Update columns.csv
[noreply] 6e6653590b313072368b37b3dbe7caff64d4c091 - Update columns.csv
[noreply] 6f9391a76c71e50bb39aced28805df7c59f36ed6 - Update columns.csv
[noreply] 13659a5c5674e456e204d6fcfc91b109b1fe09bd - Update columns.csv
[Alex Tucker] ae198a177b6726a760e84b9dc3a06cb0d3aadc74 - Check scraper works from landingPage
[Alex Tucker] 4eabf140b4ee6169608b523db24e14f152d41c1d - Check scraper works from landingPage
[lperryman] 3ea3ab539753e3a60a5eca720a500e8128cef7a7 - Code for changing Sec to M, F,T had disappeared
[lperryman] d2dc8b12a011867fd4650a954d186054b5e7769c - Code for changing Sec to M, F,T had disappeared
[lperryman] 9cabfdb37e5528e356cc5a403da469480abdbc95 - Code for changing Sec to M, F,T had disappeared
[lperryman] 8e4ce46562a729ec80a4cec42ce7fd58455fa62c - Changing Sample Size in columns.csv to a measure and a number
[lperryman] 3c6df49054b927e50726c7fe30e63376cf28c106 - Adding a Measure Type column to my datasets
[vtula2000] 9ad5368fa24ae3a5a54cc107c43165ccaf2a23bb - Tidy data
[lperryman] 708323b3b7eb7182cd26611972370c3d8011b697 - Adding a Marker column to dataset and to columns.csv file
[Alex Tucker] 167ac3bd3b6ba3512c4de29282f8b64f0108d551 - Ignore ipynb notebooks, keep the Python instead.
[noreply] 21e12e901a0c5a4ad10aed35887a7b26b00709aa - Update columns.csv
[lperryman] 0e2c6a47031616dd61777f92258850f26495615b - Adding a Marker column to dataset and to columns.csv file
[noreply] aa434283bd91c9d5ad7be9de2965b521fda2541d - Update columns.csv
[noreply] 50b1dfe507de8c180b70d93628ebae6ce2fc46fa - Update columns.csv
[vtula2000] 7718b7c0ee713db5f231d406db7d97cd20ef8ce0 - url update
[noreply] 315ddf8cbcb9cc73b86831887a80606b176dfdde - Add files via upload
[noreply] 41e921f7bb35d0775135ee5ffb5909f6babbde42 - Add files via upload
[noreply] 5b0c145139019d96fb731f2fd297a0fa9b8c86d9 - Update columns.csv
[noreply] 3f64f2919b1f30b0b56e1f3fa0b4cf65efcb5dd5 - Update columns.csv
[Alex Tucker] aef10226c53c5e8a5e401a950b5f2c56dba4066c - Add some validation for columns.csv
[lperryman] fdb28502bdb82b76a6f9d6638953c2a56322ce7c - Adding Marker to comnponents.csv file
[lperryman] b9c55f7d948c14b24a649b2a3aa18a523efa5c16 - Adding Marker codelist file
[noreply] fcc1e1e5b7c9e4cfc5fcdb5e6730543977197d8d - Update codelists-metadata.json
[noreply] 14c69f2bb386d89338c4f87512bc43062cf4f9ba - Update main.py
[Grace Spitzer-Wong] a2cec17e509749a9352d326dd5fe7abdb703e2e9 - codelist renamed
[Alex Tucker] 991666338c05dfeae4e8aaa1b33044a03136b8b2 - Cleaned up some (, ), _, - and space chars.
[Alex Tucker] c80bf8f6082cb498f5db45163dedef67ef4d8850 - Removed some double hyphens for compatibility with the way gssutils pathify() turns labels into URL paths.
No changes
[Alex Tucker] 1f3bc6a4192a314eebb538fb3df22f48ab10c488 - Fix csvlints in codelists-metadata.json
[Alex Tucker] c3ed524eefafe973fa79e7e1efcced6d98bd463c - Unix filenames are case sensitive. Make codes consistent with gssutils pathify() function.
[Alex Tucker] 6502a4f6bb75498fe85c4aeb4d0bc9be2479d2df - Ensure CSV files have CRLF line endings.
[Alex Tucker] b943367c13180b1303686d63185390b505ddfae6 - Remove duplicate list. Re-order codelists metadata to check that all the codelists are listed and add any missing.
[Alex Tucker] c5192a273390881515405d7ce7367896cd09000f - Check columns.csv against schema.
[Alex Tucker] e73ae1f8138834830da9923f4f00cb7f3586424b - Add schema for components.csv and update tests.
[Alex Tucker] 6a14b50dbb530df024cb1cb056ad3fef09ce979c - Try putting hard quotes around filename to cope with special shell chars.
[Alex Tucker] efba49cceef190108778c71654b7137627362eaf - Add 'Count' measure type.
[noreply] 250cc46bdc95c5fc5affa612c3ca1c3042f579da - Update columns.csv
[lperryman] f7b973736f5aa1149844059185b2052425df292b - Removing spaces in column Measure Type
[noreply] 9e759c863fa0d8fa1ba058c4cdbb599bc0b4f47e - Update codelists-metadata.json
[noreply] a452dfcf68b6dfdddb429ae7550637f8a62c40db - Update codelists-metadata.json
[lperryman] 5f6c118b551b51545dc35b2b48acb8876519ad2b - Removing spaces in column Measure Type
[Alex Tucker] 181d7de5f1ccae6d03169a68bda82bc46c7984e9 - Value column needs a special definition as it gets 'pivotted'.
[noreply] 31bf0ad1fb9fd1d4302992f3287d69d3e9d4e19b - Pathify Value column of Identified-Support-Needs-of-Homeless-Households-2018-19 table
[noreply] 0c94c2c7be7d9817f85574a3761d21d405f98a18 - Update Charts.py
[noreply] 2bdefdfb31038d53be0412c45f3322615394e438 - Pathify-ing columns
[noreply] eb63def56680cbf4b2dc8c3940fc1d4cb62b53a6 - Create Reason(s) for failing to maintain accommodation
[noreply] 69156efb4788f2630b4110e8603fbeef260b70ce - Rename Reason(s) for failing to maintain accommodation to Reason(s)-for-failing-to-maintain-accommodation
[noreply] 0606e32bf77f9a0ffe08d9a13dcb42cca75555ba - Update Reason(s)-for-failing-to-maintain-accommodation
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 937 lines...]
806. too_many_values. Row: 267. Percent
807. format. Row: 268,3. Social/behavioural
808. invalid_number. Row: 268,6. Percentage
809. too_many_values. Row: 268. Percent
810. format. Row: 269,3. Social/behavioural
811. invalid_number. Row: 269,6. Percentage
812. too_many_values. Row: 269. Percent
813. format. Row: 270,3. Other
814. invalid_number. Row: 270,6. Percentage
815. too_many_values. Row: 270. Percent
816. format. Row: 271,3. Other
817. invalid_number. Row: 271,6. Percentage
818. too_many_values. Row: 271. Percent
819. format. Row: 272,3. Other
820. invalid_number. Row: 272,6. Percentage
821. too_many_values. Row: 272. Percent
822. format. Row: 273,3. Other
823. invalid_number. Row: 273,6. Percentage
824. too_many_values. Row: 273. Percent
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 c56a09fd9fe4f6abe2a2b232dd4c752046be6f74bad883887de03ad504afadea
$ docker rm -f c56a09fd9fe4f6abe2a2b232dd4c752046be6f74bad883887de03ad504afadea
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes No changes No changes
[Alex Tucker] 516eb5ee94da99618bf476c56c3e6517c2482083 - Remove old special case for when out/observations.csv exists.
[Alex Tucker] 6820fef84d1c73bbfb16d07f87259afa096c4cbc - Fix ragged rows. Use DOS line endings as that's what text/* mimetypes should do.
[lperryman] f961b501f993b6801d5d1bbfec841d36350e64a3 - datasets/DWP-Family-Resources-Survey-Carer/main.py had all the wrong formatting for some reason so changed
[lperryman] 22b78bfeee1cd7bcf5833e739f418c8b211490ae - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[lperryman] 1f3e2fec7a6f13c5c0ea02bcf96e77170ac62fd8 - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[mikelovesbooks] 386eaf2559c7547c0ebc252327f160425470eba3 - added temporary manual trig file
[mikelovesbooks] a4e72e6d296eadf60ec9f43ea295284b1617b341 - updated PHE codelists
[mikelovesbooks] 92e9710cf77d6567a2422f330be4da61b8692203 - data from fingertips
[mikelovesbooks] 4dce0948a896af31013ae2554cab5d6a2b918dfe - remove old local data csv
[noreply] cffc20ac58d99cf982d93f417a6b5fc75915d639 - Delete main.ipynb
[noreply] 87ede54c0396e304ac5d372aa71eba0024f0e2d3 - Delete Jenkinsfile
[shannon1995black] be84d9fdec016c03bf7de6c1597c64218621d99a - update naming
[noreply] 928e88d31a7b985e10d265e871871edd92f9aa66 - remove unnecessary time period entry
[lperryman] 4431431355ab317f4d9aa3db8ce695cfb9c130ee - Adding rows to the components csv file
[shannon1995black] b4d0f885f6084447ec8add6ed66d3affc161332d - update main
[lperryman] 037a500fa0ea442f64b9e87949b519ac5c672e43 - Sorting ourt the schema file
[lperryman] d7079738021323d7aba78930006122c17eb2adb9 - Had a capital i one of the column headings when it should have been lower case!
[shannon1995black] 8260ab10b2288609275aa23585d28cc77faff340 - updates
[shannon1995black] 7871ceb8e22f7205829a9ca14da022fa0b86c374 - updated json file
[lperryman] 417d7d297486f1e7780b1ad3d26cfda4a37158f5 - Adding Period to columns.csv
[lperryman] 44e902bc5d106ebfa2eb318e4c64c528c42b5be4 - Getting rid of capital letter in one of the columns
[shannon1995black] af39b43f7fb1c3cbdce95f106bb5c8f81f7e5781 - update column name
[shannon1995black] 3a1135fd0c90a4d0174833f051dd372379ab2c69 - uncomment line to create observations.csv-schema.json
[lperryman] 78c14f03098459533da8df4fb7f970caf2d8f71b - Fixing columns.csv
[lperryman] 74a2b37b464c294dbeb19e5f4e41afdfb39c7ff0 - FIxing columns.csv
[lperryman] cdddeee62af46cccbf93274988364109ffd6e672 - FIxing columns.csv
[lperryman] 632a12b75329e5474b55649a26086f0753e8124a - FIxing columns.csv
[lperryman] 3ce5b581d49b56746c235eb25b055991cc7356da - FIxing columns.csv
[lperryman] bb77f055a6aff4914c2d2652efd5fd1b59149d8a - FIxing columns.csv
[Alex Tucker] 6f1cce14484ed02ddb7103995dd8cdd7c8f33cbe - Output dataset metadata and schema.
[lperryman] da8845089d902d7315ba221997bd3b7e2e087173 - FIxing columns.csv
[shannon1995black] 400c47b3af5219f66d019ca206d93bb598b25ad8 - updated value transformation type
[shannon1995black] b7f3b191dc4995a7ba3e2771a7f2bd00f9879e2d - title to uppercase
[lperryman] 513d057cabaf3c9b6e6297f7ae76f28063793427 - Change Year to period and formatted string to represent for 2 year period
[noreply] 3c54f0603efb9580f0cbd92741e32dda7c7bb283 - Update columns.csv
[lperryman] 30c46612e03dd759f8e62f92d5f5b0e880f3a6cb - Adding metadat data to codelists-metadata.json
[noreply] a2a2785da01e4297a272d42e5f8d4bb04f9fcd68 - Update codelists-metadata.json
[lperryman] 38454c78864e493cc8b9e456146933f8f746a75f - Adding trig files to output
[lperryman] d4778471823f9ed5dd602707e52556f97b572a94 - Adding trig files to output
[Alex Tucker] 0ecd7ef459fd07b8a337339d04a9d817502f4f4e - Use "landingPage" and "datasetNotes" for finding datasets/distributions.
[noreply] 3f797e6b294d01511a819e1c33d5116d84fe0024 - Update columns.csv
[lperryman] 86ee83e73743f19fa95788b2592a5c9b5c5302d0 - Adding trig files to output
[lperryman] f39704e62b7304dabe87fe5389c78b82fe57c41a - Replaceing empyt Value columns with 0
[lperryman] 267336c9e6821ecc18596392fa88d6986d9cf70f - Replaceing empyt Value columns with 0
[Grace Spitzer-Wong] aaf7c19ca60b42587a6e1a039d0c4fb2cc3d081f - Created codelist for SEN school types
[Grace Spitzer-Wong] 52e7b36436296f4c8eebebfe292d530f66a596d0 - removing spaces
[Alex Tucker] b2662d587b4af754555899f1ac626e0440ca95aa - Adding FRS Age Group dimension and Percentage of People measure for #10
[noreply] b492ad4b862db862312640ab25cc56db4bbe5ca0 - Update columns.csv
[noreply] 37dc236e927d6900104707f0d2876ecf4b5938c2 - Update columns.csv
[noreply] 8ca2458eee5788fe905e21a191a5c8e4f73d7bb6 - Update columns.csv
[noreply] cd212b405f2bc56b3f2fd07701e71c2fd31b6b84 - Update columns.csv
[noreply] 6e6653590b313072368b37b3dbe7caff64d4c091 - Update columns.csv
[noreply] 6f9391a76c71e50bb39aced28805df7c59f36ed6 - Update columns.csv
[noreply] 13659a5c5674e456e204d6fcfc91b109b1fe09bd - Update columns.csv
[Alex Tucker] ae198a177b6726a760e84b9dc3a06cb0d3aadc74 - Check scraper works from landingPage
[Alex Tucker] 4eabf140b4ee6169608b523db24e14f152d41c1d - Check scraper works from landingPage
[lperryman] 3ea3ab539753e3a60a5eca720a500e8128cef7a7 - Code for changing Sec to M, F,T had disappeared
[lperryman] d2dc8b12a011867fd4650a954d186054b5e7769c - Code for changing Sec to M, F,T had disappeared
[lperryman] 9cabfdb37e5528e356cc5a403da469480abdbc95 - Code for changing Sec to M, F,T had disappeared
[lperryman] 8e4ce46562a729ec80a4cec42ce7fd58455fa62c - Changing Sample Size in columns.csv to a measure and a number
[lperryman] 3c6df49054b927e50726c7fe30e63376cf28c106 - Adding a Measure Type column to my datasets
[vtula2000] 9ad5368fa24ae3a5a54cc107c43165ccaf2a23bb - Tidy data
[lperryman] 708323b3b7eb7182cd26611972370c3d8011b697 - Adding a Marker column to dataset and to columns.csv file
[Alex Tucker] 167ac3bd3b6ba3512c4de29282f8b64f0108d551 - Ignore ipynb notebooks, keep the Python instead.
[noreply] 21e12e901a0c5a4ad10aed35887a7b26b00709aa - Update columns.csv
[lperryman] 0e2c6a47031616dd61777f92258850f26495615b - Adding a Marker column to dataset and to columns.csv file
[noreply] aa434283bd91c9d5ad7be9de2965b521fda2541d - Update columns.csv
[noreply] 50b1dfe507de8c180b70d93628ebae6ce2fc46fa - Update columns.csv
[vtula2000] 7718b7c0ee713db5f231d406db7d97cd20ef8ce0 - url update
[noreply] 315ddf8cbcb9cc73b86831887a80606b176dfdde - Add files via upload
[noreply] 41e921f7bb35d0775135ee5ffb5909f6babbde42 - Add files via upload
[noreply] 5b0c145139019d96fb731f2fd297a0fa9b8c86d9 - Update columns.csv
[noreply] 3f64f2919b1f30b0b56e1f3fa0b4cf65efcb5dd5 - Update columns.csv
[Alex Tucker] aef10226c53c5e8a5e401a950b5f2c56dba4066c - Add some validation for columns.csv
[lperryman] fdb28502bdb82b76a6f9d6638953c2a56322ce7c - Adding Marker to comnponents.csv file
[lperryman] b9c55f7d948c14b24a649b2a3aa18a523efa5c16 - Adding Marker codelist file
[noreply] fcc1e1e5b7c9e4cfc5fcdb5e6730543977197d8d - Update codelists-metadata.json
[noreply] 14c69f2bb386d89338c4f87512bc43062cf4f9ba - Update main.py
[Grace Spitzer-Wong] a2cec17e509749a9352d326dd5fe7abdb703e2e9 - codelist renamed
[Alex Tucker] 991666338c05dfeae4e8aaa1b33044a03136b8b2 - Cleaned up some (, ), _, - and space chars.
[Alex Tucker] c80bf8f6082cb498f5db45163dedef67ef4d8850 - Removed some double hyphens for compatibility with the way gssutils pathify() turns labels into URL paths.
No changes
[Alex Tucker] 1f3bc6a4192a314eebb538fb3df22f48ab10c488 - Fix csvlints in codelists-metadata.json
[Alex Tucker] c3ed524eefafe973fa79e7e1efcced6d98bd463c - Unix filenames are case sensitive. Make codes consistent with gssutils pathify() function.
[Alex Tucker] 6502a4f6bb75498fe85c4aeb4d0bc9be2479d2df - Ensure CSV files have CRLF line endings.
[Alex Tucker] b943367c13180b1303686d63185390b505ddfae6 - Remove duplicate list. Re-order codelists metadata to check that all the codelists are listed and add any missing.
[Alex Tucker] c5192a273390881515405d7ce7367896cd09000f - Check columns.csv against schema.
[Alex Tucker] e73ae1f8138834830da9923f4f00cb7f3586424b - Add schema for components.csv and update tests.
[Alex Tucker] 6a14b50dbb530df024cb1cb056ad3fef09ce979c - Try putting hard quotes around filename to cope with special shell chars.
[Alex Tucker] efba49cceef190108778c71654b7137627362eaf - Add 'Count' measure type.
[noreply] 250cc46bdc95c5fc5affa612c3ca1c3042f579da - Update columns.csv
[lperryman] f7b973736f5aa1149844059185b2052425df292b - Removing spaces in column Measure Type
[noreply] 9e759c863fa0d8fa1ba058c4cdbb599bc0b4f47e - Update codelists-metadata.json
[noreply] a452dfcf68b6dfdddb429ae7550637f8a62c40db - Update codelists-metadata.json
[lperryman] 5f6c118b551b51545dc35b2b48acb8876519ad2b - Removing spaces in column Measure Type
[Alex Tucker] 181d7de5f1ccae6d03169a68bda82bc46c7984e9 - Value column needs a special definition as it gets 'pivotted'.
[noreply] 31bf0ad1fb9fd1d4302992f3287d69d3e9d4e19b - Pathify Value column of Identified-Support-Needs-of-Homeless-Households-2018-19 table
[noreply] 0c94c2c7be7d9817f85574a3761d21d405f98a18 - Update Charts.py
[noreply] 2bdefdfb31038d53be0412c45f3322615394e438 - Pathify-ing columns
[noreply] eb63def56680cbf4b2dc8c3940fc1d4cb62b53a6 - Create Reason(s) for failing to maintain accommodation
[noreply] 69156efb4788f2630b4110e8603fbeef260b70ce - Rename Reason(s) for failing to maintain accommodation to Reason(s)-for-failing-to-maintain-accommodation
[noreply] 0606e32bf77f9a0ffe08d9a13dcb42cca75555ba - Update Reason(s)-for-failing-to-maintain-accommodation
[noreply] d3cd8401abe0615dcd58ff37a2c76235eeeeaa09 - Rename Reason(s)-for-failing-to-maintain-accommodation to reason(s)-for-failing-to-maintain-accommodation
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 937 lines...]
806. too_many_values. Row: 267. Percent
807. format. Row: 268,3. Social/behavioural
808. invalid_number. Row: 268,6. Percentage
809. too_many_values. Row: 268. Percent
810. format. Row: 269,3. Social/behavioural
811. invalid_number. Row: 269,6. Percentage
812. too_many_values. Row: 269. Percent
813. format. Row: 270,3. Other
814. invalid_number. Row: 270,6. Percentage
815. too_many_values. Row: 270. Percent
816. format. Row: 271,3. Other
817. invalid_number. Row: 271,6. Percentage
818. too_many_values. Row: 271. Percent
819. format. Row: 272,3. Other
820. invalid_number. Row: 272,6. Percentage
821. too_many_values. Row: 272. Percent
822. format. Row: 273,3. Other
823. invalid_number. Row: 273,6. Percentage
824. too_many_values. Row: 273. Percent
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 29e4e0dd0b7f542ddfd970d2a6d9d401f111a86116161f118fa7c6bcf5d77d62
$ docker rm -f 29e4e0dd0b7f542ddfd970d2a6d9d401f111a86116161f118fa7c6bcf5d77d62
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes No changes No changes
[Alex Tucker] 516eb5ee94da99618bf476c56c3e6517c2482083 - Remove old special case for when out/observations.csv exists.
[Alex Tucker] 6820fef84d1c73bbfb16d07f87259afa096c4cbc - Fix ragged rows. Use DOS line endings as that's what text/* mimetypes should do.
[lperryman] f961b501f993b6801d5d1bbfec841d36350e64a3 - datasets/DWP-Family-Resources-Survey-Carer/main.py had all the wrong formatting for some reason so changed
[lperryman] 22b78bfeee1cd7bcf5833e739f418c8b211490ae - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[lperryman] 1f3e2fec7a6f13c5c0ea02bcf96e77170ac62fd8 - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[mikelovesbooks] 386eaf2559c7547c0ebc252327f160425470eba3 - added temporary manual trig file
[mikelovesbooks] a4e72e6d296eadf60ec9f43ea295284b1617b341 - updated PHE codelists
[mikelovesbooks] 92e9710cf77d6567a2422f330be4da61b8692203 - data from fingertips
[mikelovesbooks] 4dce0948a896af31013ae2554cab5d6a2b918dfe - remove old local data csv
[noreply] cffc20ac58d99cf982d93f417a6b5fc75915d639 - Delete main.ipynb
[noreply] 87ede54c0396e304ac5d372aa71eba0024f0e2d3 - Delete Jenkinsfile
[shannon1995black] be84d9fdec016c03bf7de6c1597c64218621d99a - update naming
[noreply] 928e88d31a7b985e10d265e871871edd92f9aa66 - remove unnecessary time period entry
[lperryman] 4431431355ab317f4d9aa3db8ce695cfb9c130ee - Adding rows to the components csv file
[shannon1995black] b4d0f885f6084447ec8add6ed66d3affc161332d - update main
[lperryman] 037a500fa0ea442f64b9e87949b519ac5c672e43 - Sorting ourt the schema file
[lperryman] d7079738021323d7aba78930006122c17eb2adb9 - Had a capital i one of the column headings when it should have been lower case!
[shannon1995black] 8260ab10b2288609275aa23585d28cc77faff340 - updates
[shannon1995black] 7871ceb8e22f7205829a9ca14da022fa0b86c374 - updated json file
[lperryman] 417d7d297486f1e7780b1ad3d26cfda4a37158f5 - Adding Period to columns.csv
[lperryman] 44e902bc5d106ebfa2eb318e4c64c528c42b5be4 - Getting rid of capital letter in one of the columns
[shannon1995black] af39b43f7fb1c3cbdce95f106bb5c8f81f7e5781 - update column name
[shannon1995black] 3a1135fd0c90a4d0174833f051dd372379ab2c69 - uncomment line to create observations.csv-schema.json
[lperryman] 78c14f03098459533da8df4fb7f970caf2d8f71b - Fixing columns.csv
[lperryman] 74a2b37b464c294dbeb19e5f4e41afdfb39c7ff0 - FIxing columns.csv
[lperryman] cdddeee62af46cccbf93274988364109ffd6e672 - FIxing columns.csv
[lperryman] 632a12b75329e5474b55649a26086f0753e8124a - FIxing columns.csv
[lperryman] 3ce5b581d49b56746c235eb25b055991cc7356da - FIxing columns.csv
[lperryman] bb77f055a6aff4914c2d2652efd5fd1b59149d8a - FIxing columns.csv
[Alex Tucker] 6f1cce14484ed02ddb7103995dd8cdd7c8f33cbe - Output dataset metadata and schema.
[lperryman] da8845089d902d7315ba221997bd3b7e2e087173 - FIxing columns.csv
[shannon1995black] 400c47b3af5219f66d019ca206d93bb598b25ad8 - updated value transformation type
[shannon1995black] b7f3b191dc4995a7ba3e2771a7f2bd00f9879e2d - title to uppercase
[lperryman] 513d057cabaf3c9b6e6297f7ae76f28063793427 - Change Year to period and formatted string to represent for 2 year period
[noreply] 3c54f0603efb9580f0cbd92741e32dda7c7bb283 - Update columns.csv
[lperryman] 30c46612e03dd759f8e62f92d5f5b0e880f3a6cb - Adding metadat data to codelists-metadata.json
[noreply] a2a2785da01e4297a272d42e5f8d4bb04f9fcd68 - Update codelists-metadata.json
[lperryman] 38454c78864e493cc8b9e456146933f8f746a75f - Adding trig files to output
[lperryman] d4778471823f9ed5dd602707e52556f97b572a94 - Adding trig files to output
[Alex Tucker] 0ecd7ef459fd07b8a337339d04a9d817502f4f4e - Use "landingPage" and "datasetNotes" for finding datasets/distributions.
[noreply] 3f797e6b294d01511a819e1c33d5116d84fe0024 - Update columns.csv
[lperryman] 86ee83e73743f19fa95788b2592a5c9b5c5302d0 - Adding trig files to output
[lperryman] f39704e62b7304dabe87fe5389c78b82fe57c41a - Replaceing empyt Value columns with 0
[lperryman] 267336c9e6821ecc18596392fa88d6986d9cf70f - Replaceing empyt Value columns with 0
[Grace Spitzer-Wong] aaf7c19ca60b42587a6e1a039d0c4fb2cc3d081f - Created codelist for SEN school types
[Grace Spitzer-Wong] 52e7b36436296f4c8eebebfe292d530f66a596d0 - removing spaces
[Alex Tucker] b2662d587b4af754555899f1ac626e0440ca95aa - Adding FRS Age Group dimension and Percentage of People measure for #10
[noreply] b492ad4b862db862312640ab25cc56db4bbe5ca0 - Update columns.csv
[noreply] 37dc236e927d6900104707f0d2876ecf4b5938c2 - Update columns.csv
[noreply] 8ca2458eee5788fe905e21a191a5c8e4f73d7bb6 - Update columns.csv
[noreply] cd212b405f2bc56b3f2fd07701e71c2fd31b6b84 - Update columns.csv
[noreply] 6e6653590b313072368b37b3dbe7caff64d4c091 - Update columns.csv
[noreply] 6f9391a76c71e50bb39aced28805df7c59f36ed6 - Update columns.csv
[noreply] 13659a5c5674e456e204d6fcfc91b109b1fe09bd - Update columns.csv
[Alex Tucker] ae198a177b6726a760e84b9dc3a06cb0d3aadc74 - Check scraper works from landingPage
[Alex Tucker] 4eabf140b4ee6169608b523db24e14f152d41c1d - Check scraper works from landingPage
[lperryman] 3ea3ab539753e3a60a5eca720a500e8128cef7a7 - Code for changing Sec to M, F,T had disappeared
[lperryman] d2dc8b12a011867fd4650a954d186054b5e7769c - Code for changing Sec to M, F,T had disappeared
[lperryman] 9cabfdb37e5528e356cc5a403da469480abdbc95 - Code for changing Sec to M, F,T had disappeared
[lperryman] 8e4ce46562a729ec80a4cec42ce7fd58455fa62c - Changing Sample Size in columns.csv to a measure and a number
[lperryman] 3c6df49054b927e50726c7fe30e63376cf28c106 - Adding a Measure Type column to my datasets
[vtula2000] 9ad5368fa24ae3a5a54cc107c43165ccaf2a23bb - Tidy data
[lperryman] 708323b3b7eb7182cd26611972370c3d8011b697 - Adding a Marker column to dataset and to columns.csv file
[Alex Tucker] 167ac3bd3b6ba3512c4de29282f8b64f0108d551 - Ignore ipynb notebooks, keep the Python instead.
[noreply] 21e12e901a0c5a4ad10aed35887a7b26b00709aa - Update columns.csv
[lperryman] 0e2c6a47031616dd61777f92258850f26495615b - Adding a Marker column to dataset and to columns.csv file
[noreply] aa434283bd91c9d5ad7be9de2965b521fda2541d - Update columns.csv
[noreply] 50b1dfe507de8c180b70d93628ebae6ce2fc46fa - Update columns.csv
[vtula2000] 7718b7c0ee713db5f231d406db7d97cd20ef8ce0 - url update
[noreply] 315ddf8cbcb9cc73b86831887a80606b176dfdde - Add files via upload
[noreply] 41e921f7bb35d0775135ee5ffb5909f6babbde42 - Add files via upload
[noreply] 5b0c145139019d96fb731f2fd297a0fa9b8c86d9 - Update columns.csv
[noreply] 3f64f2919b1f30b0b56e1f3fa0b4cf65efcb5dd5 - Update columns.csv
[Alex Tucker] aef10226c53c5e8a5e401a950b5f2c56dba4066c - Add some validation for columns.csv
[lperryman] fdb28502bdb82b76a6f9d6638953c2a56322ce7c - Adding Marker to comnponents.csv file
[lperryman] b9c55f7d948c14b24a649b2a3aa18a523efa5c16 - Adding Marker codelist file
[noreply] fcc1e1e5b7c9e4cfc5fcdb5e6730543977197d8d - Update codelists-metadata.json
[noreply] 14c69f2bb386d89338c4f87512bc43062cf4f9ba - Update main.py
[Grace Spitzer-Wong] a2cec17e509749a9352d326dd5fe7abdb703e2e9 - codelist renamed
[Alex Tucker] 991666338c05dfeae4e8aaa1b33044a03136b8b2 - Cleaned up some (, ), _, - and space chars.
[Alex Tucker] c80bf8f6082cb498f5db45163dedef67ef4d8850 - Removed some double hyphens for compatibility with the way gssutils pathify() turns labels into URL paths.
No changes
[Alex Tucker] 1f3bc6a4192a314eebb538fb3df22f48ab10c488 - Fix csvlints in codelists-metadata.json
[Alex Tucker] c3ed524eefafe973fa79e7e1efcced6d98bd463c - Unix filenames are case sensitive. Make codes consistent with gssutils pathify() function.
[Alex Tucker] 6502a4f6bb75498fe85c4aeb4d0bc9be2479d2df - Ensure CSV files have CRLF line endings.
[Alex Tucker] b943367c13180b1303686d63185390b505ddfae6 - Remove duplicate list. Re-order codelists metadata to check that all the codelists are listed and add any missing.
[Alex Tucker] c5192a273390881515405d7ce7367896cd09000f - Check columns.csv against schema.
[Alex Tucker] e73ae1f8138834830da9923f4f00cb7f3586424b - Add schema for components.csv and update tests.
[Alex Tucker] 6a14b50dbb530df024cb1cb056ad3fef09ce979c - Try putting hard quotes around filename to cope with special shell chars.
[Alex Tucker] efba49cceef190108778c71654b7137627362eaf - Add 'Count' measure type.
[noreply] 250cc46bdc95c5fc5affa612c3ca1c3042f579da - Update columns.csv
[lperryman] f7b973736f5aa1149844059185b2052425df292b - Removing spaces in column Measure Type
[noreply] 9e759c863fa0d8fa1ba058c4cdbb599bc0b4f47e - Update codelists-metadata.json
[noreply] a452dfcf68b6dfdddb429ae7550637f8a62c40db - Update codelists-metadata.json
[lperryman] 5f6c118b551b51545dc35b2b48acb8876519ad2b - Removing spaces in column Measure Type
[Alex Tucker] 181d7de5f1ccae6d03169a68bda82bc46c7984e9 - Value column needs a special definition as it gets 'pivotted'.
[noreply] 31bf0ad1fb9fd1d4302992f3287d69d3e9d4e19b - Pathify Value column of Identified-Support-Needs-of-Homeless-Households-2018-19 table
[noreply] 0c94c2c7be7d9817f85574a3761d21d405f98a18 - Update Charts.py
[noreply] 2bdefdfb31038d53be0412c45f3322615394e438 - Pathify-ing columns
[noreply] eb63def56680cbf4b2dc8c3940fc1d4cb62b53a6 - Create Reason(s) for failing to maintain accommodation
[noreply] 69156efb4788f2630b4110e8603fbeef260b70ce - Rename Reason(s) for failing to maintain accommodation to Reason(s)-for-failing-to-maintain-accommodation
[noreply] 0606e32bf77f9a0ffe08d9a13dcb42cca75555ba - Update Reason(s)-for-failing-to-maintain-accommodation
[noreply] d3cd8401abe0615dcd58ff37a2c76235eeeeaa09 - Rename Reason(s)-for-failing-to-maintain-accommodation to reason(s)-for-failing-to-maintain-accommodation
No changes
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 937 lines...]
806. too_many_values. Row: 267. Percent
807. format. Row: 268,3. Social/behavioural
808. invalid_number. Row: 268,6. Percentage
809. too_many_values. Row: 268. Percent
810. format. Row: 269,3. Social/behavioural
811. invalid_number. Row: 269,6. Percentage
812. too_many_values. Row: 269. Percent
813. format. Row: 270,3. Other
814. invalid_number. Row: 270,6. Percentage
815. too_many_values. Row: 270. Percent
816. format. Row: 271,3. Other
817. invalid_number. Row: 271,6. Percentage
818. too_many_values. Row: 271. Percent
819. format. Row: 272,3. Other
820. invalid_number. Row: 272,6. Percentage
821. too_many_values. Row: 272. Percent
822. format. Row: 273,3. Other
823. invalid_number. Row: 273,6. Percentage
824. too_many_values. Row: 273. Percent
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 8f5528d42691bcdcde76dc5e0d218d186de41dc6b5d4b3a249409eec943976a3
$ docker rm -f 8f5528d42691bcdcde76dc5e0d218d186de41dc6b5d4b3a249409eec943976a3
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes No changes No changes
[Alex Tucker] 516eb5ee94da99618bf476c56c3e6517c2482083 - Remove old special case for when out/observations.csv exists.
[Alex Tucker] 6820fef84d1c73bbfb16d07f87259afa096c4cbc - Fix ragged rows. Use DOS line endings as that's what text/* mimetypes should do.
[lperryman] f961b501f993b6801d5d1bbfec841d36350e64a3 - datasets/DWP-Family-Resources-Survey-Carer/main.py had all the wrong formatting for some reason so changed
[lperryman] 22b78bfeee1cd7bcf5833e739f418c8b211490ae - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[lperryman] 1f3e2fec7a6f13c5c0ea02bcf96e77170ac62fd8 - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[mikelovesbooks] 386eaf2559c7547c0ebc252327f160425470eba3 - added temporary manual trig file
[mikelovesbooks] a4e72e6d296eadf60ec9f43ea295284b1617b341 - updated PHE codelists
[mikelovesbooks] 92e9710cf77d6567a2422f330be4da61b8692203 - data from fingertips
[mikelovesbooks] 4dce0948a896af31013ae2554cab5d6a2b918dfe - remove old local data csv
[noreply] cffc20ac58d99cf982d93f417a6b5fc75915d639 - Delete main.ipynb
[noreply] 87ede54c0396e304ac5d372aa71eba0024f0e2d3 - Delete Jenkinsfile
[shannon1995black] be84d9fdec016c03bf7de6c1597c64218621d99a - update naming
[noreply] 928e88d31a7b985e10d265e871871edd92f9aa66 - remove unnecessary time period entry
[lperryman] 4431431355ab317f4d9aa3db8ce695cfb9c130ee - Adding rows to the components csv file
[shannon1995black] b4d0f885f6084447ec8add6ed66d3affc161332d - update main
[lperryman] 037a500fa0ea442f64b9e87949b519ac5c672e43 - Sorting ourt the schema file
[lperryman] d7079738021323d7aba78930006122c17eb2adb9 - Had a capital i one of the column headings when it should have been lower case!
[shannon1995black] 8260ab10b2288609275aa23585d28cc77faff340 - updates
[shannon1995black] 7871ceb8e22f7205829a9ca14da022fa0b86c374 - updated json file
[lperryman] 417d7d297486f1e7780b1ad3d26cfda4a37158f5 - Adding Period to columns.csv
[lperryman] 44e902bc5d106ebfa2eb318e4c64c528c42b5be4 - Getting rid of capital letter in one of the columns
[shannon1995black] af39b43f7fb1c3cbdce95f106bb5c8f81f7e5781 - update column name
[shannon1995black] 3a1135fd0c90a4d0174833f051dd372379ab2c69 - uncomment line to create observations.csv-schema.json
[lperryman] 78c14f03098459533da8df4fb7f970caf2d8f71b - Fixing columns.csv
[lperryman] 74a2b37b464c294dbeb19e5f4e41afdfb39c7ff0 - FIxing columns.csv
[lperryman] cdddeee62af46cccbf93274988364109ffd6e672 - FIxing columns.csv
[lperryman] 632a12b75329e5474b55649a26086f0753e8124a - FIxing columns.csv
[lperryman] 3ce5b581d49b56746c235eb25b055991cc7356da - FIxing columns.csv
[lperryman] bb77f055a6aff4914c2d2652efd5fd1b59149d8a - FIxing columns.csv
[Alex Tucker] 6f1cce14484ed02ddb7103995dd8cdd7c8f33cbe - Output dataset metadata and schema.
[lperryman] da8845089d902d7315ba221997bd3b7e2e087173 - FIxing columns.csv
[shannon1995black] 400c47b3af5219f66d019ca206d93bb598b25ad8 - updated value transformation type
[shannon1995black] b7f3b191dc4995a7ba3e2771a7f2bd00f9879e2d - title to uppercase
[lperryman] 513d057cabaf3c9b6e6297f7ae76f28063793427 - Change Year to period and formatted string to represent for 2 year period
[noreply] 3c54f0603efb9580f0cbd92741e32dda7c7bb283 - Update columns.csv
[lperryman] 30c46612e03dd759f8e62f92d5f5b0e880f3a6cb - Adding metadat data to codelists-metadata.json
[noreply] a2a2785da01e4297a272d42e5f8d4bb04f9fcd68 - Update codelists-metadata.json
[lperryman] 38454c78864e493cc8b9e456146933f8f746a75f - Adding trig files to output
[lperryman] d4778471823f9ed5dd602707e52556f97b572a94 - Adding trig files to output
[Alex Tucker] 0ecd7ef459fd07b8a337339d04a9d817502f4f4e - Use "landingPage" and "datasetNotes" for finding datasets/distributions.
[noreply] 3f797e6b294d01511a819e1c33d5116d84fe0024 - Update columns.csv
[lperryman] 86ee83e73743f19fa95788b2592a5c9b5c5302d0 - Adding trig files to output
[lperryman] f39704e62b7304dabe87fe5389c78b82fe57c41a - Replaceing empyt Value columns with 0
[lperryman] 267336c9e6821ecc18596392fa88d6986d9cf70f - Replaceing empyt Value columns with 0
[Grace Spitzer-Wong] aaf7c19ca60b42587a6e1a039d0c4fb2cc3d081f - Created codelist for SEN school types
[Grace Spitzer-Wong] 52e7b36436296f4c8eebebfe292d530f66a596d0 - removing spaces
[Alex Tucker] b2662d587b4af754555899f1ac626e0440ca95aa - Adding FRS Age Group dimension and Percentage of People measure for #10
[noreply] b492ad4b862db862312640ab25cc56db4bbe5ca0 - Update columns.csv
[noreply] 37dc236e927d6900104707f0d2876ecf4b5938c2 - Update columns.csv
[noreply] 8ca2458eee5788fe905e21a191a5c8e4f73d7bb6 - Update columns.csv
[noreply] cd212b405f2bc56b3f2fd07701e71c2fd31b6b84 - Update columns.csv
[noreply] 6e6653590b313072368b37b3dbe7caff64d4c091 - Update columns.csv
[noreply] 6f9391a76c71e50bb39aced28805df7c59f36ed6 - Update columns.csv
[noreply] 13659a5c5674e456e204d6fcfc91b109b1fe09bd - Update columns.csv
[Alex Tucker] ae198a177b6726a760e84b9dc3a06cb0d3aadc74 - Check scraper works from landingPage
[Alex Tucker] 4eabf140b4ee6169608b523db24e14f152d41c1d - Check scraper works from landingPage
[lperryman] 3ea3ab539753e3a60a5eca720a500e8128cef7a7 - Code for changing Sec to M, F,T had disappeared
[lperryman] d2dc8b12a011867fd4650a954d186054b5e7769c - Code for changing Sec to M, F,T had disappeared
[lperryman] 9cabfdb37e5528e356cc5a403da469480abdbc95 - Code for changing Sec to M, F,T had disappeared
[lperryman] 8e4ce46562a729ec80a4cec42ce7fd58455fa62c - Changing Sample Size in columns.csv to a measure and a number
[lperryman] 3c6df49054b927e50726c7fe30e63376cf28c106 - Adding a Measure Type column to my datasets
[vtula2000] 9ad5368fa24ae3a5a54cc107c43165ccaf2a23bb - Tidy data
[lperryman] 708323b3b7eb7182cd26611972370c3d8011b697 - Adding a Marker column to dataset and to columns.csv file
[Alex Tucker] 167ac3bd3b6ba3512c4de29282f8b64f0108d551 - Ignore ipynb notebooks, keep the Python instead.
[noreply] 21e12e901a0c5a4ad10aed35887a7b26b00709aa - Update columns.csv
[lperryman] 0e2c6a47031616dd61777f92258850f26495615b - Adding a Marker column to dataset and to columns.csv file
[noreply] aa434283bd91c9d5ad7be9de2965b521fda2541d - Update columns.csv
[noreply] 50b1dfe507de8c180b70d93628ebae6ce2fc46fa - Update columns.csv
[vtula2000] 7718b7c0ee713db5f231d406db7d97cd20ef8ce0 - url update
[noreply] 315ddf8cbcb9cc73b86831887a80606b176dfdde - Add files via upload
[noreply] 41e921f7bb35d0775135ee5ffb5909f6babbde42 - Add files via upload
[noreply] 5b0c145139019d96fb731f2fd297a0fa9b8c86d9 - Update columns.csv
[noreply] 3f64f2919b1f30b0b56e1f3fa0b4cf65efcb5dd5 - Update columns.csv
[Alex Tucker] aef10226c53c5e8a5e401a950b5f2c56dba4066c - Add some validation for columns.csv
[lperryman] fdb28502bdb82b76a6f9d6638953c2a56322ce7c - Adding Marker to comnponents.csv file
[lperryman] b9c55f7d948c14b24a649b2a3aa18a523efa5c16 - Adding Marker codelist file
[noreply] fcc1e1e5b7c9e4cfc5fcdb5e6730543977197d8d - Update codelists-metadata.json
[noreply] 14c69f2bb386d89338c4f87512bc43062cf4f9ba - Update main.py
[Grace Spitzer-Wong] a2cec17e509749a9352d326dd5fe7abdb703e2e9 - codelist renamed
[Alex Tucker] 991666338c05dfeae4e8aaa1b33044a03136b8b2 - Cleaned up some (, ), _, - and space chars.
[Alex Tucker] c80bf8f6082cb498f5db45163dedef67ef4d8850 - Removed some double hyphens for compatibility with the way gssutils pathify() turns labels into URL paths.
No changes
[Alex Tucker] 1f3bc6a4192a314eebb538fb3df22f48ab10c488 - Fix csvlints in codelists-metadata.json
[Alex Tucker] c3ed524eefafe973fa79e7e1efcced6d98bd463c - Unix filenames are case sensitive. Make codes consistent with gssutils pathify() function.
[Alex Tucker] 6502a4f6bb75498fe85c4aeb4d0bc9be2479d2df - Ensure CSV files have CRLF line endings.
[Alex Tucker] b943367c13180b1303686d63185390b505ddfae6 - Remove duplicate list. Re-order codelists metadata to check that all the codelists are listed and add any missing.
[Alex Tucker] c5192a273390881515405d7ce7367896cd09000f - Check columns.csv against schema.
[Alex Tucker] e73ae1f8138834830da9923f4f00cb7f3586424b - Add schema for components.csv and update tests.
[Alex Tucker] 6a14b50dbb530df024cb1cb056ad3fef09ce979c - Try putting hard quotes around filename to cope with special shell chars.
[Alex Tucker] efba49cceef190108778c71654b7137627362eaf - Add 'Count' measure type.
[noreply] 250cc46bdc95c5fc5affa612c3ca1c3042f579da - Update columns.csv
[lperryman] f7b973736f5aa1149844059185b2052425df292b - Removing spaces in column Measure Type
[noreply] 9e759c863fa0d8fa1ba058c4cdbb599bc0b4f47e - Update codelists-metadata.json
[noreply] a452dfcf68b6dfdddb429ae7550637f8a62c40db - Update codelists-metadata.json
[lperryman] 5f6c118b551b51545dc35b2b48acb8876519ad2b - Removing spaces in column Measure Type
[Alex Tucker] 181d7de5f1ccae6d03169a68bda82bc46c7984e9 - Value column needs a special definition as it gets 'pivotted'.
[noreply] 31bf0ad1fb9fd1d4302992f3287d69d3e9d4e19b - Pathify Value column of Identified-Support-Needs-of-Homeless-Households-2018-19 table
[noreply] 0c94c2c7be7d9817f85574a3761d21d405f98a18 - Update Charts.py
[noreply] 2bdefdfb31038d53be0412c45f3322615394e438 - Pathify-ing columns
[noreply] eb63def56680cbf4b2dc8c3940fc1d4cb62b53a6 - Create Reason(s) for failing to maintain accommodation
[noreply] 69156efb4788f2630b4110e8603fbeef260b70ce - Rename Reason(s) for failing to maintain accommodation to Reason(s)-for-failing-to-maintain-accommodation
[noreply] 0606e32bf77f9a0ffe08d9a13dcb42cca75555ba - Update Reason(s)-for-failing-to-maintain-accommodation
[noreply] d3cd8401abe0615dcd58ff37a2c76235eeeeaa09 - Rename Reason(s)-for-failing-to-maintain-accommodation to reason(s)-for-failing-to-maintain-accommodation
No changes
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 937 lines...]
806. too_many_values. Row: 267. Percent
807. format. Row: 268,3. Social/behavioural
808. invalid_number. Row: 268,6. Percentage
809. too_many_values. Row: 268. Percent
810. format. Row: 269,3. Social/behavioural
811. invalid_number. Row: 269,6. Percentage
812. too_many_values. Row: 269. Percent
813. format. Row: 270,3. Other
814. invalid_number. Row: 270,6. Percentage
815. too_many_values. Row: 270. Percent
816. format. Row: 271,3. Other
817. invalid_number. Row: 271,6. Percentage
818. too_many_values. Row: 271. Percent
819. format. Row: 272,3. Other
820. invalid_number. Row: 272,6. Percentage
821. too_many_values. Row: 272. Percent
822. format. Row: 273,3. Other
823. invalid_number. Row: 273,6. Percentage
824. too_many_values. Row: 273. Percent
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 32cbfa13dfaed77e0ebfb28677f36205b95a3017e93edae86ecf8fbe73f8789a
$ docker rm -f 32cbfa13dfaed77e0ebfb28677f36205b95a3017e93edae86ecf8fbe73f8789a
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes No changes No changes
[Alex Tucker] 516eb5ee94da99618bf476c56c3e6517c2482083 - Remove old special case for when out/observations.csv exists.
[Alex Tucker] 6820fef84d1c73bbfb16d07f87259afa096c4cbc - Fix ragged rows. Use DOS line endings as that's what text/* mimetypes should do.
[lperryman] f961b501f993b6801d5d1bbfec841d36350e64a3 - datasets/DWP-Family-Resources-Survey-Carer/main.py had all the wrong formatting for some reason so changed
[lperryman] 22b78bfeee1cd7bcf5833e739f418c8b211490ae - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[lperryman] 1f3e2fec7a6f13c5c0ea02bcf96e77170ac62fd8 - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[mikelovesbooks] 386eaf2559c7547c0ebc252327f160425470eba3 - added temporary manual trig file
[mikelovesbooks] a4e72e6d296eadf60ec9f43ea295284b1617b341 - updated PHE codelists
[mikelovesbooks] 92e9710cf77d6567a2422f330be4da61b8692203 - data from fingertips
[mikelovesbooks] 4dce0948a896af31013ae2554cab5d6a2b918dfe - remove old local data csv
[noreply] cffc20ac58d99cf982d93f417a6b5fc75915d639 - Delete main.ipynb
[noreply] 87ede54c0396e304ac5d372aa71eba0024f0e2d3 - Delete Jenkinsfile
[shannon1995black] be84d9fdec016c03bf7de6c1597c64218621d99a - update naming
[noreply] 928e88d31a7b985e10d265e871871edd92f9aa66 - remove unnecessary time period entry
[lperryman] 4431431355ab317f4d9aa3db8ce695cfb9c130ee - Adding rows to the components csv file
[shannon1995black] b4d0f885f6084447ec8add6ed66d3affc161332d - update main
[lperryman] 037a500fa0ea442f64b9e87949b519ac5c672e43 - Sorting ourt the schema file
[lperryman] d7079738021323d7aba78930006122c17eb2adb9 - Had a capital i one of the column headings when it should have been lower case!
[shannon1995black] 8260ab10b2288609275aa23585d28cc77faff340 - updates
[shannon1995black] 7871ceb8e22f7205829a9ca14da022fa0b86c374 - updated json file
[lperryman] 417d7d297486f1e7780b1ad3d26cfda4a37158f5 - Adding Period to columns.csv
[lperryman] 44e902bc5d106ebfa2eb318e4c64c528c42b5be4 - Getting rid of capital letter in one of the columns
[shannon1995black] af39b43f7fb1c3cbdce95f106bb5c8f81f7e5781 - update column name
[shannon1995black] 3a1135fd0c90a4d0174833f051dd372379ab2c69 - uncomment line to create observations.csv-schema.json
[lperryman] 78c14f03098459533da8df4fb7f970caf2d8f71b - Fixing columns.csv
[lperryman] 74a2b37b464c294dbeb19e5f4e41afdfb39c7ff0 - FIxing columns.csv
[lperryman] cdddeee62af46cccbf93274988364109ffd6e672 - FIxing columns.csv
[lperryman] 632a12b75329e5474b55649a26086f0753e8124a - FIxing columns.csv
[lperryman] 3ce5b581d49b56746c235eb25b055991cc7356da - FIxing columns.csv
[lperryman] bb77f055a6aff4914c2d2652efd5fd1b59149d8a - FIxing columns.csv
[Alex Tucker] 6f1cce14484ed02ddb7103995dd8cdd7c8f33cbe - Output dataset metadata and schema.
[lperryman] da8845089d902d7315ba221997bd3b7e2e087173 - FIxing columns.csv
[shannon1995black] 400c47b3af5219f66d019ca206d93bb598b25ad8 - updated value transformation type
[shannon1995black] b7f3b191dc4995a7ba3e2771a7f2bd00f9879e2d - title to uppercase
[lperryman] 513d057cabaf3c9b6e6297f7ae76f28063793427 - Change Year to period and formatted string to represent for 2 year period
[noreply] 3c54f0603efb9580f0cbd92741e32dda7c7bb283 - Update columns.csv
[lperryman] 30c46612e03dd759f8e62f92d5f5b0e880f3a6cb - Adding metadat data to codelists-metadata.json
[noreply] a2a2785da01e4297a272d42e5f8d4bb04f9fcd68 - Update codelists-metadata.json
[lperryman] 38454c78864e493cc8b9e456146933f8f746a75f - Adding trig files to output
[lperryman] d4778471823f9ed5dd602707e52556f97b572a94 - Adding trig files to output
[Alex Tucker] 0ecd7ef459fd07b8a337339d04a9d817502f4f4e - Use "landingPage" and "datasetNotes" for finding datasets/distributions.
[noreply] 3f797e6b294d01511a819e1c33d5116d84fe0024 - Update columns.csv
[lperryman] 86ee83e73743f19fa95788b2592a5c9b5c5302d0 - Adding trig files to output
[lperryman] f39704e62b7304dabe87fe5389c78b82fe57c41a - Replaceing empyt Value columns with 0
[lperryman] 267336c9e6821ecc18596392fa88d6986d9cf70f - Replaceing empyt Value columns with 0
[Grace Spitzer-Wong] aaf7c19ca60b42587a6e1a039d0c4fb2cc3d081f - Created codelist for SEN school types
[Grace Spitzer-Wong] 52e7b36436296f4c8eebebfe292d530f66a596d0 - removing spaces
[Alex Tucker] b2662d587b4af754555899f1ac626e0440ca95aa - Adding FRS Age Group dimension and Percentage of People measure for #10
[noreply] b492ad4b862db862312640ab25cc56db4bbe5ca0 - Update columns.csv
[noreply] 37dc236e927d6900104707f0d2876ecf4b5938c2 - Update columns.csv
[noreply] 8ca2458eee5788fe905e21a191a5c8e4f73d7bb6 - Update columns.csv
[noreply] cd212b405f2bc56b3f2fd07701e71c2fd31b6b84 - Update columns.csv
[noreply] 6e6653590b313072368b37b3dbe7caff64d4c091 - Update columns.csv
[noreply] 6f9391a76c71e50bb39aced28805df7c59f36ed6 - Update columns.csv
[noreply] 13659a5c5674e456e204d6fcfc91b109b1fe09bd - Update columns.csv
[Alex Tucker] ae198a177b6726a760e84b9dc3a06cb0d3aadc74 - Check scraper works from landingPage
[Alex Tucker] 4eabf140b4ee6169608b523db24e14f152d41c1d - Check scraper works from landingPage
[lperryman] 3ea3ab539753e3a60a5eca720a500e8128cef7a7 - Code for changing Sec to M, F,T had disappeared
[lperryman] d2dc8b12a011867fd4650a954d186054b5e7769c - Code for changing Sec to M, F,T had disappeared
[lperryman] 9cabfdb37e5528e356cc5a403da469480abdbc95 - Code for changing Sec to M, F,T had disappeared
[lperryman] 8e4ce46562a729ec80a4cec42ce7fd58455fa62c - Changing Sample Size in columns.csv to a measure and a number
[lperryman] 3c6df49054b927e50726c7fe30e63376cf28c106 - Adding a Measure Type column to my datasets
[vtula2000] 9ad5368fa24ae3a5a54cc107c43165ccaf2a23bb - Tidy data
[lperryman] 708323b3b7eb7182cd26611972370c3d8011b697 - Adding a Marker column to dataset and to columns.csv file
[Alex Tucker] 167ac3bd3b6ba3512c4de29282f8b64f0108d551 - Ignore ipynb notebooks, keep the Python instead.
[noreply] 21e12e901a0c5a4ad10aed35887a7b26b00709aa - Update columns.csv
[lperryman] 0e2c6a47031616dd61777f92258850f26495615b - Adding a Marker column to dataset and to columns.csv file
[noreply] aa434283bd91c9d5ad7be9de2965b521fda2541d - Update columns.csv
[noreply] 50b1dfe507de8c180b70d93628ebae6ce2fc46fa - Update columns.csv
[vtula2000] 7718b7c0ee713db5f231d406db7d97cd20ef8ce0 - url update
[noreply] 315ddf8cbcb9cc73b86831887a80606b176dfdde - Add files via upload
[noreply] 41e921f7bb35d0775135ee5ffb5909f6babbde42 - Add files via upload
[noreply] 5b0c145139019d96fb731f2fd297a0fa9b8c86d9 - Update columns.csv
[noreply] 3f64f2919b1f30b0b56e1f3fa0b4cf65efcb5dd5 - Update columns.csv
[Alex Tucker] aef10226c53c5e8a5e401a950b5f2c56dba4066c - Add some validation for columns.csv
[lperryman] fdb28502bdb82b76a6f9d6638953c2a56322ce7c - Adding Marker to comnponents.csv file
[lperryman] b9c55f7d948c14b24a649b2a3aa18a523efa5c16 - Adding Marker codelist file
[noreply] fcc1e1e5b7c9e4cfc5fcdb5e6730543977197d8d - Update codelists-metadata.json
[noreply] 14c69f2bb386d89338c4f87512bc43062cf4f9ba - Update main.py
[Grace Spitzer-Wong] a2cec17e509749a9352d326dd5fe7abdb703e2e9 - codelist renamed
[Alex Tucker] 991666338c05dfeae4e8aaa1b33044a03136b8b2 - Cleaned up some (, ), _, - and space chars.
[Alex Tucker] c80bf8f6082cb498f5db45163dedef67ef4d8850 - Removed some double hyphens for compatibility with the way gssutils pathify() turns labels into URL paths.
No changes
[Alex Tucker] 1f3bc6a4192a314eebb538fb3df22f48ab10c488 - Fix csvlints in codelists-metadata.json
[Alex Tucker] c3ed524eefafe973fa79e7e1efcced6d98bd463c - Unix filenames are case sensitive. Make codes consistent with gssutils pathify() function.
[Alex Tucker] 6502a4f6bb75498fe85c4aeb4d0bc9be2479d2df - Ensure CSV files have CRLF line endings.
[Alex Tucker] b943367c13180b1303686d63185390b505ddfae6 - Remove duplicate list. Re-order codelists metadata to check that all the codelists are listed and add any missing.
[Alex Tucker] c5192a273390881515405d7ce7367896cd09000f - Check columns.csv against schema.
[Alex Tucker] e73ae1f8138834830da9923f4f00cb7f3586424b - Add schema for components.csv and update tests.
[Alex Tucker] 6a14b50dbb530df024cb1cb056ad3fef09ce979c - Try putting hard quotes around filename to cope with special shell chars.
[Alex Tucker] efba49cceef190108778c71654b7137627362eaf - Add 'Count' measure type.
[noreply] 250cc46bdc95c5fc5affa612c3ca1c3042f579da - Update columns.csv
[lperryman] f7b973736f5aa1149844059185b2052425df292b - Removing spaces in column Measure Type
[noreply] 9e759c863fa0d8fa1ba058c4cdbb599bc0b4f47e - Update codelists-metadata.json
[noreply] a452dfcf68b6dfdddb429ae7550637f8a62c40db - Update codelists-metadata.json
[lperryman] 5f6c118b551b51545dc35b2b48acb8876519ad2b - Removing spaces in column Measure Type
[Alex Tucker] 181d7de5f1ccae6d03169a68bda82bc46c7984e9 - Value column needs a special definition as it gets 'pivotted'.
[noreply] 31bf0ad1fb9fd1d4302992f3287d69d3e9d4e19b - Pathify Value column of Identified-Support-Needs-of-Homeless-Households-2018-19 table
[noreply] 0c94c2c7be7d9817f85574a3761d21d405f98a18 - Update Charts.py
[noreply] 2bdefdfb31038d53be0412c45f3322615394e438 - Pathify-ing columns
[noreply] eb63def56680cbf4b2dc8c3940fc1d4cb62b53a6 - Create Reason(s) for failing to maintain accommodation
[noreply] 69156efb4788f2630b4110e8603fbeef260b70ce - Rename Reason(s) for failing to maintain accommodation to Reason(s)-for-failing-to-maintain-accommodation
[noreply] 0606e32bf77f9a0ffe08d9a13dcb42cca75555ba - Update Reason(s)-for-failing-to-maintain-accommodation
[noreply] d3cd8401abe0615dcd58ff37a2c76235eeeeaa09 - Rename Reason(s)-for-failing-to-maintain-accommodation to reason(s)-for-failing-to-maintain-accommodation
No changes
[noreply] 43203c3d61885a6833ef086e33deae8095d83270 - Create identified-support-needs-of-homeless-households
[noreply] 0fed31a08628c6e79da616700cdf6cd79af46c6a - Rename reason(s)-for-failing-to-maintain-accommodation to reasons-for-failing-to-maintain-accommodation
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 937 lines...]
806. too_many_values. Row: 267. Percent
807. format. Row: 268,3. Social/behavioural
808. invalid_number. Row: 268,6. Percentage
809. too_many_values. Row: 268. Percent
810. format. Row: 269,3. Social/behavioural
811. invalid_number. Row: 269,6. Percentage
812. too_many_values. Row: 269. Percent
813. format. Row: 270,3. Other
814. invalid_number. Row: 270,6. Percentage
815. too_many_values. Row: 270. Percent
816. format. Row: 271,3. Other
817. invalid_number. Row: 271,6. Percentage
818. too_many_values. Row: 271. Percent
819. format. Row: 272,3. Other
820. invalid_number. Row: 272,6. Percentage
821. too_many_values. Row: 272. Percent
822. format. Row: 273,3. Other
823. invalid_number. Row: 273,6. Percentage
824. too_many_values. Row: 273. Percent
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 232e7dfc90328002b67ec02097225f7e1f77ad606d18ce25fd8eeb59cc27b106
$ docker rm -f 232e7dfc90328002b67ec02097225f7e1f77ad606d18ce25fd8eeb59cc27b106
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes No changes No changes
[Alex Tucker] 516eb5ee94da99618bf476c56c3e6517c2482083 - Remove old special case for when out/observations.csv exists.
[Alex Tucker] 6820fef84d1c73bbfb16d07f87259afa096c4cbc - Fix ragged rows. Use DOS line endings as that's what text/* mimetypes should do.
[lperryman] f961b501f993b6801d5d1bbfec841d36350e64a3 - datasets/DWP-Family-Resources-Survey-Carer/main.py had all the wrong formatting for some reason so changed
[lperryman] 22b78bfeee1cd7bcf5833e739f418c8b211490ae - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[lperryman] 1f3e2fec7a6f13c5c0ea02bcf96e77170ac62fd8 - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[mikelovesbooks] 386eaf2559c7547c0ebc252327f160425470eba3 - added temporary manual trig file
[mikelovesbooks] a4e72e6d296eadf60ec9f43ea295284b1617b341 - updated PHE codelists
[mikelovesbooks] 92e9710cf77d6567a2422f330be4da61b8692203 - data from fingertips
[mikelovesbooks] 4dce0948a896af31013ae2554cab5d6a2b918dfe - remove old local data csv
[noreply] cffc20ac58d99cf982d93f417a6b5fc75915d639 - Delete main.ipynb
[noreply] 87ede54c0396e304ac5d372aa71eba0024f0e2d3 - Delete Jenkinsfile
[shannon1995black] be84d9fdec016c03bf7de6c1597c64218621d99a - update naming
[noreply] 928e88d31a7b985e10d265e871871edd92f9aa66 - remove unnecessary time period entry
[lperryman] 4431431355ab317f4d9aa3db8ce695cfb9c130ee - Adding rows to the components csv file
[shannon1995black] b4d0f885f6084447ec8add6ed66d3affc161332d - update main
[lperryman] 037a500fa0ea442f64b9e87949b519ac5c672e43 - Sorting ourt the schema file
[lperryman] d7079738021323d7aba78930006122c17eb2adb9 - Had a capital i one of the column headings when it should have been lower case!
[shannon1995black] 8260ab10b2288609275aa23585d28cc77faff340 - updates
[shannon1995black] 7871ceb8e22f7205829a9ca14da022fa0b86c374 - updated json file
[lperryman] 417d7d297486f1e7780b1ad3d26cfda4a37158f5 - Adding Period to columns.csv
[lperryman] 44e902bc5d106ebfa2eb318e4c64c528c42b5be4 - Getting rid of capital letter in one of the columns
[shannon1995black] af39b43f7fb1c3cbdce95f106bb5c8f81f7e5781 - update column name
[shannon1995black] 3a1135fd0c90a4d0174833f051dd372379ab2c69 - uncomment line to create observations.csv-schema.json
[lperryman] 78c14f03098459533da8df4fb7f970caf2d8f71b - Fixing columns.csv
[lperryman] 74a2b37b464c294dbeb19e5f4e41afdfb39c7ff0 - FIxing columns.csv
[lperryman] cdddeee62af46cccbf93274988364109ffd6e672 - FIxing columns.csv
[lperryman] 632a12b75329e5474b55649a26086f0753e8124a - FIxing columns.csv
[lperryman] 3ce5b581d49b56746c235eb25b055991cc7356da - FIxing columns.csv
[lperryman] bb77f055a6aff4914c2d2652efd5fd1b59149d8a - FIxing columns.csv
[Alex Tucker] 6f1cce14484ed02ddb7103995dd8cdd7c8f33cbe - Output dataset metadata and schema.
[lperryman] da8845089d902d7315ba221997bd3b7e2e087173 - FIxing columns.csv
[shannon1995black] 400c47b3af5219f66d019ca206d93bb598b25ad8 - updated value transformation type
[shannon1995black] b7f3b191dc4995a7ba3e2771a7f2bd00f9879e2d - title to uppercase
[lperryman] 513d057cabaf3c9b6e6297f7ae76f28063793427 - Change Year to period and formatted string to represent for 2 year period
[noreply] 3c54f0603efb9580f0cbd92741e32dda7c7bb283 - Update columns.csv
[lperryman] 30c46612e03dd759f8e62f92d5f5b0e880f3a6cb - Adding metadat data to codelists-metadata.json
[noreply] a2a2785da01e4297a272d42e5f8d4bb04f9fcd68 - Update codelists-metadata.json
[lperryman] 38454c78864e493cc8b9e456146933f8f746a75f - Adding trig files to output
[lperryman] d4778471823f9ed5dd602707e52556f97b572a94 - Adding trig files to output
[Alex Tucker] 0ecd7ef459fd07b8a337339d04a9d817502f4f4e - Use "landingPage" and "datasetNotes" for finding datasets/distributions.
[noreply] 3f797e6b294d01511a819e1c33d5116d84fe0024 - Update columns.csv
[lperryman] 86ee83e73743f19fa95788b2592a5c9b5c5302d0 - Adding trig files to output
[lperryman] f39704e62b7304dabe87fe5389c78b82fe57c41a - Replaceing empyt Value columns with 0
[lperryman] 267336c9e6821ecc18596392fa88d6986d9cf70f - Replaceing empyt Value columns with 0
[Grace Spitzer-Wong] aaf7c19ca60b42587a6e1a039d0c4fb2cc3d081f - Created codelist for SEN school types
[Grace Spitzer-Wong] 52e7b36436296f4c8eebebfe292d530f66a596d0 - removing spaces
[Alex Tucker] b2662d587b4af754555899f1ac626e0440ca95aa - Adding FRS Age Group dimension and Percentage of People measure for #10
[noreply] b492ad4b862db862312640ab25cc56db4bbe5ca0 - Update columns.csv
[noreply] 37dc236e927d6900104707f0d2876ecf4b5938c2 - Update columns.csv
[noreply] 8ca2458eee5788fe905e21a191a5c8e4f73d7bb6 - Update columns.csv
[noreply] cd212b405f2bc56b3f2fd07701e71c2fd31b6b84 - Update columns.csv
[noreply] 6e6653590b313072368b37b3dbe7caff64d4c091 - Update columns.csv
[noreply] 6f9391a76c71e50bb39aced28805df7c59f36ed6 - Update columns.csv
[noreply] 13659a5c5674e456e204d6fcfc91b109b1fe09bd - Update columns.csv
[Alex Tucker] ae198a177b6726a760e84b9dc3a06cb0d3aadc74 - Check scraper works from landingPage
[Alex Tucker] 4eabf140b4ee6169608b523db24e14f152d41c1d - Check scraper works from landingPage
[lperryman] 3ea3ab539753e3a60a5eca720a500e8128cef7a7 - Code for changing Sec to M, F,T had disappeared
[lperryman] d2dc8b12a011867fd4650a954d186054b5e7769c - Code for changing Sec to M, F,T had disappeared
[lperryman] 9cabfdb37e5528e356cc5a403da469480abdbc95 - Code for changing Sec to M, F,T had disappeared
[lperryman] 8e4ce46562a729ec80a4cec42ce7fd58455fa62c - Changing Sample Size in columns.csv to a measure and a number
[lperryman] 3c6df49054b927e50726c7fe30e63376cf28c106 - Adding a Measure Type column to my datasets
[vtula2000] 9ad5368fa24ae3a5a54cc107c43165ccaf2a23bb - Tidy data
[lperryman] 708323b3b7eb7182cd26611972370c3d8011b697 - Adding a Marker column to dataset and to columns.csv file
[Alex Tucker] 167ac3bd3b6ba3512c4de29282f8b64f0108d551 - Ignore ipynb notebooks, keep the Python instead.
[noreply] 21e12e901a0c5a4ad10aed35887a7b26b00709aa - Update columns.csv
[lperryman] 0e2c6a47031616dd61777f92258850f26495615b - Adding a Marker column to dataset and to columns.csv file
[noreply] aa434283bd91c9d5ad7be9de2965b521fda2541d - Update columns.csv
[noreply] 50b1dfe507de8c180b70d93628ebae6ce2fc46fa - Update columns.csv
[vtula2000] 7718b7c0ee713db5f231d406db7d97cd20ef8ce0 - url update
[noreply] 315ddf8cbcb9cc73b86831887a80606b176dfdde - Add files via upload
[noreply] 41e921f7bb35d0775135ee5ffb5909f6babbde42 - Add files via upload
[noreply] 5b0c145139019d96fb731f2fd297a0fa9b8c86d9 - Update columns.csv
[noreply] 3f64f2919b1f30b0b56e1f3fa0b4cf65efcb5dd5 - Update columns.csv
[Alex Tucker] aef10226c53c5e8a5e401a950b5f2c56dba4066c - Add some validation for columns.csv
[lperryman] fdb28502bdb82b76a6f9d6638953c2a56322ce7c - Adding Marker to comnponents.csv file
[lperryman] b9c55f7d948c14b24a649b2a3aa18a523efa5c16 - Adding Marker codelist file
[noreply] fcc1e1e5b7c9e4cfc5fcdb5e6730543977197d8d - Update codelists-metadata.json
[noreply] 14c69f2bb386d89338c4f87512bc43062cf4f9ba - Update main.py
[Grace Spitzer-Wong] a2cec17e509749a9352d326dd5fe7abdb703e2e9 - codelist renamed
[Alex Tucker] 991666338c05dfeae4e8aaa1b33044a03136b8b2 - Cleaned up some (, ), _, - and space chars.
[Alex Tucker] c80bf8f6082cb498f5db45163dedef67ef4d8850 - Removed some double hyphens for compatibility with the way gssutils pathify() turns labels into URL paths.
No changes
[Alex Tucker] 1f3bc6a4192a314eebb538fb3df22f48ab10c488 - Fix csvlints in codelists-metadata.json
[Alex Tucker] c3ed524eefafe973fa79e7e1efcced6d98bd463c - Unix filenames are case sensitive. Make codes consistent with gssutils pathify() function.
[Alex Tucker] 6502a4f6bb75498fe85c4aeb4d0bc9be2479d2df - Ensure CSV files have CRLF line endings.
[Alex Tucker] b943367c13180b1303686d63185390b505ddfae6 - Remove duplicate list. Re-order codelists metadata to check that all the codelists are listed and add any missing.
[Alex Tucker] c5192a273390881515405d7ce7367896cd09000f - Check columns.csv against schema.
[Alex Tucker] e73ae1f8138834830da9923f4f00cb7f3586424b - Add schema for components.csv and update tests.
[Alex Tucker] 6a14b50dbb530df024cb1cb056ad3fef09ce979c - Try putting hard quotes around filename to cope with special shell chars.
[Alex Tucker] efba49cceef190108778c71654b7137627362eaf - Add 'Count' measure type.
[noreply] 250cc46bdc95c5fc5affa612c3ca1c3042f579da - Update columns.csv
[lperryman] f7b973736f5aa1149844059185b2052425df292b - Removing spaces in column Measure Type
[noreply] 9e759c863fa0d8fa1ba058c4cdbb599bc0b4f47e - Update codelists-metadata.json
[noreply] a452dfcf68b6dfdddb429ae7550637f8a62c40db - Update codelists-metadata.json
[lperryman] 5f6c118b551b51545dc35b2b48acb8876519ad2b - Removing spaces in column Measure Type
[Alex Tucker] 181d7de5f1ccae6d03169a68bda82bc46c7984e9 - Value column needs a special definition as it gets 'pivotted'.
[noreply] 31bf0ad1fb9fd1d4302992f3287d69d3e9d4e19b - Pathify Value column of Identified-Support-Needs-of-Homeless-Households-2018-19 table
[noreply] 0c94c2c7be7d9817f85574a3761d21d405f98a18 - Update Charts.py
[noreply] 2bdefdfb31038d53be0412c45f3322615394e438 - Pathify-ing columns
[noreply] eb63def56680cbf4b2dc8c3940fc1d4cb62b53a6 - Create Reason(s) for failing to maintain accommodation
[noreply] 69156efb4788f2630b4110e8603fbeef260b70ce - Rename Reason(s) for failing to maintain accommodation to Reason(s)-for-failing-to-maintain-accommodation
[noreply] 0606e32bf77f9a0ffe08d9a13dcb42cca75555ba - Update Reason(s)-for-failing-to-maintain-accommodation
[noreply] d3cd8401abe0615dcd58ff37a2c76235eeeeaa09 - Rename Reason(s)-for-failing-to-maintain-accommodation to reason(s)-for-failing-to-maintain-accommodation
No changes
[noreply] 43203c3d61885a6833ef086e33deae8095d83270 - Create identified-support-needs-of-homeless-households
[noreply] 0fed31a08628c6e79da616700cdf6cd79af46c6a - Rename reason(s)-for-failing-to-maintain-accommodation to reasons-for-failing-to-maintain-accommodation
[Alex Tucker] aedc32557ddb6dcae2467f81d499a4bb329b56ba - Rename files as CSV. Add to list in codelists-metadata.json. Remove extra chars and get syntax right. Slightly tidy some labels.
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 937 lines...]
806. too_many_values. Row: 267. Percent
807. format. Row: 268,3. Social/behavioural
808. invalid_number. Row: 268,6. Percentage
809. too_many_values. Row: 268. Percent
810. format. Row: 269,3. Social/behavioural
811. invalid_number. Row: 269,6. Percentage
812. too_many_values. Row: 269. Percent
813. format. Row: 270,3. Other
814. invalid_number. Row: 270,6. Percentage
815. too_many_values. Row: 270. Percent
816. format. Row: 271,3. Other
817. invalid_number. Row: 271,6. Percentage
818. too_many_values. Row: 271. Percent
819. format. Row: 272,3. Other
820. invalid_number. Row: 272,6. Percentage
821. too_many_values. Row: 272. Percent
822. format. Row: 273,3. Other
823. invalid_number. Row: 273,6. Percentage
824. too_many_values. Row: 273. Percent
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 78525dad4696bb0f3b88f9021b0333a774ffaf34eac39c8edcf6b7e60b6696af
$ docker rm -f 78525dad4696bb0f3b88f9021b0333a774ffaf34eac39c8edcf6b7e60b6696af
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes No changes No changes
[Alex Tucker] 516eb5ee94da99618bf476c56c3e6517c2482083 - Remove old special case for when out/observations.csv exists.
[Alex Tucker] 6820fef84d1c73bbfb16d07f87259afa096c4cbc - Fix ragged rows. Use DOS line endings as that's what text/* mimetypes should do.
[lperryman] f961b501f993b6801d5d1bbfec841d36350e64a3 - datasets/DWP-Family-Resources-Survey-Carer/main.py had all the wrong formatting for some reason so changed
[lperryman] 22b78bfeee1cd7bcf5833e739f418c8b211490ae - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[lperryman] 1f3e2fec7a6f13c5c0ea02bcf96e77170ac62fd8 - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[mikelovesbooks] 386eaf2559c7547c0ebc252327f160425470eba3 - added temporary manual trig file
[mikelovesbooks] a4e72e6d296eadf60ec9f43ea295284b1617b341 - updated PHE codelists
[mikelovesbooks] 92e9710cf77d6567a2422f330be4da61b8692203 - data from fingertips
[mikelovesbooks] 4dce0948a896af31013ae2554cab5d6a2b918dfe - remove old local data csv
[noreply] cffc20ac58d99cf982d93f417a6b5fc75915d639 - Delete main.ipynb
[noreply] 87ede54c0396e304ac5d372aa71eba0024f0e2d3 - Delete Jenkinsfile
[shannon1995black] be84d9fdec016c03bf7de6c1597c64218621d99a - update naming
[noreply] 928e88d31a7b985e10d265e871871edd92f9aa66 - remove unnecessary time period entry
[lperryman] 4431431355ab317f4d9aa3db8ce695cfb9c130ee - Adding rows to the components csv file
[shannon1995black] b4d0f885f6084447ec8add6ed66d3affc161332d - update main
[lperryman] 037a500fa0ea442f64b9e87949b519ac5c672e43 - Sorting ourt the schema file
[lperryman] d7079738021323d7aba78930006122c17eb2adb9 - Had a capital i one of the column headings when it should have been lower case!
[shannon1995black] 8260ab10b2288609275aa23585d28cc77faff340 - updates
[shannon1995black] 7871ceb8e22f7205829a9ca14da022fa0b86c374 - updated json file
[lperryman] 417d7d297486f1e7780b1ad3d26cfda4a37158f5 - Adding Period to columns.csv
[lperryman] 44e902bc5d106ebfa2eb318e4c64c528c42b5be4 - Getting rid of capital letter in one of the columns
[shannon1995black] af39b43f7fb1c3cbdce95f106bb5c8f81f7e5781 - update column name
[shannon1995black] 3a1135fd0c90a4d0174833f051dd372379ab2c69 - uncomment line to create observations.csv-schema.json
[lperryman] 78c14f03098459533da8df4fb7f970caf2d8f71b - Fixing columns.csv
[lperryman] 74a2b37b464c294dbeb19e5f4e41afdfb39c7ff0 - FIxing columns.csv
[lperryman] cdddeee62af46cccbf93274988364109ffd6e672 - FIxing columns.csv
[lperryman] 632a12b75329e5474b55649a26086f0753e8124a - FIxing columns.csv
[lperryman] 3ce5b581d49b56746c235eb25b055991cc7356da - FIxing columns.csv
[lperryman] bb77f055a6aff4914c2d2652efd5fd1b59149d8a - FIxing columns.csv
[Alex Tucker] 6f1cce14484ed02ddb7103995dd8cdd7c8f33cbe - Output dataset metadata and schema.
[lperryman] da8845089d902d7315ba221997bd3b7e2e087173 - FIxing columns.csv
[shannon1995black] 400c47b3af5219f66d019ca206d93bb598b25ad8 - updated value transformation type
[shannon1995black] b7f3b191dc4995a7ba3e2771a7f2bd00f9879e2d - title to uppercase
[lperryman] 513d057cabaf3c9b6e6297f7ae76f28063793427 - Change Year to period and formatted string to represent for 2 year period
[noreply] 3c54f0603efb9580f0cbd92741e32dda7c7bb283 - Update columns.csv
[lperryman] 30c46612e03dd759f8e62f92d5f5b0e880f3a6cb - Adding metadat data to codelists-metadata.json
[noreply] a2a2785da01e4297a272d42e5f8d4bb04f9fcd68 - Update codelists-metadata.json
[lperryman] 38454c78864e493cc8b9e456146933f8f746a75f - Adding trig files to output
[lperryman] d4778471823f9ed5dd602707e52556f97b572a94 - Adding trig files to output
[Alex Tucker] 0ecd7ef459fd07b8a337339d04a9d817502f4f4e - Use "landingPage" and "datasetNotes" for finding datasets/distributions.
[noreply] 3f797e6b294d01511a819e1c33d5116d84fe0024 - Update columns.csv
[lperryman] 86ee83e73743f19fa95788b2592a5c9b5c5302d0 - Adding trig files to output
[lperryman] f39704e62b7304dabe87fe5389c78b82fe57c41a - Replaceing empyt Value columns with 0
[lperryman] 267336c9e6821ecc18596392fa88d6986d9cf70f - Replaceing empyt Value columns with 0
[Grace Spitzer-Wong] aaf7c19ca60b42587a6e1a039d0c4fb2cc3d081f - Created codelist for SEN school types
[Grace Spitzer-Wong] 52e7b36436296f4c8eebebfe292d530f66a596d0 - removing spaces
[Alex Tucker] b2662d587b4af754555899f1ac626e0440ca95aa - Adding FRS Age Group dimension and Percentage of People measure for #10
[noreply] b492ad4b862db862312640ab25cc56db4bbe5ca0 - Update columns.csv
[noreply] 37dc236e927d6900104707f0d2876ecf4b5938c2 - Update columns.csv
[noreply] 8ca2458eee5788fe905e21a191a5c8e4f73d7bb6 - Update columns.csv
[noreply] cd212b405f2bc56b3f2fd07701e71c2fd31b6b84 - Update columns.csv
[noreply] 6e6653590b313072368b37b3dbe7caff64d4c091 - Update columns.csv
[noreply] 6f9391a76c71e50bb39aced28805df7c59f36ed6 - Update columns.csv
[noreply] 13659a5c5674e456e204d6fcfc91b109b1fe09bd - Update columns.csv
[Alex Tucker] ae198a177b6726a760e84b9dc3a06cb0d3aadc74 - Check scraper works from landingPage
[Alex Tucker] 4eabf140b4ee6169608b523db24e14f152d41c1d - Check scraper works from landingPage
[lperryman] 3ea3ab539753e3a60a5eca720a500e8128cef7a7 - Code for changing Sec to M, F,T had disappeared
[lperryman] d2dc8b12a011867fd4650a954d186054b5e7769c - Code for changing Sec to M, F,T had disappeared
[lperryman] 9cabfdb37e5528e356cc5a403da469480abdbc95 - Code for changing Sec to M, F,T had disappeared
[lperryman] 8e4ce46562a729ec80a4cec42ce7fd58455fa62c - Changing Sample Size in columns.csv to a measure and a number
[lperryman] 3c6df49054b927e50726c7fe30e63376cf28c106 - Adding a Measure Type column to my datasets
[vtula2000] 9ad5368fa24ae3a5a54cc107c43165ccaf2a23bb - Tidy data
[lperryman] 708323b3b7eb7182cd26611972370c3d8011b697 - Adding a Marker column to dataset and to columns.csv file
[Alex Tucker] 167ac3bd3b6ba3512c4de29282f8b64f0108d551 - Ignore ipynb notebooks, keep the Python instead.
[noreply] 21e12e901a0c5a4ad10aed35887a7b26b00709aa - Update columns.csv
[lperryman] 0e2c6a47031616dd61777f92258850f26495615b - Adding a Marker column to dataset and to columns.csv file
[noreply] aa434283bd91c9d5ad7be9de2965b521fda2541d - Update columns.csv
[noreply] 50b1dfe507de8c180b70d93628ebae6ce2fc46fa - Update columns.csv
[vtula2000] 7718b7c0ee713db5f231d406db7d97cd20ef8ce0 - url update
[noreply] 315ddf8cbcb9cc73b86831887a80606b176dfdde - Add files via upload
[noreply] 41e921f7bb35d0775135ee5ffb5909f6babbde42 - Add files via upload
[noreply] 5b0c145139019d96fb731f2fd297a0fa9b8c86d9 - Update columns.csv
[noreply] 3f64f2919b1f30b0b56e1f3fa0b4cf65efcb5dd5 - Update columns.csv
[Alex Tucker] aef10226c53c5e8a5e401a950b5f2c56dba4066c - Add some validation for columns.csv
[lperryman] fdb28502bdb82b76a6f9d6638953c2a56322ce7c - Adding Marker to comnponents.csv file
[lperryman] b9c55f7d948c14b24a649b2a3aa18a523efa5c16 - Adding Marker codelist file
[noreply] fcc1e1e5b7c9e4cfc5fcdb5e6730543977197d8d - Update codelists-metadata.json
[noreply] 14c69f2bb386d89338c4f87512bc43062cf4f9ba - Update main.py
[Grace Spitzer-Wong] a2cec17e509749a9352d326dd5fe7abdb703e2e9 - codelist renamed
[Alex Tucker] 991666338c05dfeae4e8aaa1b33044a03136b8b2 - Cleaned up some (, ), _, - and space chars.
[Alex Tucker] c80bf8f6082cb498f5db45163dedef67ef4d8850 - Removed some double hyphens for compatibility with the way gssutils pathify() turns labels into URL paths.
No changes
[Alex Tucker] 1f3bc6a4192a314eebb538fb3df22f48ab10c488 - Fix csvlints in codelists-metadata.json
[Alex Tucker] c3ed524eefafe973fa79e7e1efcced6d98bd463c - Unix filenames are case sensitive. Make codes consistent with gssutils pathify() function.
[Alex Tucker] 6502a4f6bb75498fe85c4aeb4d0bc9be2479d2df - Ensure CSV files have CRLF line endings.
[Alex Tucker] b943367c13180b1303686d63185390b505ddfae6 - Remove duplicate list. Re-order codelists metadata to check that all the codelists are listed and add any missing.
[Alex Tucker] c5192a273390881515405d7ce7367896cd09000f - Check columns.csv against schema.
[Alex Tucker] e73ae1f8138834830da9923f4f00cb7f3586424b - Add schema for components.csv and update tests.
[Alex Tucker] 6a14b50dbb530df024cb1cb056ad3fef09ce979c - Try putting hard quotes around filename to cope with special shell chars.
[Alex Tucker] efba49cceef190108778c71654b7137627362eaf - Add 'Count' measure type.
[noreply] 250cc46bdc95c5fc5affa612c3ca1c3042f579da - Update columns.csv
[lperryman] f7b973736f5aa1149844059185b2052425df292b - Removing spaces in column Measure Type
[noreply] 9e759c863fa0d8fa1ba058c4cdbb599bc0b4f47e - Update codelists-metadata.json
[noreply] a452dfcf68b6dfdddb429ae7550637f8a62c40db - Update codelists-metadata.json
[lperryman] 5f6c118b551b51545dc35b2b48acb8876519ad2b - Removing spaces in column Measure Type
[Alex Tucker] 181d7de5f1ccae6d03169a68bda82bc46c7984e9 - Value column needs a special definition as it gets 'pivotted'.
[noreply] 31bf0ad1fb9fd1d4302992f3287d69d3e9d4e19b - Pathify Value column of Identified-Support-Needs-of-Homeless-Households-2018-19 table
[noreply] 0c94c2c7be7d9817f85574a3761d21d405f98a18 - Update Charts.py
[noreply] 2bdefdfb31038d53be0412c45f3322615394e438 - Pathify-ing columns
[noreply] eb63def56680cbf4b2dc8c3940fc1d4cb62b53a6 - Create Reason(s) for failing to maintain accommodation
[noreply] 69156efb4788f2630b4110e8603fbeef260b70ce - Rename Reason(s) for failing to maintain accommodation to Reason(s)-for-failing-to-maintain-accommodation
[noreply] 0606e32bf77f9a0ffe08d9a13dcb42cca75555ba - Update Reason(s)-for-failing-to-maintain-accommodation
[noreply] d3cd8401abe0615dcd58ff37a2c76235eeeeaa09 - Rename Reason(s)-for-failing-to-maintain-accommodation to reason(s)-for-failing-to-maintain-accommodation
No changes
[noreply] 43203c3d61885a6833ef086e33deae8095d83270 - Create identified-support-needs-of-homeless-households
[noreply] 0fed31a08628c6e79da616700cdf6cd79af46c6a - Rename reason(s)-for-failing-to-maintain-accommodation to reasons-for-failing-to-maintain-accommodation
[Alex Tucker] aedc32557ddb6dcae2467f81d499a4bb329b56ba - Rename files as CSV. Add to list in codelists-metadata.json. Remove extra chars and get syntax right. Slightly tidy some labels.
[Alex Tucker] 1f7eeed26f6ad1a5a9ff9ea2e4f1ecf60e382a67 - suppport -> support
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
[...truncated 935 lines...]
806. too_many_values. Row: 267. Percent
807. format. Row: 268,3. Social/behavioural
808. invalid_number. Row: 268,6. Percentage
809. too_many_values. Row: 268. Percent
810. format. Row: 269,3. Social/behavioural
811. invalid_number. Row: 269,6. Percentage
812. too_many_values. Row: 269. Percent
813. format. Row: 270,3. Other
814. invalid_number. Row: 270,6. Percentage
815. too_many_values. Row: 270. Percent
816. format. Row: 271,3. Other
817. invalid_number. Row: 271,6. Percentage
818. too_many_values. Row: 271. Percent
819. format. Row: 272,3. Other
820. invalid_number. Row: 272,6. Percentage
821. too_many_values. Row: 272. Percent
822. format. Row: 273,3. Other
823. invalid_number. Row: 273,6. Percentage
824. too_many_values. Row: 273. Percent
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 83fabbbfd2df7f1043ec8dcc683745e0f9fb81e72341f551ab511d65789e0ff2
$ docker rm -f 83fabbbfd2df7f1043ec8dcc683745e0f9fb81e72341f551ab511d65789e0ff2
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build:
[Alex Tucker] 42f7f8212c64eee861a17f5f11a418655c2989d1 - Revert back to running the full pipeline when triggered
[Alex Tucker] 91fe8e145fc858f7c2c39cb22c01c5a6fc246585 - Move file change trigger to 'additional steps' in config.
No changes No changes No changes
[Alex Tucker] 516eb5ee94da99618bf476c56c3e6517c2482083 - Remove old special case for when out/observations.csv exists.
[Alex Tucker] 6820fef84d1c73bbfb16d07f87259afa096c4cbc - Fix ragged rows. Use DOS line endings as that's what text/* mimetypes should do.
[lperryman] f961b501f993b6801d5d1bbfec841d36350e64a3 - datasets/DWP-Family-Resources-Survey-Carer/main.py had all the wrong formatting for some reason so changed
[lperryman] 22b78bfeee1cd7bcf5833e739f418c8b211490ae - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[lperryman] 1f3e2fec7a6f13c5c0ea02bcf96e77170ac62fd8 - datasets/DWP-Family-Resources-Survey-Carer/main.py, commented out the schema for the moment as it is raising a 404 error
[mikelovesbooks] 386eaf2559c7547c0ebc252327f160425470eba3 - added temporary manual trig file
[mikelovesbooks] a4e72e6d296eadf60ec9f43ea295284b1617b341 - updated PHE codelists
[mikelovesbooks] 92e9710cf77d6567a2422f330be4da61b8692203 - data from fingertips
[mikelovesbooks] 4dce0948a896af31013ae2554cab5d6a2b918dfe - remove old local data csv
[noreply] cffc20ac58d99cf982d93f417a6b5fc75915d639 - Delete main.ipynb
[noreply] 87ede54c0396e304ac5d372aa71eba0024f0e2d3 - Delete Jenkinsfile
[shannon1995black] be84d9fdec016c03bf7de6c1597c64218621d99a - update naming
[noreply] 928e88d31a7b985e10d265e871871edd92f9aa66 - remove unnecessary time period entry
[lperryman] 4431431355ab317f4d9aa3db8ce695cfb9c130ee - Adding rows to the components csv file
[shannon1995black] b4d0f885f6084447ec8add6ed66d3affc161332d - update main
[lperryman] 037a500fa0ea442f64b9e87949b519ac5c672e43 - Sorting ourt the schema file
[lperryman] d7079738021323d7aba78930006122c17eb2adb9 - Had a capital i one of the column headings when it should have been lower case!
[shannon1995black] 8260ab10b2288609275aa23585d28cc77faff340 - updates
[shannon1995black] 7871ceb8e22f7205829a9ca14da022fa0b86c374 - updated json file
[lperryman] 417d7d297486f1e7780b1ad3d26cfda4a37158f5 - Adding Period to columns.csv
[lperryman] 44e902bc5d106ebfa2eb318e4c64c528c42b5be4 - Getting rid of capital letter in one of the columns
[shannon1995black] af39b43f7fb1c3cbdce95f106bb5c8f81f7e5781 - update column name
[shannon1995black] 3a1135fd0c90a4d0174833f051dd372379ab2c69 - uncomment line to create observations.csv-schema.json
[lperryman] 78c14f03098459533da8df4fb7f970caf2d8f71b - Fixing columns.csv
[lperryman] 74a2b37b464c294dbeb19e5f4e41afdfb39c7ff0 - FIxing columns.csv
[lperryman] cdddeee62af46cccbf93274988364109ffd6e672 - FIxing columns.csv
[lperryman] 632a12b75329e5474b55649a26086f0753e8124a - FIxing columns.csv
[lperryman] 3ce5b581d49b56746c235eb25b055991cc7356da - FIxing columns.csv
[lperryman] bb77f055a6aff4914c2d2652efd5fd1b59149d8a - FIxing columns.csv
[Alex Tucker] 6f1cce14484ed02ddb7103995dd8cdd7c8f33cbe - Output dataset metadata and schema.
[lperryman] da8845089d902d7315ba221997bd3b7e2e087173 - FIxing columns.csv
[shannon1995black] 400c47b3af5219f66d019ca206d93bb598b25ad8 - updated value transformation type
[shannon1995black] b7f3b191dc4995a7ba3e2771a7f2bd00f9879e2d - title to uppercase
[lperryman] 513d057cabaf3c9b6e6297f7ae76f28063793427 - Change Year to period and formatted string to represent for 2 year period
[noreply] 3c54f0603efb9580f0cbd92741e32dda7c7bb283 - Update columns.csv
[lperryman] 30c46612e03dd759f8e62f92d5f5b0e880f3a6cb - Adding metadat data to codelists-metadata.json
[noreply] a2a2785da01e4297a272d42e5f8d4bb04f9fcd68 - Update codelists-metadata.json
[lperryman] 38454c78864e493cc8b9e456146933f8f746a75f - Adding trig files to output
[lperryman] d4778471823f9ed5dd602707e52556f97b572a94 - Adding trig files to output
[Alex Tucker] 0ecd7ef459fd07b8a337339d04a9d817502f4f4e - Use "landingPage" and "datasetNotes" for finding datasets/distributions.
[noreply] 3f797e6b294d01511a819e1c33d5116d84fe0024 - Update columns.csv
[lperryman] 86ee83e73743f19fa95788b2592a5c9b5c5302d0 - Adding trig files to output
[lperryman] f39704e62b7304dabe87fe5389c78b82fe57c41a - Replaceing empyt Value columns with 0
[lperryman] 267336c9e6821ecc18596392fa88d6986d9cf70f - Replaceing empyt Value columns with 0
[Grace Spitzer-Wong] aaf7c19ca60b42587a6e1a039d0c4fb2cc3d081f - Created codelist for SEN school types
[Grace Spitzer-Wong] 52e7b36436296f4c8eebebfe292d530f66a596d0 - removing spaces
[Alex Tucker] b2662d587b4af754555899f1ac626e0440ca95aa - Adding FRS Age Group dimension and Percentage of People measure for #10
[noreply] b492ad4b862db862312640ab25cc56db4bbe5ca0 - Update columns.csv
[noreply] 37dc236e927d6900104707f0d2876ecf4b5938c2 - Update columns.csv
[noreply] 8ca2458eee5788fe905e21a191a5c8e4f73d7bb6 - Update columns.csv
[noreply] cd212b405f2bc56b3f2fd07701e71c2fd31b6b84 - Update columns.csv
[noreply] 6e6653590b313072368b37b3dbe7caff64d4c091 - Update columns.csv
[noreply] 6f9391a76c71e50bb39aced28805df7c59f36ed6 - Update columns.csv
[noreply] 13659a5c5674e456e204d6fcfc91b109b1fe09bd - Update columns.csv
[Alex Tucker] ae198a177b6726a760e84b9dc3a06cb0d3aadc74 - Check scraper works from landingPage
[Alex Tucker] 4eabf140b4ee6169608b523db24e14f152d41c1d - Check scraper works from landingPage
[lperryman] 3ea3ab539753e3a60a5eca720a500e8128cef7a7 - Code for changing Sec to M, F,T had disappeared
[lperryman] d2dc8b12a011867fd4650a954d186054b5e7769c - Code for changing Sec to M, F,T had disappeared
[lperryman] 9cabfdb37e5528e356cc5a403da469480abdbc95 - Code for changing Sec to M, F,T had disappeared
[lperryman] 8e4ce46562a729ec80a4cec42ce7fd58455fa62c - Changing Sample Size in columns.csv to a measure and a number
[lperryman] 3c6df49054b927e50726c7fe30e63376cf28c106 - Adding a Measure Type column to my datasets
[vtula2000] 9ad5368fa24ae3a5a54cc107c43165ccaf2a23bb - Tidy data
[lperryman] 708323b3b7eb7182cd26611972370c3d8011b697 - Adding a Marker column to dataset and to columns.csv file
[Alex Tucker] 167ac3bd3b6ba3512c4de29282f8b64f0108d551 - Ignore ipynb notebooks, keep the Python instead.
[noreply] 21e12e901a0c5a4ad10aed35887a7b26b00709aa - Update columns.csv
[lperryman] 0e2c6a47031616dd61777f92258850f26495615b - Adding a Marker column to dataset and to columns.csv file
[noreply] aa434283bd91c9d5ad7be9de2965b521fda2541d - Update columns.csv
[noreply] 50b1dfe507de8c180b70d93628ebae6ce2fc46fa - Update columns.csv
[vtula2000] 7718b7c0ee713db5f231d406db7d97cd20ef8ce0 - url update
[noreply] 315ddf8cbcb9cc73b86831887a80606b176dfdde - Add files via upload
[noreply] 41e921f7bb35d0775135ee5ffb5909f6babbde42 - Add files via upload
[noreply] 5b0c145139019d96fb731f2fd297a0fa9b8c86d9 - Update columns.csv
[noreply] 3f64f2919b1f30b0b56e1f3fa0b4cf65efcb5dd5 - Update columns.csv
[Alex Tucker] aef10226c53c5e8a5e401a950b5f2c56dba4066c - Add some validation for columns.csv
[lperryman] fdb28502bdb82b76a6f9d6638953c2a56322ce7c - Adding Marker to comnponents.csv file
[lperryman] b9c55f7d948c14b24a649b2a3aa18a523efa5c16 - Adding Marker codelist file
[noreply] fcc1e1e5b7c9e4cfc5fcdb5e6730543977197d8d - Update codelists-metadata.json
[noreply] 14c69f2bb386d89338c4f87512bc43062cf4f9ba - Update main.py
[Grace Spitzer-Wong] a2cec17e509749a9352d326dd5fe7abdb703e2e9 - codelist renamed
[Alex Tucker] 991666338c05dfeae4e8aaa1b33044a03136b8b2 - Cleaned up some (, ), _, - and space chars.
[Alex Tucker] c80bf8f6082cb498f5db45163dedef67ef4d8850 - Removed some double hyphens for compatibility with the way gssutils pathify() turns labels into URL paths.
No changes
[Alex Tucker] 1f3bc6a4192a314eebb538fb3df22f48ab10c488 - Fix csvlints in codelists-metadata.json
[Alex Tucker] c3ed524eefafe973fa79e7e1efcced6d98bd463c - Unix filenames are case sensitive. Make codes consistent with gssutils pathify() function.
[Alex Tucker] 6502a4f6bb75498fe85c4aeb4d0bc9be2479d2df - Ensure CSV files have CRLF line endings.
[Alex Tucker] b943367c13180b1303686d63185390b505ddfae6 - Remove duplicate list. Re-order codelists metadata to check that all the codelists are listed and add any missing.
[Alex Tucker] c5192a273390881515405d7ce7367896cd09000f - Check columns.csv against schema.
[Alex Tucker] e73ae1f8138834830da9923f4f00cb7f3586424b - Add schema for components.csv and update tests.
[Alex Tucker] 6a14b50dbb530df024cb1cb056ad3fef09ce979c - Try putting hard quotes around filename to cope with special shell chars.
[Alex Tucker] efba49cceef190108778c71654b7137627362eaf - Add 'Count' measure type.
[noreply] 250cc46bdc95c5fc5affa612c3ca1c3042f579da - Update columns.csv
[lperryman] f7b973736f5aa1149844059185b2052425df292b - Removing spaces in column Measure Type
[noreply] 9e759c863fa0d8fa1ba058c4cdbb599bc0b4f47e - Update codelists-metadata.json
[noreply] a452dfcf68b6dfdddb429ae7550637f8a62c40db - Update codelists-metadata.json
[lperryman] 5f6c118b551b51545dc35b2b48acb8876519ad2b - Removing spaces in column Measure Type
[Alex Tucker] 181d7de5f1ccae6d03169a68bda82bc46c7984e9 - Value column needs a special definition as it gets 'pivotted'.
[noreply] 31bf0ad1fb9fd1d4302992f3287d69d3e9d4e19b - Pathify Value column of Identified-Support-Needs-of-Homeless-Households-2018-19 table
[noreply] 0c94c2c7be7d9817f85574a3761d21d405f98a18 - Update Charts.py
[noreply] 2bdefdfb31038d53be0412c45f3322615394e438 - Pathify-ing columns
[noreply] eb63def56680cbf4b2dc8c3940fc1d4cb62b53a6 - Create Reason(s) for failing to maintain accommodation
[noreply] 69156efb4788f2630b4110e8603fbeef260b70ce - Rename Reason(s) for failing to maintain accommodation to Reason(s)-for-failing-to-maintain-accommodation
[noreply] 0606e32bf77f9a0ffe08d9a13dcb42cca75555ba - Update Reason(s)-for-failing-to-maintain-accommodation
[noreply] d3cd8401abe0615dcd58ff37a2c76235eeeeaa09 - Rename Reason(s)-for-failing-to-maintain-accommodation to reason(s)-for-failing-to-maintain-accommodation
No changes
[noreply] 43203c3d61885a6833ef086e33deae8095d83270 - Create identified-support-needs-of-homeless-households
[noreply] 0fed31a08628c6e79da616700cdf6cd79af46c6a - Rename reason(s)-for-failing-to-maintain-accommodation to reasons-for-failing-to-maintain-accommodation
[Alex Tucker] aedc32557ddb6dcae2467f81d499a4bb329b56ba - Rename files as CSV. Add to list in codelists-metadata.json. Remove extra chars and get syntax right. Slightly tidy some labels.
[Alex Tucker] 1f7eeed26f6ad1a5a9ff9ea2e4f1ecf60e382a67 - suppport -> support
[Alex Tucker] b2021e74634a0d6e3665116f36a0b42bf620065e - Tidied and added dimension for "Identified support needs"
Build 'GSS_data/Disability/DWP-Family-Resources-Survey-Disability' is failing!
Last 50 lines of build output:
Changes since last successful build:
View full output