Open ajtucker opened 5 years ago
Build 'GSS_data/Health/ISD-Drug-and-Alcohol-Treatment-Waiting-Times' is failing!
Last 50 lines of build output:
[...truncated 210 lines...]
[0;32m---> 88[0;31m [0mragged_rows[0m[0;34m=[0m[0mragged_rows[0m[0;34m,[0m[0;34m[0m[0;34m[0m[0m
[0m[1;32m 89[0m )
[1;32m 90[0m [0mt1[0m [0;34m=[0m [0mperf_counter[0m[0;34m([0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
[0;32m~usr/local/lib/python3.7/site-packages/xlrd/book.py[0m in [0;36mbiff2_8_load[0;34m(self, filename, file_contents, logfile, verbosity, use_mmap, encoding_override, formatting_info, on_demand, ragged_rows)[0m
[1;32m 637[0m [0;32mif[0m [0mself[0m[0;34m.[0m[0mmem[0m[0;34m:[0m [0;32mbreak[0m[0;34m[0m[0;34m[0m[0m
[1;32m 638[0m [0;32melse[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[0;32m--> 639[0;31m [0;32mraise[0m [0mXLRDError[0m[0;34m([0m[0;34m"Can't find workbook in OLE2 compound document"[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
[0m[1;32m 640[0m [0;32melse[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[1;32m 641[0m [0;32mfor[0m [0mqname[0m [0;32min[0m [0;34m[[0m[0;34m'Workbook'[0m[0;34m,[0m [0;34m'Book'[0m[0;34m][0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[0;31mReadError[0m: Can't read Excel file: XLRDError("Can't find workbook in OLE2 compound document")
ReadError: Can't read Excel file: XLRDError("Can't find workbook in OLE2 compound document")
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 168a10bd871db4e693fd9710ac987dd5c15a9c6fdb25860e276b7fcb99aadd7d
$ docker rm -f 168a10bd871db4e693fd9710ac987dd5c15a9c6fdb25860e276b7fcb99aadd7d
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Validate CSV)
Stage "Validate CSV" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build: No changes
[Alex Tucker] 5328e76cfe9081687e10cc995cbe19af43d54cc6 - Re-enabled first two scripts. Use 'alcohol' for dataset family for now.
[vtula2000] 884eaa3bb9e1da50192878cbeb119a9847cdd484 - Period/age/Trust/Measure type/Unit updates
[Alex Tucker] 05c3e7eff7871326fbc26bbaf012f10e018a948d - Add schema to test output against review at
[Alex Tucker] 4ea8f4dd2d7bd9dd89f3c70e811cf0abeef77b14 - Add trigger from ref_alcohol.
No changes
[vtula2000] c6b71a6d2881888d4ecd6813245f226d85110756 - ag3
[Alex Tucker] a92a690fcdb67782f789b0fe79daf2078599f52e - Remove value from primaryKey; the combinations of dimensions need to be
No changes No changes No changes
No changes No changes No changes No changes No changes No changes No changes No changes No changes No changes No changes
[Alex Tucker] d82b13f35b53782a0e4f2a6f5c49bab4bc935f5d - Add test based on
[Alex Tucker] d73e6af2c0dea77acb9e96ca65708e74cc48210c - Add pipeline-utility-steps for readJSON
[Alex Tucker] fc1d75997fc176e81954e7ab6ffbdedbfc22f458 - Add configFileProvider and credentials binding plugins, for testing
[Alex Tucker] 757778395ce8eae2042318dab89507bf0da4df0e - Try implementing with callable global to set things up and compiled
[Alex Tucker] ff1f8c9bb849849e6ac2da7c8479e2993f958361 - Use Apache http components directly in cube import pipeline, with
[Alex Tucker] f776522d6cfe23a942dabfe1b24a4de48f444ec6 - Start verifying pipeline requests.
[Alex Tucker] 8ed2d1ed353d92fc61f6cc2d7ebde03d22a7486c - Use husdon.FilePath() to get file InputStream. May need special handling
[Alex Tucker] 9602186fd1815ffd26b2c32b9c32454293fe7712 - Apache components HttpHost uses -1 as default port for scheme; see if
[Alex Tucker] f5317f5a145b41d87055f98e139b6208a5b932be - Implement Drafter.publishDraftset()
[Alex Tucker] a1a9642147e2df65a73d873a5ab32e32eddc44dd - Test for and add cache buster config as part of publish.
[Alex Tucker] cf982038bd5549cba8db2be5a19ca9f567a192c7 - Test for jobDraft.replace() issue. Extend Exception rather than
[Alex Tucker] 03eb0af4dfc6218b69531819411002ac91b86058 - Implement codelist pipeline using HTTP Components direclty.
[Alex Tucker] a2e05b0886617515e6dafbbfbc290c2e6b03150f - British spelling of slugize :(
[Alex Tucker] 59ce786f5495d91bfe0be05f735b3719d651e5d6 - Use WORKSPACE env variable to find file to upload.
[Alex Tucker] ec8e2a1bf5b697cfccff3f12ec496c871eadf150 - Add test for write-lock (503) and implement retry/holdoff polling of
[Alex Tucker] 170a94578ff14f51ee25c75fb10752c6e386ba8c - Implement components pipeline call. Remove un-used methods.
[Alex Tucker] 74eca1533cfa548ab8196be54e077c0083b762d7 - Prefix file with workspace directory.
[Alex Tucker] 11592644cf0e40dbb91f4d4f885ab00b399dd11d - Typo, csvv -> csv.
[Alex Tucker] 3c869ff7583e91deea0d26910ae48712dc10c146 - Allow adding data from a remote HTTP source.
[Alex Tucker] 9703d169a2d7f0e576dc12070d3e75a1c8f2b631 - Need to return to break out from retry loop.
[Alex Tucker] 57b810eee25ce1249435af236755a151382dca37 - Attempt to avoid issues fetching external mapping (columns.csv) for upload.
[Alex Tucker] f7975dc9d2642014366c73686660a2e37708745c - Explicitly use addBinaryBody.
[Alex Tucker] 540ba45d5aa50426e9e1d3f7a1ec0411ddc164d4 - Write lock URI needs to have prepended.
[Alex Tucker] 6290fc536b2603617b26728abc883ac9169f23bf - Missed a missing /v1/status
.
[Alex Tucker] 5ee1bd86aebac936c0390926b177426944210e69 - Add optional argument for dataset metadata trig file.
[Alex Tucker] a75d492bb510a698967fb5411843dc5422b88016 - Make metadata param relative to CWD.
No changes No changes No changes No changes
[Alex Tucker] d304a5acc8766e52976306021fa62c6ab7bae04c - Add template transformation pipeline.
[vtula2000] 9a912db3b428e0cfba4903a3c3be2f6c005b2c5b - Duplicate errors
[Alex Tucker] 7eda5c2f5f1a251462cd0a2820b201263fd36e11 - Add getDraftsetEndpoint
[Alex Tucker] 7c9c4e98b4ee0c634379ab5253c3293b426e7301 - Add SPARQL tests step and publish results.
[Alex Tucker] 806951bf2ee882eb722ed68d14041b7f0e928fea - SPARQL tests need union-with-live=true
[vtula2000] 37b9f8617bc034a3cf436908038a1ab1c57d90dd - Update
[vtula2000] 560d3e9eb8ed7a4215403a969b4c06866bfe9711 - Code
[vtula2000] 4ff82326c20701c66426653f5f63ae57f10b5d33 - Code
No changes No changes
[vtula2000] 666fc9ab7a60d94e1db1485436d7f96099030f5c - Alcohol and Drugs data
[Alex Tucker] d747d17b909dea7f689436a623263ff531631c94 - Don't trigger GDP-tests as they're now run on the unpublished draftset.
[Alex Tucker] 62649fad57b72a99ab79e909cd88123217afcc80 - Use pipeline template.
No changes
[Alex Tucker] 57b7cae64f2422e744b548d8533c87ea96b0c7b0 - Template for multiple datasets.
[Alex Tucker] 554340c2f38e69909c77daea277188852640b339 - Disambiguate use of 'dataset'
[Alex Tucker] 1452178f3d07debcb12de21cb3782810370ff2c0 - Use $refFamily
No changes
[Alex Tucker] 0ab4797047cdc3a26e01fe2cfd6da3da461c57f3 - Try to always update Trello card.
[Alex Tucker] 2c3a2d2dcad68f95080061335209f3d7241b6af9 - If main.py exists, convert to notebook using jupytext.
[Alex Tucker] 1acd29462408540f9fbc087e739c4dd458b20af7 - Convert any .py files to .ipynb using jupytext.
No changes
No changes
Build 'GSS_data/Health/ISD-Drug-and-Alcohol-Treatment-Waiting-Times' is failing!
Last 50 lines of build output:
[...truncated 210 lines...]
[0;32m---> 88[0;31m [0mragged_rows[0m[0;34m=[0m[0mragged_rows[0m[0;34m,[0m[0;34m[0m[0;34m[0m[0m
[0m[1;32m 89[0m )
[1;32m 90[0m [0mt1[0m [0;34m=[0m [0mperf_counter[0m[0;34m([0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
[0;32m~usr/local/lib/python3.7/site-packages/xlrd/book.py[0m in [0;36mbiff2_8_load[0;34m(self, filename, file_contents, logfile, verbosity, use_mmap, encoding_override, formatting_info, on_demand, ragged_rows)[0m
[1;32m 637[0m [0;32mif[0m [0mself[0m[0;34m.[0m[0mmem[0m[0;34m:[0m [0;32mbreak[0m[0;34m[0m[0;34m[0m[0m
[1;32m 638[0m [0;32melse[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[0;32m--> 639[0;31m [0;32mraise[0m [0mXLRDError[0m[0;34m([0m[0;34m"Can't find workbook in OLE2 compound document"[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
[0m[1;32m 640[0m [0;32melse[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[1;32m 641[0m [0;32mfor[0m [0mqname[0m [0;32min[0m [0;34m[[0m[0;34m'Workbook'[0m[0;34m,[0m [0;34m'Book'[0m[0;34m][0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[0;31mReadError[0m: Can't read Excel file: XLRDError("Can't find workbook in OLE2 compound document")
ReadError: Can't read Excel file: XLRDError("Can't find workbook in OLE2 compound document")
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 5778c23caa48ca5d0459c2a7b4ec865db36eb806d8fba33c2a9e7d8efaff3cad
$ docker rm -f 5778c23caa48ca5d0459c2a7b4ec865db36eb806d8fba33c2a9e7d8efaff3cad
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Validate CSV)
Stage "Validate CSV" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build: No changes
[Alex Tucker] 5328e76cfe9081687e10cc995cbe19af43d54cc6 - Re-enabled first two scripts. Use 'alcohol' for dataset family for now.
[vtula2000] 884eaa3bb9e1da50192878cbeb119a9847cdd484 - Period/age/Trust/Measure type/Unit updates
[Alex Tucker] 05c3e7eff7871326fbc26bbaf012f10e018a948d - Add schema to test output against review at
[Alex Tucker] 4ea8f4dd2d7bd9dd89f3c70e811cf0abeef77b14 - Add trigger from ref_alcohol.
No changes
[vtula2000] c6b71a6d2881888d4ecd6813245f226d85110756 - ag3
[Alex Tucker] a92a690fcdb67782f789b0fe79daf2078599f52e - Remove value from primaryKey; the combinations of dimensions need to be
No changes No changes No changes
No changes No changes No changes No changes No changes No changes No changes No changes No changes No changes No changes
[Alex Tucker] d82b13f35b53782a0e4f2a6f5c49bab4bc935f5d - Add test based on
[Alex Tucker] d73e6af2c0dea77acb9e96ca65708e74cc48210c - Add pipeline-utility-steps for readJSON
[Alex Tucker] fc1d75997fc176e81954e7ab6ffbdedbfc22f458 - Add configFileProvider and credentials binding plugins, for testing
[Alex Tucker] 757778395ce8eae2042318dab89507bf0da4df0e - Try implementing with callable global to set things up and compiled
[Alex Tucker] ff1f8c9bb849849e6ac2da7c8479e2993f958361 - Use Apache http components directly in cube import pipeline, with
[Alex Tucker] f776522d6cfe23a942dabfe1b24a4de48f444ec6 - Start verifying pipeline requests.
[Alex Tucker] 8ed2d1ed353d92fc61f6cc2d7ebde03d22a7486c - Use husdon.FilePath() to get file InputStream. May need special handling
[Alex Tucker] 9602186fd1815ffd26b2c32b9c32454293fe7712 - Apache components HttpHost uses -1 as default port for scheme; see if
[Alex Tucker] f5317f5a145b41d87055f98e139b6208a5b932be - Implement Drafter.publishDraftset()
[Alex Tucker] a1a9642147e2df65a73d873a5ab32e32eddc44dd - Test for and add cache buster config as part of publish.
[Alex Tucker] cf982038bd5549cba8db2be5a19ca9f567a192c7 - Test for jobDraft.replace() issue. Extend Exception rather than
[Alex Tucker] 03eb0af4dfc6218b69531819411002ac91b86058 - Implement codelist pipeline using HTTP Components direclty.
[Alex Tucker] a2e05b0886617515e6dafbbfbc290c2e6b03150f - British spelling of slugize :(
[Alex Tucker] 59ce786f5495d91bfe0be05f735b3719d651e5d6 - Use WORKSPACE env variable to find file to upload.
[Alex Tucker] ec8e2a1bf5b697cfccff3f12ec496c871eadf150 - Add test for write-lock (503) and implement retry/holdoff polling of
[Alex Tucker] 170a94578ff14f51ee25c75fb10752c6e386ba8c - Implement components pipeline call. Remove un-used methods.
[Alex Tucker] 74eca1533cfa548ab8196be54e077c0083b762d7 - Prefix file with workspace directory.
[Alex Tucker] 11592644cf0e40dbb91f4d4f885ab00b399dd11d - Typo, csvv -> csv.
[Alex Tucker] 3c869ff7583e91deea0d26910ae48712dc10c146 - Allow adding data from a remote HTTP source.
[Alex Tucker] 9703d169a2d7f0e576dc12070d3e75a1c8f2b631 - Need to return to break out from retry loop.
[Alex Tucker] 57b810eee25ce1249435af236755a151382dca37 - Attempt to avoid issues fetching external mapping (columns.csv) for upload.
[Alex Tucker] f7975dc9d2642014366c73686660a2e37708745c - Explicitly use addBinaryBody.
[Alex Tucker] 540ba45d5aa50426e9e1d3f7a1ec0411ddc164d4 - Write lock URI needs to have prepended.
[Alex Tucker] 6290fc536b2603617b26728abc883ac9169f23bf - Missed a missing /v1/status
.
[Alex Tucker] 5ee1bd86aebac936c0390926b177426944210e69 - Add optional argument for dataset metadata trig file.
[Alex Tucker] a75d492bb510a698967fb5411843dc5422b88016 - Make metadata param relative to CWD.
No changes No changes No changes No changes
[Alex Tucker] d304a5acc8766e52976306021fa62c6ab7bae04c - Add template transformation pipeline.
[vtula2000] 9a912db3b428e0cfba4903a3c3be2f6c005b2c5b - Duplicate errors
[Alex Tucker] 7eda5c2f5f1a251462cd0a2820b201263fd36e11 - Add getDraftsetEndpoint
[Alex Tucker] 7c9c4e98b4ee0c634379ab5253c3293b426e7301 - Add SPARQL tests step and publish results.
[Alex Tucker] 806951bf2ee882eb722ed68d14041b7f0e928fea - SPARQL tests need union-with-live=true
[vtula2000] 37b9f8617bc034a3cf436908038a1ab1c57d90dd - Update
[vtula2000] 560d3e9eb8ed7a4215403a969b4c06866bfe9711 - Code
[vtula2000] 4ff82326c20701c66426653f5f63ae57f10b5d33 - Code
No changes No changes
[vtula2000] 666fc9ab7a60d94e1db1485436d7f96099030f5c - Alcohol and Drugs data
[Alex Tucker] d747d17b909dea7f689436a623263ff531631c94 - Don't trigger GDP-tests as they're now run on the unpublished draftset.
[Alex Tucker] 62649fad57b72a99ab79e909cd88123217afcc80 - Use pipeline template.
No changes
[Alex Tucker] 57b7cae64f2422e744b548d8533c87ea96b0c7b0 - Template for multiple datasets.
[Alex Tucker] 554340c2f38e69909c77daea277188852640b339 - Disambiguate use of 'dataset'
[Alex Tucker] 1452178f3d07debcb12de21cb3782810370ff2c0 - Use $refFamily
No changes
[Alex Tucker] 0ab4797047cdc3a26e01fe2cfd6da3da461c57f3 - Try to always update Trello card.
[Alex Tucker] 2c3a2d2dcad68f95080061335209f3d7241b6af9 - If main.py exists, convert to notebook using jupytext.
[Alex Tucker] 1acd29462408540f9fbc087e739c4dd458b20af7 - Convert any .py files to .ipynb using jupytext.
No changes
No changes
No changes
We're explicitly looming for April 2014 - March 2018 Demographic Tables
and it's not there anymore (or the page structure has changed so we're not getting it anymore).
Build 'GSS_data/Health/ISD-Drug-and-Alcohol-Treatment-Waiting-Times' is failing!
Last 50 lines of build output:
[...truncated 249 lines...]
[0;32m---> 88[0;31m [0mragged_rows[0m[0;34m=[0m[0mragged_rows[0m[0;34m,[0m[0;34m[0m[0;34m[0m[0m
[0m[1;32m 89[0m )
[1;32m 90[0m [0mt1[0m [0;34m=[0m [0mperf_counter[0m[0;34m([0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
[0;32m~usr/local/lib/python3.7/site-packages/xlrd/book.py[0m in [0;36mbiff2_8_load[0;34m(self, filename, file_contents, logfile, verbosity, use_mmap, encoding_override, formatting_info, on_demand, ragged_rows)[0m
[1;32m 637[0m [0;32mif[0m [0mself[0m[0;34m.[0m[0mmem[0m[0;34m:[0m [0;32mbreak[0m[0;34m[0m[0;34m[0m[0m
[1;32m 638[0m [0;32melse[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[0;32m--> 639[0;31m [0;32mraise[0m [0mXLRDError[0m[0;34m([0m[0;34m"Can't find workbook in OLE2 compound document"[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
[0m[1;32m 640[0m [0;32melse[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[1;32m 641[0m [0;32mfor[0m [0mqname[0m [0;32min[0m [0;34m[[0m[0;34m'Workbook'[0m[0;34m,[0m [0;34m'Book'[0m[0;34m][0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[0;31mReadError[0m: Can't read Excel file: XLRDError("Can't find workbook in OLE2 compound document")
ReadError: Can't read Excel file: XLRDError("Can't find workbook in OLE2 compound document")
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 222756b5df70b9fbc4635cbedd55aff15da41832cc910304325e2fb1a182789f
$ docker rm -f 222756b5df70b9fbc4635cbedd55aff15da41832cc910304325e2fb1a182789f
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Validate CSV)
Stage "Validate CSV" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build: No changes
[Alex Tucker] 5328e76cfe9081687e10cc995cbe19af43d54cc6 - Re-enabled first two scripts. Use 'alcohol' for dataset family for now.
[vtula2000] 884eaa3bb9e1da50192878cbeb119a9847cdd484 - Period/age/Trust/Measure type/Unit updates
[Alex Tucker] 05c3e7eff7871326fbc26bbaf012f10e018a948d - Add schema to test output against review at
[Alex Tucker] 4ea8f4dd2d7bd9dd89f3c70e811cf0abeef77b14 - Add trigger from ref_alcohol.
No changes
[vtula2000] c6b71a6d2881888d4ecd6813245f226d85110756 - ag3
[Alex Tucker] a92a690fcdb67782f789b0fe79daf2078599f52e - Remove value from primaryKey; the combinations of dimensions need to be
No changes No changes No changes
No changes No changes No changes No changes No changes No changes No changes No changes No changes No changes No changes
[Alex Tucker] d82b13f35b53782a0e4f2a6f5c49bab4bc935f5d - Add test based on
[Alex Tucker] d73e6af2c0dea77acb9e96ca65708e74cc48210c - Add pipeline-utility-steps for readJSON
[Alex Tucker] fc1d75997fc176e81954e7ab6ffbdedbfc22f458 - Add configFileProvider and credentials binding plugins, for testing
[Alex Tucker] 757778395ce8eae2042318dab89507bf0da4df0e - Try implementing with callable global to set things up and compiled
[Alex Tucker] ff1f8c9bb849849e6ac2da7c8479e2993f958361 - Use Apache http components directly in cube import pipeline, with
[Alex Tucker] f776522d6cfe23a942dabfe1b24a4de48f444ec6 - Start verifying pipeline requests.
[Alex Tucker] 8ed2d1ed353d92fc61f6cc2d7ebde03d22a7486c - Use husdon.FilePath() to get file InputStream. May need special handling
[Alex Tucker] 9602186fd1815ffd26b2c32b9c32454293fe7712 - Apache components HttpHost uses -1 as default port for scheme; see if
[Alex Tucker] f5317f5a145b41d87055f98e139b6208a5b932be - Implement Drafter.publishDraftset()
[Alex Tucker] a1a9642147e2df65a73d873a5ab32e32eddc44dd - Test for and add cache buster config as part of publish.
[Alex Tucker] cf982038bd5549cba8db2be5a19ca9f567a192c7 - Test for jobDraft.replace() issue. Extend Exception rather than
[Alex Tucker] 03eb0af4dfc6218b69531819411002ac91b86058 - Implement codelist pipeline using HTTP Components direclty.
[Alex Tucker] a2e05b0886617515e6dafbbfbc290c2e6b03150f - British spelling of slugize :(
[Alex Tucker] 59ce786f5495d91bfe0be05f735b3719d651e5d6 - Use WORKSPACE env variable to find file to upload.
[Alex Tucker] ec8e2a1bf5b697cfccff3f12ec496c871eadf150 - Add test for write-lock (503) and implement retry/holdoff polling of
[Alex Tucker] 170a94578ff14f51ee25c75fb10752c6e386ba8c - Implement components pipeline call. Remove un-used methods.
[Alex Tucker] 74eca1533cfa548ab8196be54e077c0083b762d7 - Prefix file with workspace directory.
[Alex Tucker] 11592644cf0e40dbb91f4d4f885ab00b399dd11d - Typo, csvv -> csv.
[Alex Tucker] 3c869ff7583e91deea0d26910ae48712dc10c146 - Allow adding data from a remote HTTP source.
[Alex Tucker] 9703d169a2d7f0e576dc12070d3e75a1c8f2b631 - Need to return to break out from retry loop.
[Alex Tucker] 57b810eee25ce1249435af236755a151382dca37 - Attempt to avoid issues fetching external mapping (columns.csv) for upload.
[Alex Tucker] f7975dc9d2642014366c73686660a2e37708745c - Explicitly use addBinaryBody.
[Alex Tucker] 540ba45d5aa50426e9e1d3f7a1ec0411ddc164d4 - Write lock URI needs to have prepended.
[Alex Tucker] 6290fc536b2603617b26728abc883ac9169f23bf - Missed a missing /v1/status
.
[Alex Tucker] 5ee1bd86aebac936c0390926b177426944210e69 - Add optional argument for dataset metadata trig file.
[Alex Tucker] a75d492bb510a698967fb5411843dc5422b88016 - Make metadata param relative to CWD.
No changes No changes No changes No changes
[Alex Tucker] d304a5acc8766e52976306021fa62c6ab7bae04c - Add template transformation pipeline.
[vtula2000] 9a912db3b428e0cfba4903a3c3be2f6c005b2c5b - Duplicate errors
[Alex Tucker] 7eda5c2f5f1a251462cd0a2820b201263fd36e11 - Add getDraftsetEndpoint
[Alex Tucker] 7c9c4e98b4ee0c634379ab5253c3293b426e7301 - Add SPARQL tests step and publish results.
[Alex Tucker] 806951bf2ee882eb722ed68d14041b7f0e928fea - SPARQL tests need union-with-live=true
[vtula2000] 37b9f8617bc034a3cf436908038a1ab1c57d90dd - Update
[vtula2000] 560d3e9eb8ed7a4215403a969b4c06866bfe9711 - Code
[vtula2000] 4ff82326c20701c66426653f5f63ae57f10b5d33 - Code
No changes No changes
[vtula2000] 666fc9ab7a60d94e1db1485436d7f96099030f5c - Alcohol and Drugs data
[Alex Tucker] d747d17b909dea7f689436a623263ff531631c94 - Don't trigger GDP-tests as they're now run on the unpublished draftset.
[Alex Tucker] 62649fad57b72a99ab79e909cd88123217afcc80 - Use pipeline template.
No changes
[Alex Tucker] 57b7cae64f2422e744b548d8533c87ea96b0c7b0 - Template for multiple datasets.
[Alex Tucker] 554340c2f38e69909c77daea277188852640b339 - Disambiguate use of 'dataset'
[Alex Tucker] 1452178f3d07debcb12de21cb3782810370ff2c0 - Use $refFamily
No changes
[Alex Tucker] 0ab4797047cdc3a26e01fe2cfd6da3da461c57f3 - Try to always update Trello card.
[Alex Tucker] 2c3a2d2dcad68f95080061335209f3d7241b6af9 - If main.py exists, convert to notebook using jupytext.
[Alex Tucker] 1acd29462408540f9fbc087e739c4dd458b20af7 - Convert any .py files to .ipynb using jupytext.
No changes
No changes
No changes
Build 'GSS_data/Health/ISD-Drug-and-Alcohol-Treatment-Waiting-Times' is failing!
Last 50 lines of build output:
[...truncated 213 lines...]
[0;32m---> 88[0;31m [0mragged_rows[0m[0;34m=[0m[0mragged_rows[0m[0;34m,[0m[0;34m[0m[0;34m[0m[0m
[0m[1;32m 89[0m )
[1;32m 90[0m [0mt1[0m [0;34m=[0m [0mperf_counter[0m[0;34m([0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
[0;32m~usr/local/lib/python3.7/site-packages/xlrd/book.py[0m in [0;36mbiff2_8_load[0;34m(self, filename, file_contents, logfile, verbosity, use_mmap, encoding_override, formatting_info, on_demand, ragged_rows)[0m
[1;32m 637[0m [0;32mif[0m [0mself[0m[0;34m.[0m[0mmem[0m[0;34m:[0m [0;32mbreak[0m[0;34m[0m[0;34m[0m[0m
[1;32m 638[0m [0;32melse[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[0;32m--> 639[0;31m [0;32mraise[0m [0mXLRDError[0m[0;34m([0m[0;34m"Can't find workbook in OLE2 compound document"[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
[0m[1;32m 640[0m [0;32melse[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[1;32m 641[0m [0;32mfor[0m [0mqname[0m [0;32min[0m [0;34m[[0m[0;34m'Workbook'[0m[0;34m,[0m [0;34m'Book'[0m[0;34m][0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[0;31mReadError[0m: Can't read Excel file: XLRDError("Can't find workbook in OLE2 compound document")
ReadError: Can't read Excel file: XLRDError("Can't find workbook in OLE2 compound document")
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 745dc6dff58455ddf9fa3a6950739b870b70bd21887413ce3682c8d8184f2a1e
$ docker rm -f 745dc6dff58455ddf9fa3a6950739b870b70bd21887413ce3682c8d8184f2a1e
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Validate CSV)
Stage "Validate CSV" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build: No changes
[Alex Tucker] 5328e76cfe9081687e10cc995cbe19af43d54cc6 - Re-enabled first two scripts. Use 'alcohol' for dataset family for now.
[vtula2000] 884eaa3bb9e1da50192878cbeb119a9847cdd484 - Period/age/Trust/Measure type/Unit updates
[Alex Tucker] 05c3e7eff7871326fbc26bbaf012f10e018a948d - Add schema to test output against review at
[Alex Tucker] 4ea8f4dd2d7bd9dd89f3c70e811cf0abeef77b14 - Add trigger from ref_alcohol.
No changes
[vtula2000] c6b71a6d2881888d4ecd6813245f226d85110756 - ag3
[Alex Tucker] a92a690fcdb67782f789b0fe79daf2078599f52e - Remove value from primaryKey; the combinations of dimensions need to be
No changes No changes No changes
No changes No changes No changes No changes No changes No changes No changes No changes No changes No changes No changes
[Alex Tucker] d82b13f35b53782a0e4f2a6f5c49bab4bc935f5d - Add test based on
[Alex Tucker] d73e6af2c0dea77acb9e96ca65708e74cc48210c - Add pipeline-utility-steps for readJSON
[Alex Tucker] fc1d75997fc176e81954e7ab6ffbdedbfc22f458 - Add configFileProvider and credentials binding plugins, for testing
[Alex Tucker] 757778395ce8eae2042318dab89507bf0da4df0e - Try implementing with callable global to set things up and compiled
[Alex Tucker] ff1f8c9bb849849e6ac2da7c8479e2993f958361 - Use Apache http components directly in cube import pipeline, with
[Alex Tucker] f776522d6cfe23a942dabfe1b24a4de48f444ec6 - Start verifying pipeline requests.
[Alex Tucker] 8ed2d1ed353d92fc61f6cc2d7ebde03d22a7486c - Use husdon.FilePath() to get file InputStream. May need special handling
[Alex Tucker] 9602186fd1815ffd26b2c32b9c32454293fe7712 - Apache components HttpHost uses -1 as default port for scheme; see if
[Alex Tucker] f5317f5a145b41d87055f98e139b6208a5b932be - Implement Drafter.publishDraftset()
[Alex Tucker] a1a9642147e2df65a73d873a5ab32e32eddc44dd - Test for and add cache buster config as part of publish.
[Alex Tucker] cf982038bd5549cba8db2be5a19ca9f567a192c7 - Test for jobDraft.replace() issue. Extend Exception rather than
[Alex Tucker] 03eb0af4dfc6218b69531819411002ac91b86058 - Implement codelist pipeline using HTTP Components direclty.
[Alex Tucker] a2e05b0886617515e6dafbbfbc290c2e6b03150f - British spelling of slugize :(
[Alex Tucker] 59ce786f5495d91bfe0be05f735b3719d651e5d6 - Use WORKSPACE env variable to find file to upload.
[Alex Tucker] ec8e2a1bf5b697cfccff3f12ec496c871eadf150 - Add test for write-lock (503) and implement retry/holdoff polling of
[Alex Tucker] 170a94578ff14f51ee25c75fb10752c6e386ba8c - Implement components pipeline call. Remove un-used methods.
[Alex Tucker] 74eca1533cfa548ab8196be54e077c0083b762d7 - Prefix file with workspace directory.
[Alex Tucker] 11592644cf0e40dbb91f4d4f885ab00b399dd11d - Typo, csvv -> csv.
[Alex Tucker] 3c869ff7583e91deea0d26910ae48712dc10c146 - Allow adding data from a remote HTTP source.
[Alex Tucker] 9703d169a2d7f0e576dc12070d3e75a1c8f2b631 - Need to return to break out from retry loop.
[Alex Tucker] 57b810eee25ce1249435af236755a151382dca37 - Attempt to avoid issues fetching external mapping (columns.csv) for upload.
[Alex Tucker] f7975dc9d2642014366c73686660a2e37708745c - Explicitly use addBinaryBody.
[Alex Tucker] 540ba45d5aa50426e9e1d3f7a1ec0411ddc164d4 - Write lock URI needs to have prepended.
[Alex Tucker] 6290fc536b2603617b26728abc883ac9169f23bf - Missed a missing /v1/status
.
[Alex Tucker] 5ee1bd86aebac936c0390926b177426944210e69 - Add optional argument for dataset metadata trig file.
[Alex Tucker] a75d492bb510a698967fb5411843dc5422b88016 - Make metadata param relative to CWD.
No changes No changes No changes No changes
[Alex Tucker] d304a5acc8766e52976306021fa62c6ab7bae04c - Add template transformation pipeline.
[vtula2000] 9a912db3b428e0cfba4903a3c3be2f6c005b2c5b - Duplicate errors
[Alex Tucker] 7eda5c2f5f1a251462cd0a2820b201263fd36e11 - Add getDraftsetEndpoint
[Alex Tucker] 7c9c4e98b4ee0c634379ab5253c3293b426e7301 - Add SPARQL tests step and publish results.
[Alex Tucker] 806951bf2ee882eb722ed68d14041b7f0e928fea - SPARQL tests need union-with-live=true
[vtula2000] 37b9f8617bc034a3cf436908038a1ab1c57d90dd - Update
[vtula2000] 560d3e9eb8ed7a4215403a969b4c06866bfe9711 - Code
[vtula2000] 4ff82326c20701c66426653f5f63ae57f10b5d33 - Code
No changes No changes
[vtula2000] 666fc9ab7a60d94e1db1485436d7f96099030f5c - Alcohol and Drugs data
[Alex Tucker] d747d17b909dea7f689436a623263ff531631c94 - Don't trigger GDP-tests as they're now run on the unpublished draftset.
[Alex Tucker] 62649fad57b72a99ab79e909cd88123217afcc80 - Use pipeline template.
No changes
[Alex Tucker] 57b7cae64f2422e744b548d8533c87ea96b0c7b0 - Template for multiple datasets.
[Alex Tucker] 554340c2f38e69909c77daea277188852640b339 - Disambiguate use of 'dataset'
[Alex Tucker] 1452178f3d07debcb12de21cb3782810370ff2c0 - Use $refFamily
No changes
[Alex Tucker] 0ab4797047cdc3a26e01fe2cfd6da3da461c57f3 - Try to always update Trello card.
[Alex Tucker] 2c3a2d2dcad68f95080061335209f3d7241b6af9 - If main.py exists, convert to notebook using jupytext.
[Alex Tucker] 1acd29462408540f9fbc087e739c4dd458b20af7 - Convert any .py files to .ipynb using jupytext.
No changes
No changes
No changes
[Alex Tucker] cc2bca87d857753755272fa5aaa08034ec2428f6 - Add template for ref_* pipelines.
[Alex Tucker] fd491cc35f5f1a690f227435207d77378bce174e - Also validate columns.csv and components.csv.
Build 'GSS_data/Health/ISD-Drug-and-Alcohol-Treatment-Waiting-Times' is failing!
Last 50 lines of build output:
[...truncated 212 lines...]
[0;32m---> 88[0;31m [0mragged_rows[0m[0;34m=[0m[0mragged_rows[0m[0;34m,[0m[0;34m[0m[0;34m[0m[0m
[0m[1;32m 89[0m )
[1;32m 90[0m [0mt1[0m [0;34m=[0m [0mperf_counter[0m[0;34m([0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
[0;32m~usr/local/lib/python3.7/site-packages/xlrd/book.py[0m in [0;36mbiff2_8_load[0;34m(self, filename, file_contents, logfile, verbosity, use_mmap, encoding_override, formatting_info, on_demand, ragged_rows)[0m
[1;32m 637[0m [0;32mif[0m [0mself[0m[0;34m.[0m[0mmem[0m[0;34m:[0m [0;32mbreak[0m[0;34m[0m[0;34m[0m[0m
[1;32m 638[0m [0;32melse[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[0;32m--> 639[0;31m [0;32mraise[0m [0mXLRDError[0m[0;34m([0m[0;34m"Can't find workbook in OLE2 compound document"[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
[0m[1;32m 640[0m [0;32melse[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[1;32m 641[0m [0;32mfor[0m [0mqname[0m [0;32min[0m [0;34m[[0m[0;34m'Workbook'[0m[0;34m,[0m [0;34m'Book'[0m[0;34m][0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[0;31mReadError[0m: Can't read Excel file: XLRDError("Can't find workbook in OLE2 compound document")
ReadError: Can't read Excel file: XLRDError("Can't find workbook in OLE2 compound document")
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 80ea1809b5cb77aaf08a32d6f108eda3a07f8b9ab194564ee8c6a469bce0ca51
$ docker rm -f 80ea1809b5cb77aaf08a32d6f108eda3a07f8b9ab194564ee8c6a469bce0ca51
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Validate CSV)
Stage "Validate CSV" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build: No changes
[Alex Tucker] 5328e76cfe9081687e10cc995cbe19af43d54cc6 - Re-enabled first two scripts. Use 'alcohol' for dataset family for now.
[vtula2000] 884eaa3bb9e1da50192878cbeb119a9847cdd484 - Period/age/Trust/Measure type/Unit updates
[Alex Tucker] 05c3e7eff7871326fbc26bbaf012f10e018a948d - Add schema to test output against review at
[Alex Tucker] 4ea8f4dd2d7bd9dd89f3c70e811cf0abeef77b14 - Add trigger from ref_alcohol.
No changes
[vtula2000] c6b71a6d2881888d4ecd6813245f226d85110756 - ag3
[Alex Tucker] a92a690fcdb67782f789b0fe79daf2078599f52e - Remove value from primaryKey; the combinations of dimensions need to be
No changes No changes No changes
No changes No changes No changes No changes No changes No changes No changes No changes No changes No changes No changes
[Alex Tucker] d82b13f35b53782a0e4f2a6f5c49bab4bc935f5d - Add test based on
[Alex Tucker] d73e6af2c0dea77acb9e96ca65708e74cc48210c - Add pipeline-utility-steps for readJSON
[Alex Tucker] fc1d75997fc176e81954e7ab6ffbdedbfc22f458 - Add configFileProvider and credentials binding plugins, for testing
[Alex Tucker] 757778395ce8eae2042318dab89507bf0da4df0e - Try implementing with callable global to set things up and compiled
[Alex Tucker] ff1f8c9bb849849e6ac2da7c8479e2993f958361 - Use Apache http components directly in cube import pipeline, with
[Alex Tucker] f776522d6cfe23a942dabfe1b24a4de48f444ec6 - Start verifying pipeline requests.
[Alex Tucker] 8ed2d1ed353d92fc61f6cc2d7ebde03d22a7486c - Use husdon.FilePath() to get file InputStream. May need special handling
[Alex Tucker] 9602186fd1815ffd26b2c32b9c32454293fe7712 - Apache components HttpHost uses -1 as default port for scheme; see if
[Alex Tucker] f5317f5a145b41d87055f98e139b6208a5b932be - Implement Drafter.publishDraftset()
[Alex Tucker] a1a9642147e2df65a73d873a5ab32e32eddc44dd - Test for and add cache buster config as part of publish.
[Alex Tucker] cf982038bd5549cba8db2be5a19ca9f567a192c7 - Test for jobDraft.replace() issue. Extend Exception rather than
[Alex Tucker] 03eb0af4dfc6218b69531819411002ac91b86058 - Implement codelist pipeline using HTTP Components direclty.
[Alex Tucker] a2e05b0886617515e6dafbbfbc290c2e6b03150f - British spelling of slugize :(
[Alex Tucker] 59ce786f5495d91bfe0be05f735b3719d651e5d6 - Use WORKSPACE env variable to find file to upload.
[Alex Tucker] ec8e2a1bf5b697cfccff3f12ec496c871eadf150 - Add test for write-lock (503) and implement retry/holdoff polling of
[Alex Tucker] 170a94578ff14f51ee25c75fb10752c6e386ba8c - Implement components pipeline call. Remove un-used methods.
[Alex Tucker] 74eca1533cfa548ab8196be54e077c0083b762d7 - Prefix file with workspace directory.
[Alex Tucker] 11592644cf0e40dbb91f4d4f885ab00b399dd11d - Typo, csvv -> csv.
[Alex Tucker] 3c869ff7583e91deea0d26910ae48712dc10c146 - Allow adding data from a remote HTTP source.
[Alex Tucker] 9703d169a2d7f0e576dc12070d3e75a1c8f2b631 - Need to return to break out from retry loop.
[Alex Tucker] 57b810eee25ce1249435af236755a151382dca37 - Attempt to avoid issues fetching external mapping (columns.csv) for upload.
[Alex Tucker] f7975dc9d2642014366c73686660a2e37708745c - Explicitly use addBinaryBody.
[Alex Tucker] 540ba45d5aa50426e9e1d3f7a1ec0411ddc164d4 - Write lock URI needs to have prepended.
[Alex Tucker] 6290fc536b2603617b26728abc883ac9169f23bf - Missed a missing /v1/status
.
[Alex Tucker] 5ee1bd86aebac936c0390926b177426944210e69 - Add optional argument for dataset metadata trig file.
[Alex Tucker] a75d492bb510a698967fb5411843dc5422b88016 - Make metadata param relative to CWD.
No changes No changes No changes No changes
[Alex Tucker] d304a5acc8766e52976306021fa62c6ab7bae04c - Add template transformation pipeline.
[vtula2000] 9a912db3b428e0cfba4903a3c3be2f6c005b2c5b - Duplicate errors
[Alex Tucker] 7eda5c2f5f1a251462cd0a2820b201263fd36e11 - Add getDraftsetEndpoint
[Alex Tucker] 7c9c4e98b4ee0c634379ab5253c3293b426e7301 - Add SPARQL tests step and publish results.
[Alex Tucker] 806951bf2ee882eb722ed68d14041b7f0e928fea - SPARQL tests need union-with-live=true
[vtula2000] 37b9f8617bc034a3cf436908038a1ab1c57d90dd - Update
[vtula2000] 560d3e9eb8ed7a4215403a969b4c06866bfe9711 - Code
[vtula2000] 4ff82326c20701c66426653f5f63ae57f10b5d33 - Code
No changes No changes
[vtula2000] 666fc9ab7a60d94e1db1485436d7f96099030f5c - Alcohol and Drugs data
[Alex Tucker] d747d17b909dea7f689436a623263ff531631c94 - Don't trigger GDP-tests as they're now run on the unpublished draftset.
[Alex Tucker] 62649fad57b72a99ab79e909cd88123217afcc80 - Use pipeline template.
No changes
[Alex Tucker] 57b7cae64f2422e744b548d8533c87ea96b0c7b0 - Template for multiple datasets.
[Alex Tucker] 554340c2f38e69909c77daea277188852640b339 - Disambiguate use of 'dataset'
[Alex Tucker] 1452178f3d07debcb12de21cb3782810370ff2c0 - Use $refFamily
No changes
[Alex Tucker] 0ab4797047cdc3a26e01fe2cfd6da3da461c57f3 - Try to always update Trello card.
[Alex Tucker] 2c3a2d2dcad68f95080061335209f3d7241b6af9 - If main.py exists, convert to notebook using jupytext.
[Alex Tucker] 1acd29462408540f9fbc087e739c4dd458b20af7 - Convert any .py files to .ipynb using jupytext.
No changes
No changes
No changes
[Alex Tucker] cc2bca87d857753755272fa5aaa08034ec2428f6 - Add template for ref_* pipelines.
[Alex Tucker] fd491cc35f5f1a690f227435207d77378bce174e - Also validate columns.csv and components.csv.
No changes
Build 'GSS_data/Health/ISD-Drug-and-Alcohol-Treatment-Waiting-Times' is failing!
Last 50 lines of build output:
[...truncated 210 lines...]
[0;32m---> 88[0;31m [0mragged_rows[0m[0;34m=[0m[0mragged_rows[0m[0;34m,[0m[0;34m[0m[0;34m[0m[0m
[0m[1;32m 89[0m )
[1;32m 90[0m [0mt1[0m [0;34m=[0m [0mperf_counter[0m[0;34m([0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
[0;32m~usr/local/lib/python3.7/site-packages/xlrd/book.py[0m in [0;36mbiff2_8_load[0;34m(self, filename, file_contents, logfile, verbosity, use_mmap, encoding_override, formatting_info, on_demand, ragged_rows)[0m
[1;32m 637[0m [0;32mif[0m [0mself[0m[0;34m.[0m[0mmem[0m[0;34m:[0m [0;32mbreak[0m[0;34m[0m[0;34m[0m[0m
[1;32m 638[0m [0;32melse[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[0;32m--> 639[0;31m [0;32mraise[0m [0mXLRDError[0m[0;34m([0m[0;34m"Can't find workbook in OLE2 compound document"[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
[0m[1;32m 640[0m [0;32melse[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[1;32m 641[0m [0;32mfor[0m [0mqname[0m [0;32min[0m [0;34m[[0m[0;34m'Workbook'[0m[0;34m,[0m [0;34m'Book'[0m[0;34m][0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[0;31mReadError[0m: Can't read Excel file: XLRDError("Can't find workbook in OLE2 compound document")
ReadError: Can't read Excel file: XLRDError("Can't find workbook in OLE2 compound document")
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 885cdbd51a4a660c0ba347f65ea90cc8967780106a0925b7b4c50349c16bed41
$ docker rm -f 885cdbd51a4a660c0ba347f65ea90cc8967780106a0925b7b4c50349c16bed41
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Validate CSV)
Stage "Validate CSV" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build: No changes
[Alex Tucker] 5328e76cfe9081687e10cc995cbe19af43d54cc6 - Re-enabled first two scripts. Use 'alcohol' for dataset family for now.
[vtula2000] 884eaa3bb9e1da50192878cbeb119a9847cdd484 - Period/age/Trust/Measure type/Unit updates
[Alex Tucker] 05c3e7eff7871326fbc26bbaf012f10e018a948d - Add schema to test output against review at
[Alex Tucker] 4ea8f4dd2d7bd9dd89f3c70e811cf0abeef77b14 - Add trigger from ref_alcohol.
No changes
[vtula2000] c6b71a6d2881888d4ecd6813245f226d85110756 - ag3
[Alex Tucker] a92a690fcdb67782f789b0fe79daf2078599f52e - Remove value from primaryKey; the combinations of dimensions need to be
No changes No changes No changes
No changes No changes No changes No changes No changes No changes No changes No changes No changes No changes No changes
[Alex Tucker] d82b13f35b53782a0e4f2a6f5c49bab4bc935f5d - Add test based on
[Alex Tucker] d73e6af2c0dea77acb9e96ca65708e74cc48210c - Add pipeline-utility-steps for readJSON
[Alex Tucker] fc1d75997fc176e81954e7ab6ffbdedbfc22f458 - Add configFileProvider and credentials binding plugins, for testing
[Alex Tucker] 757778395ce8eae2042318dab89507bf0da4df0e - Try implementing with callable global to set things up and compiled
[Alex Tucker] ff1f8c9bb849849e6ac2da7c8479e2993f958361 - Use Apache http components directly in cube import pipeline, with
[Alex Tucker] f776522d6cfe23a942dabfe1b24a4de48f444ec6 - Start verifying pipeline requests.
[Alex Tucker] 8ed2d1ed353d92fc61f6cc2d7ebde03d22a7486c - Use husdon.FilePath() to get file InputStream. May need special handling
[Alex Tucker] 9602186fd1815ffd26b2c32b9c32454293fe7712 - Apache components HttpHost uses -1 as default port for scheme; see if
[Alex Tucker] f5317f5a145b41d87055f98e139b6208a5b932be - Implement Drafter.publishDraftset()
[Alex Tucker] a1a9642147e2df65a73d873a5ab32e32eddc44dd - Test for and add cache buster config as part of publish.
[Alex Tucker] cf982038bd5549cba8db2be5a19ca9f567a192c7 - Test for jobDraft.replace() issue. Extend Exception rather than
[Alex Tucker] 03eb0af4dfc6218b69531819411002ac91b86058 - Implement codelist pipeline using HTTP Components direclty.
[Alex Tucker] a2e05b0886617515e6dafbbfbc290c2e6b03150f - British spelling of slugize :(
[Alex Tucker] 59ce786f5495d91bfe0be05f735b3719d651e5d6 - Use WORKSPACE env variable to find file to upload.
[Alex Tucker] ec8e2a1bf5b697cfccff3f12ec496c871eadf150 - Add test for write-lock (503) and implement retry/holdoff polling of
[Alex Tucker] 170a94578ff14f51ee25c75fb10752c6e386ba8c - Implement components pipeline call. Remove un-used methods.
[Alex Tucker] 74eca1533cfa548ab8196be54e077c0083b762d7 - Prefix file with workspace directory.
[Alex Tucker] 11592644cf0e40dbb91f4d4f885ab00b399dd11d - Typo, csvv -> csv.
[Alex Tucker] 3c869ff7583e91deea0d26910ae48712dc10c146 - Allow adding data from a remote HTTP source.
[Alex Tucker] 9703d169a2d7f0e576dc12070d3e75a1c8f2b631 - Need to return to break out from retry loop.
[Alex Tucker] 57b810eee25ce1249435af236755a151382dca37 - Attempt to avoid issues fetching external mapping (columns.csv) for upload.
[Alex Tucker] f7975dc9d2642014366c73686660a2e37708745c - Explicitly use addBinaryBody.
[Alex Tucker] 540ba45d5aa50426e9e1d3f7a1ec0411ddc164d4 - Write lock URI needs to have prepended.
[Alex Tucker] 6290fc536b2603617b26728abc883ac9169f23bf - Missed a missing /v1/status
.
[Alex Tucker] 5ee1bd86aebac936c0390926b177426944210e69 - Add optional argument for dataset metadata trig file.
[Alex Tucker] a75d492bb510a698967fb5411843dc5422b88016 - Make metadata param relative to CWD.
No changes No changes No changes No changes
[Alex Tucker] d304a5acc8766e52976306021fa62c6ab7bae04c - Add template transformation pipeline.
[vtula2000] 9a912db3b428e0cfba4903a3c3be2f6c005b2c5b - Duplicate errors
[Alex Tucker] 7eda5c2f5f1a251462cd0a2820b201263fd36e11 - Add getDraftsetEndpoint
[Alex Tucker] 7c9c4e98b4ee0c634379ab5253c3293b426e7301 - Add SPARQL tests step and publish results.
[Alex Tucker] 806951bf2ee882eb722ed68d14041b7f0e928fea - SPARQL tests need union-with-live=true
[vtula2000] 37b9f8617bc034a3cf436908038a1ab1c57d90dd - Update
[vtula2000] 560d3e9eb8ed7a4215403a969b4c06866bfe9711 - Code
[vtula2000] 4ff82326c20701c66426653f5f63ae57f10b5d33 - Code
No changes No changes
[vtula2000] 666fc9ab7a60d94e1db1485436d7f96099030f5c - Alcohol and Drugs data
[Alex Tucker] d747d17b909dea7f689436a623263ff531631c94 - Don't trigger GDP-tests as they're now run on the unpublished draftset.
[Alex Tucker] 62649fad57b72a99ab79e909cd88123217afcc80 - Use pipeline template.
No changes
[Alex Tucker] 57b7cae64f2422e744b548d8533c87ea96b0c7b0 - Template for multiple datasets.
[Alex Tucker] 554340c2f38e69909c77daea277188852640b339 - Disambiguate use of 'dataset'
[Alex Tucker] 1452178f3d07debcb12de21cb3782810370ff2c0 - Use $refFamily
No changes
[Alex Tucker] 0ab4797047cdc3a26e01fe2cfd6da3da461c57f3 - Try to always update Trello card.
[Alex Tucker] 2c3a2d2dcad68f95080061335209f3d7241b6af9 - If main.py exists, convert to notebook using jupytext.
[Alex Tucker] 1acd29462408540f9fbc087e739c4dd458b20af7 - Convert any .py files to .ipynb using jupytext.
No changes
No changes
No changes
[Alex Tucker] cc2bca87d857753755272fa5aaa08034ec2428f6 - Add template for ref_* pipelines.
[Alex Tucker] fd491cc35f5f1a690f227435207d77378bce174e - Also validate columns.csv and components.csv.
No changes
Build 'GSS_data/Health/ISD-Drug-and-Alcohol-Treatment-Waiting-Times' is failing!
Last 50 lines of build output:
[...truncated 212 lines...]
[0;32m---> 88[0;31m [0mragged_rows[0m[0;34m=[0m[0mragged_rows[0m[0;34m,[0m[0;34m[0m[0;34m[0m[0m
[0m[1;32m 89[0m )
[1;32m 90[0m [0mt1[0m [0;34m=[0m [0mperf_counter[0m[0;34m([0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
[0;32m~usr/local/lib/python3.7/site-packages/xlrd/book.py[0m in [0;36mbiff2_8_load[0;34m(self, filename, file_contents, logfile, verbosity, use_mmap, encoding_override, formatting_info, on_demand, ragged_rows)[0m
[1;32m 637[0m [0;32mif[0m [0mself[0m[0;34m.[0m[0mmem[0m[0;34m:[0m [0;32mbreak[0m[0;34m[0m[0;34m[0m[0m
[1;32m 638[0m [0;32melse[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[0;32m--> 639[0;31m [0;32mraise[0m [0mXLRDError[0m[0;34m([0m[0;34m"Can't find workbook in OLE2 compound document"[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
[0m[1;32m 640[0m [0;32melse[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[1;32m 641[0m [0;32mfor[0m [0mqname[0m [0;32min[0m [0;34m[[0m[0;34m'Workbook'[0m[0;34m,[0m [0;34m'Book'[0m[0;34m][0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[0;31mReadError[0m: Can't read Excel file: XLRDError("Can't find workbook in OLE2 compound document")
ReadError: Can't read Excel file: XLRDError("Can't find workbook in OLE2 compound document")
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 180707cca8f07feabd559a56d986d78a86fd900b360dc09f00f3855226115b41
$ docker rm -f 180707cca8f07feabd559a56d986d78a86fd900b360dc09f00f3855226115b41
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Validate CSV)
Stage "Validate CSV" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build: No changes
[Alex Tucker] 5328e76cfe9081687e10cc995cbe19af43d54cc6 - Re-enabled first two scripts. Use 'alcohol' for dataset family for now.
[vtula2000] 884eaa3bb9e1da50192878cbeb119a9847cdd484 - Period/age/Trust/Measure type/Unit updates
[Alex Tucker] 05c3e7eff7871326fbc26bbaf012f10e018a948d - Add schema to test output against review at
[Alex Tucker] 4ea8f4dd2d7bd9dd89f3c70e811cf0abeef77b14 - Add trigger from ref_alcohol.
No changes
[vtula2000] c6b71a6d2881888d4ecd6813245f226d85110756 - ag3
[Alex Tucker] a92a690fcdb67782f789b0fe79daf2078599f52e - Remove value from primaryKey; the combinations of dimensions need to be
No changes No changes No changes
No changes No changes No changes No changes No changes No changes No changes No changes No changes No changes No changes
[Alex Tucker] d82b13f35b53782a0e4f2a6f5c49bab4bc935f5d - Add test based on
[Alex Tucker] d73e6af2c0dea77acb9e96ca65708e74cc48210c - Add pipeline-utility-steps for readJSON
[Alex Tucker] fc1d75997fc176e81954e7ab6ffbdedbfc22f458 - Add configFileProvider and credentials binding plugins, for testing
[Alex Tucker] 757778395ce8eae2042318dab89507bf0da4df0e - Try implementing with callable global to set things up and compiled
[Alex Tucker] ff1f8c9bb849849e6ac2da7c8479e2993f958361 - Use Apache http components directly in cube import pipeline, with
[Alex Tucker] f776522d6cfe23a942dabfe1b24a4de48f444ec6 - Start verifying pipeline requests.
[Alex Tucker] 8ed2d1ed353d92fc61f6cc2d7ebde03d22a7486c - Use husdon.FilePath() to get file InputStream. May need special handling
[Alex Tucker] 9602186fd1815ffd26b2c32b9c32454293fe7712 - Apache components HttpHost uses -1 as default port for scheme; see if
[Alex Tucker] f5317f5a145b41d87055f98e139b6208a5b932be - Implement Drafter.publishDraftset()
[Alex Tucker] a1a9642147e2df65a73d873a5ab32e32eddc44dd - Test for and add cache buster config as part of publish.
[Alex Tucker] cf982038bd5549cba8db2be5a19ca9f567a192c7 - Test for jobDraft.replace() issue. Extend Exception rather than
[Alex Tucker] 03eb0af4dfc6218b69531819411002ac91b86058 - Implement codelist pipeline using HTTP Components direclty.
[Alex Tucker] a2e05b0886617515e6dafbbfbc290c2e6b03150f - British spelling of slugize :(
[Alex Tucker] 59ce786f5495d91bfe0be05f735b3719d651e5d6 - Use WORKSPACE env variable to find file to upload.
[Alex Tucker] ec8e2a1bf5b697cfccff3f12ec496c871eadf150 - Add test for write-lock (503) and implement retry/holdoff polling of
[Alex Tucker] 170a94578ff14f51ee25c75fb10752c6e386ba8c - Implement components pipeline call. Remove un-used methods.
[Alex Tucker] 74eca1533cfa548ab8196be54e077c0083b762d7 - Prefix file with workspace directory.
[Alex Tucker] 11592644cf0e40dbb91f4d4f885ab00b399dd11d - Typo, csvv -> csv.
[Alex Tucker] 3c869ff7583e91deea0d26910ae48712dc10c146 - Allow adding data from a remote HTTP source.
[Alex Tucker] 9703d169a2d7f0e576dc12070d3e75a1c8f2b631 - Need to return to break out from retry loop.
[Alex Tucker] 57b810eee25ce1249435af236755a151382dca37 - Attempt to avoid issues fetching external mapping (columns.csv) for upload.
[Alex Tucker] f7975dc9d2642014366c73686660a2e37708745c - Explicitly use addBinaryBody.
[Alex Tucker] 540ba45d5aa50426e9e1d3f7a1ec0411ddc164d4 - Write lock URI needs to have prepended.
[Alex Tucker] 6290fc536b2603617b26728abc883ac9169f23bf - Missed a missing /v1/status
.
[Alex Tucker] 5ee1bd86aebac936c0390926b177426944210e69 - Add optional argument for dataset metadata trig file.
[Alex Tucker] a75d492bb510a698967fb5411843dc5422b88016 - Make metadata param relative to CWD.
No changes No changes No changes No changes
[Alex Tucker] d304a5acc8766e52976306021fa62c6ab7bae04c - Add template transformation pipeline.
[vtula2000] 9a912db3b428e0cfba4903a3c3be2f6c005b2c5b - Duplicate errors
[Alex Tucker] 7eda5c2f5f1a251462cd0a2820b201263fd36e11 - Add getDraftsetEndpoint
[Alex Tucker] 7c9c4e98b4ee0c634379ab5253c3293b426e7301 - Add SPARQL tests step and publish results.
[Alex Tucker] 806951bf2ee882eb722ed68d14041b7f0e928fea - SPARQL tests need union-with-live=true
[vtula2000] 37b9f8617bc034a3cf436908038a1ab1c57d90dd - Update
[vtula2000] 560d3e9eb8ed7a4215403a969b4c06866bfe9711 - Code
[vtula2000] 4ff82326c20701c66426653f5f63ae57f10b5d33 - Code
No changes No changes
[vtula2000] 666fc9ab7a60d94e1db1485436d7f96099030f5c - Alcohol and Drugs data
[Alex Tucker] d747d17b909dea7f689436a623263ff531631c94 - Don't trigger GDP-tests as they're now run on the unpublished draftset.
[Alex Tucker] 62649fad57b72a99ab79e909cd88123217afcc80 - Use pipeline template.
No changes
[Alex Tucker] 57b7cae64f2422e744b548d8533c87ea96b0c7b0 - Template for multiple datasets.
[Alex Tucker] 554340c2f38e69909c77daea277188852640b339 - Disambiguate use of 'dataset'
[Alex Tucker] 1452178f3d07debcb12de21cb3782810370ff2c0 - Use $refFamily
No changes
[Alex Tucker] 0ab4797047cdc3a26e01fe2cfd6da3da461c57f3 - Try to always update Trello card.
[Alex Tucker] 2c3a2d2dcad68f95080061335209f3d7241b6af9 - If main.py exists, convert to notebook using jupytext.
[Alex Tucker] 1acd29462408540f9fbc087e739c4dd458b20af7 - Convert any .py files to .ipynb using jupytext.
No changes
No changes
No changes
[Alex Tucker] cc2bca87d857753755272fa5aaa08034ec2428f6 - Add template for ref_* pipelines.
[Alex Tucker] fd491cc35f5f1a690f227435207d77378bce174e - Also validate columns.csv and components.csv.
No changes
No changes
Build 'GSS_data/Health/ISD-Drug-and-Alcohol-Treatment-Waiting-Times' is failing!
Last 50 lines of build output:
[...truncated 222 lines...]
[0;32m---> 88[0;31m [0mragged_rows[0m[0;34m=[0m[0mragged_rows[0m[0;34m,[0m[0;34m[0m[0;34m[0m[0m
[0m[1;32m 89[0m )
[1;32m 90[0m [0mt1[0m [0;34m=[0m [0mperf_counter[0m[0;34m([0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
[0;32m~usr/local/lib/python3.7/site-packages/xlrd/book.py[0m in [0;36mbiff2_8_load[0;34m(self, filename, file_contents, logfile, verbosity, use_mmap, encoding_override, formatting_info, on_demand, ragged_rows)[0m
[1;32m 637[0m [0;32mif[0m [0mself[0m[0;34m.[0m[0mmem[0m[0;34m:[0m [0;32mbreak[0m[0;34m[0m[0;34m[0m[0m
[1;32m 638[0m [0;32melse[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[0;32m--> 639[0;31m [0;32mraise[0m [0mXLRDError[0m[0;34m([0m[0;34m"Can't find workbook in OLE2 compound document"[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
[0m[1;32m 640[0m [0;32melse[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[1;32m 641[0m [0;32mfor[0m [0mqname[0m [0;32min[0m [0;34m[[0m[0;34m'Workbook'[0m[0;34m,[0m [0;34m'Book'[0m[0;34m][0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[0;31mReadError[0m: Can't read Excel file: XLRDError("Can't find workbook in OLE2 compound document")
ReadError: Can't read Excel file: XLRDError("Can't find workbook in OLE2 compound document")
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 7fa44a19ddb92fc10cb068ef79d60fa0fd9f1987bfccb7ee1be2c1741c0f57ca
$ docker rm -f 7fa44a19ddb92fc10cb068ef79d60fa0fd9f1987bfccb7ee1be2c1741c0f57ca
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Validate CSV)
Stage "Validate CSV" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build: No changes
[Alex Tucker] 5328e76cfe9081687e10cc995cbe19af43d54cc6 - Re-enabled first two scripts. Use 'alcohol' for dataset family for now.
[vtula2000] 884eaa3bb9e1da50192878cbeb119a9847cdd484 - Period/age/Trust/Measure type/Unit updates
[Alex Tucker] 05c3e7eff7871326fbc26bbaf012f10e018a948d - Add schema to test output against review at
[Alex Tucker] 4ea8f4dd2d7bd9dd89f3c70e811cf0abeef77b14 - Add trigger from ref_alcohol.
No changes
[vtula2000] c6b71a6d2881888d4ecd6813245f226d85110756 - ag3
[Alex Tucker] a92a690fcdb67782f789b0fe79daf2078599f52e - Remove value from primaryKey; the combinations of dimensions need to be
No changes No changes No changes
No changes No changes No changes No changes No changes No changes No changes No changes No changes No changes No changes
[Alex Tucker] d82b13f35b53782a0e4f2a6f5c49bab4bc935f5d - Add test based on
[Alex Tucker] d73e6af2c0dea77acb9e96ca65708e74cc48210c - Add pipeline-utility-steps for readJSON
[Alex Tucker] fc1d75997fc176e81954e7ab6ffbdedbfc22f458 - Add configFileProvider and credentials binding plugins, for testing
[Alex Tucker] 757778395ce8eae2042318dab89507bf0da4df0e - Try implementing with callable global to set things up and compiled
[Alex Tucker] ff1f8c9bb849849e6ac2da7c8479e2993f958361 - Use Apache http components directly in cube import pipeline, with
[Alex Tucker] f776522d6cfe23a942dabfe1b24a4de48f444ec6 - Start verifying pipeline requests.
[Alex Tucker] 8ed2d1ed353d92fc61f6cc2d7ebde03d22a7486c - Use husdon.FilePath() to get file InputStream. May need special handling
[Alex Tucker] 9602186fd1815ffd26b2c32b9c32454293fe7712 - Apache components HttpHost uses -1 as default port for scheme; see if
[Alex Tucker] f5317f5a145b41d87055f98e139b6208a5b932be - Implement Drafter.publishDraftset()
[Alex Tucker] a1a9642147e2df65a73d873a5ab32e32eddc44dd - Test for and add cache buster config as part of publish.
[Alex Tucker] cf982038bd5549cba8db2be5a19ca9f567a192c7 - Test for jobDraft.replace() issue. Extend Exception rather than
[Alex Tucker] 03eb0af4dfc6218b69531819411002ac91b86058 - Implement codelist pipeline using HTTP Components direclty.
[Alex Tucker] a2e05b0886617515e6dafbbfbc290c2e6b03150f - British spelling of slugize :(
[Alex Tucker] 59ce786f5495d91bfe0be05f735b3719d651e5d6 - Use WORKSPACE env variable to find file to upload.
[Alex Tucker] ec8e2a1bf5b697cfccff3f12ec496c871eadf150 - Add test for write-lock (503) and implement retry/holdoff polling of
[Alex Tucker] 170a94578ff14f51ee25c75fb10752c6e386ba8c - Implement components pipeline call. Remove un-used methods.
[Alex Tucker] 74eca1533cfa548ab8196be54e077c0083b762d7 - Prefix file with workspace directory.
[Alex Tucker] 11592644cf0e40dbb91f4d4f885ab00b399dd11d - Typo, csvv -> csv.
[Alex Tucker] 3c869ff7583e91deea0d26910ae48712dc10c146 - Allow adding data from a remote HTTP source.
[Alex Tucker] 9703d169a2d7f0e576dc12070d3e75a1c8f2b631 - Need to return to break out from retry loop.
[Alex Tucker] 57b810eee25ce1249435af236755a151382dca37 - Attempt to avoid issues fetching external mapping (columns.csv) for upload.
[Alex Tucker] f7975dc9d2642014366c73686660a2e37708745c - Explicitly use addBinaryBody.
[Alex Tucker] 540ba45d5aa50426e9e1d3f7a1ec0411ddc164d4 - Write lock URI needs to have prepended.
[Alex Tucker] 6290fc536b2603617b26728abc883ac9169f23bf - Missed a missing /v1/status
.
[Alex Tucker] 5ee1bd86aebac936c0390926b177426944210e69 - Add optional argument for dataset metadata trig file.
[Alex Tucker] a75d492bb510a698967fb5411843dc5422b88016 - Make metadata param relative to CWD.
No changes No changes No changes No changes
[Alex Tucker] d304a5acc8766e52976306021fa62c6ab7bae04c - Add template transformation pipeline.
[vtula2000] 9a912db3b428e0cfba4903a3c3be2f6c005b2c5b - Duplicate errors
[Alex Tucker] 7eda5c2f5f1a251462cd0a2820b201263fd36e11 - Add getDraftsetEndpoint
[Alex Tucker] 7c9c4e98b4ee0c634379ab5253c3293b426e7301 - Add SPARQL tests step and publish results.
[Alex Tucker] 806951bf2ee882eb722ed68d14041b7f0e928fea - SPARQL tests need union-with-live=true
[vtula2000] 37b9f8617bc034a3cf436908038a1ab1c57d90dd - Update
[vtula2000] 560d3e9eb8ed7a4215403a969b4c06866bfe9711 - Code
[vtula2000] 4ff82326c20701c66426653f5f63ae57f10b5d33 - Code
No changes No changes
[vtula2000] 666fc9ab7a60d94e1db1485436d7f96099030f5c - Alcohol and Drugs data
[Alex Tucker] d747d17b909dea7f689436a623263ff531631c94 - Don't trigger GDP-tests as they're now run on the unpublished draftset.
[Alex Tucker] 62649fad57b72a99ab79e909cd88123217afcc80 - Use pipeline template.
No changes
[Alex Tucker] 57b7cae64f2422e744b548d8533c87ea96b0c7b0 - Template for multiple datasets.
[Alex Tucker] 554340c2f38e69909c77daea277188852640b339 - Disambiguate use of 'dataset'
[Alex Tucker] 1452178f3d07debcb12de21cb3782810370ff2c0 - Use $refFamily
No changes
[Alex Tucker] 0ab4797047cdc3a26e01fe2cfd6da3da461c57f3 - Try to always update Trello card.
[Alex Tucker] 2c3a2d2dcad68f95080061335209f3d7241b6af9 - If main.py exists, convert to notebook using jupytext.
[Alex Tucker] 1acd29462408540f9fbc087e739c4dd458b20af7 - Convert any .py files to .ipynb using jupytext.
No changes
No changes
No changes
[Alex Tucker] cc2bca87d857753755272fa5aaa08034ec2428f6 - Add template for ref_* pipelines.
[Alex Tucker] fd491cc35f5f1a690f227435207d77378bce174e - Also validate columns.csv and components.csv.
No changes
No changes
Build 'GSS_data/Health/ISD-Drug-and-Alcohol-Treatment-Waiting-Times' is failing!
Last 50 lines of build output:
[...truncated 219 lines...]
[0;32m---> 88[0;31m [0mragged_rows[0m[0;34m=[0m[0mragged_rows[0m[0;34m,[0m[0;34m[0m[0;34m[0m[0m
[0m[1;32m 89[0m )
[1;32m 90[0m [0mt1[0m [0;34m=[0m [0mperf_counter[0m[0;34m([0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
[0;32m~usr/local/lib/python3.7/site-packages/xlrd/book.py[0m in [0;36mbiff2_8_load[0;34m(self, filename, file_contents, logfile, verbosity, use_mmap, encoding_override, formatting_info, on_demand, ragged_rows)[0m
[1;32m 637[0m [0;32mif[0m [0mself[0m[0;34m.[0m[0mmem[0m[0;34m:[0m [0;32mbreak[0m[0;34m[0m[0;34m[0m[0m
[1;32m 638[0m [0;32melse[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[0;32m--> 639[0;31m [0;32mraise[0m [0mXLRDError[0m[0;34m([0m[0;34m"Can't find workbook in OLE2 compound document"[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
[0m[1;32m 640[0m [0;32melse[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[1;32m 641[0m [0;32mfor[0m [0mqname[0m [0;32min[0m [0;34m[[0m[0;34m'Workbook'[0m[0;34m,[0m [0;34m'Book'[0m[0;34m][0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[0;31mReadError[0m: Can't read Excel file: XLRDError("Can't find workbook in OLE2 compound document")
ReadError: Can't read Excel file: XLRDError("Can't find workbook in OLE2 compound document")
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 9d5f6c229c22b492a737cd215706bca6906be2973137c963eeb5acfc8f1f3f33
$ docker rm -f 9d5f6c229c22b492a737cd215706bca6906be2973137c963eeb5acfc8f1f3f33
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Validate CSV)
Stage "Validate CSV" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build: No changes
[Alex Tucker] 5328e76cfe9081687e10cc995cbe19af43d54cc6 - Re-enabled first two scripts. Use 'alcohol' for dataset family for now.
[vtula2000] 884eaa3bb9e1da50192878cbeb119a9847cdd484 - Period/age/Trust/Measure type/Unit updates
[Alex Tucker] 05c3e7eff7871326fbc26bbaf012f10e018a948d - Add schema to test output against review at
[Alex Tucker] 4ea8f4dd2d7bd9dd89f3c70e811cf0abeef77b14 - Add trigger from ref_alcohol.
No changes
[vtula2000] c6b71a6d2881888d4ecd6813245f226d85110756 - ag3
[Alex Tucker] a92a690fcdb67782f789b0fe79daf2078599f52e - Remove value from primaryKey; the combinations of dimensions need to be
No changes No changes No changes
No changes No changes No changes No changes No changes No changes No changes No changes No changes No changes No changes
[Alex Tucker] d82b13f35b53782a0e4f2a6f5c49bab4bc935f5d - Add test based on
[Alex Tucker] d73e6af2c0dea77acb9e96ca65708e74cc48210c - Add pipeline-utility-steps for readJSON
[Alex Tucker] fc1d75997fc176e81954e7ab6ffbdedbfc22f458 - Add configFileProvider and credentials binding plugins, for testing
[Alex Tucker] 757778395ce8eae2042318dab89507bf0da4df0e - Try implementing with callable global to set things up and compiled
[Alex Tucker] ff1f8c9bb849849e6ac2da7c8479e2993f958361 - Use Apache http components directly in cube import pipeline, with
[Alex Tucker] f776522d6cfe23a942dabfe1b24a4de48f444ec6 - Start verifying pipeline requests.
[Alex Tucker] 8ed2d1ed353d92fc61f6cc2d7ebde03d22a7486c - Use husdon.FilePath() to get file InputStream. May need special handling
[Alex Tucker] 9602186fd1815ffd26b2c32b9c32454293fe7712 - Apache components HttpHost uses -1 as default port for scheme; see if
[Alex Tucker] f5317f5a145b41d87055f98e139b6208a5b932be - Implement Drafter.publishDraftset()
[Alex Tucker] a1a9642147e2df65a73d873a5ab32e32eddc44dd - Test for and add cache buster config as part of publish.
[Alex Tucker] cf982038bd5549cba8db2be5a19ca9f567a192c7 - Test for jobDraft.replace() issue. Extend Exception rather than
[Alex Tucker] 03eb0af4dfc6218b69531819411002ac91b86058 - Implement codelist pipeline using HTTP Components direclty.
[Alex Tucker] a2e05b0886617515e6dafbbfbc290c2e6b03150f - British spelling of slugize :(
[Alex Tucker] 59ce786f5495d91bfe0be05f735b3719d651e5d6 - Use WORKSPACE env variable to find file to upload.
[Alex Tucker] ec8e2a1bf5b697cfccff3f12ec496c871eadf150 - Add test for write-lock (503) and implement retry/holdoff polling of
[Alex Tucker] 170a94578ff14f51ee25c75fb10752c6e386ba8c - Implement components pipeline call. Remove un-used methods.
[Alex Tucker] 74eca1533cfa548ab8196be54e077c0083b762d7 - Prefix file with workspace directory.
[Alex Tucker] 11592644cf0e40dbb91f4d4f885ab00b399dd11d - Typo, csvv -> csv.
[Alex Tucker] 3c869ff7583e91deea0d26910ae48712dc10c146 - Allow adding data from a remote HTTP source.
[Alex Tucker] 9703d169a2d7f0e576dc12070d3e75a1c8f2b631 - Need to return to break out from retry loop.
[Alex Tucker] 57b810eee25ce1249435af236755a151382dca37 - Attempt to avoid issues fetching external mapping (columns.csv) for upload.
[Alex Tucker] f7975dc9d2642014366c73686660a2e37708745c - Explicitly use addBinaryBody.
[Alex Tucker] 540ba45d5aa50426e9e1d3f7a1ec0411ddc164d4 - Write lock URI needs to have prepended.
[Alex Tucker] 6290fc536b2603617b26728abc883ac9169f23bf - Missed a missing /v1/status
.
[Alex Tucker] 5ee1bd86aebac936c0390926b177426944210e69 - Add optional argument for dataset metadata trig file.
[Alex Tucker] a75d492bb510a698967fb5411843dc5422b88016 - Make metadata param relative to CWD.
No changes No changes No changes No changes
[Alex Tucker] d304a5acc8766e52976306021fa62c6ab7bae04c - Add template transformation pipeline.
[vtula2000] 9a912db3b428e0cfba4903a3c3be2f6c005b2c5b - Duplicate errors
[Alex Tucker] 7eda5c2f5f1a251462cd0a2820b201263fd36e11 - Add getDraftsetEndpoint
[Alex Tucker] 7c9c4e98b4ee0c634379ab5253c3293b426e7301 - Add SPARQL tests step and publish results.
[Alex Tucker] 806951bf2ee882eb722ed68d14041b7f0e928fea - SPARQL tests need union-with-live=true
[vtula2000] 37b9f8617bc034a3cf436908038a1ab1c57d90dd - Update
[vtula2000] 560d3e9eb8ed7a4215403a969b4c06866bfe9711 - Code
[vtula2000] 4ff82326c20701c66426653f5f63ae57f10b5d33 - Code
No changes No changes
[vtula2000] 666fc9ab7a60d94e1db1485436d7f96099030f5c - Alcohol and Drugs data
[Alex Tucker] d747d17b909dea7f689436a623263ff531631c94 - Don't trigger GDP-tests as they're now run on the unpublished draftset.
[Alex Tucker] 62649fad57b72a99ab79e909cd88123217afcc80 - Use pipeline template.
No changes
[Alex Tucker] 57b7cae64f2422e744b548d8533c87ea96b0c7b0 - Template for multiple datasets.
[Alex Tucker] 554340c2f38e69909c77daea277188852640b339 - Disambiguate use of 'dataset'
[Alex Tucker] 1452178f3d07debcb12de21cb3782810370ff2c0 - Use $refFamily
No changes
[Alex Tucker] 0ab4797047cdc3a26e01fe2cfd6da3da461c57f3 - Try to always update Trello card.
[Alex Tucker] 2c3a2d2dcad68f95080061335209f3d7241b6af9 - If main.py exists, convert to notebook using jupytext.
[Alex Tucker] 1acd29462408540f9fbc087e739c4dd458b20af7 - Convert any .py files to .ipynb using jupytext.
No changes
No changes
No changes
[Alex Tucker] cc2bca87d857753755272fa5aaa08034ec2428f6 - Add template for ref_* pipelines.
[Alex Tucker] fd491cc35f5f1a690f227435207d77378bce174e - Also validate columns.csv and components.csv.
No changes
No changes
No changes
Build 'GSS_data/Health/ISD-Drug-and-Alcohol-Treatment-Waiting-Times' is failing!
Last 50 lines of build output:
[...truncated 213 lines...]
[0;32m---> 88[0;31m [0mragged_rows[0m[0;34m=[0m[0mragged_rows[0m[0;34m,[0m[0;34m[0m[0;34m[0m[0m
[0m[1;32m 89[0m )
[1;32m 90[0m [0mt1[0m [0;34m=[0m [0mperf_counter[0m[0;34m([0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
[0;32m~usr/local/lib/python3.7/site-packages/xlrd/book.py[0m in [0;36mbiff2_8_load[0;34m(self, filename, file_contents, logfile, verbosity, use_mmap, encoding_override, formatting_info, on_demand, ragged_rows)[0m
[1;32m 637[0m [0;32mif[0m [0mself[0m[0;34m.[0m[0mmem[0m[0;34m:[0m [0;32mbreak[0m[0;34m[0m[0;34m[0m[0m
[1;32m 638[0m [0;32melse[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[0;32m--> 639[0;31m [0;32mraise[0m [0mXLRDError[0m[0;34m([0m[0;34m"Can't find workbook in OLE2 compound document"[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
[0m[1;32m 640[0m [0;32melse[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[1;32m 641[0m [0;32mfor[0m [0mqname[0m [0;32min[0m [0;34m[[0m[0;34m'Workbook'[0m[0;34m,[0m [0;34m'Book'[0m[0;34m][0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[0;31mReadError[0m: Can't read Excel file: XLRDError("Can't find workbook in OLE2 compound document")
ReadError: Can't read Excel file: XLRDError("Can't find workbook in OLE2 compound document")
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 280b5a9387b8a344e29e5264265f587fcb551ab87f2dd4be60cec8613e8b39a6
$ docker rm -f 280b5a9387b8a344e29e5264265f587fcb551ab87f2dd4be60cec8613e8b39a6
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Validate CSV)
Stage "Validate CSV" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build: No changes
[Alex Tucker] 5328e76cfe9081687e10cc995cbe19af43d54cc6 - Re-enabled first two scripts. Use 'alcohol' for dataset family for now.
[vtula2000] 884eaa3bb9e1da50192878cbeb119a9847cdd484 - Period/age/Trust/Measure type/Unit updates
[Alex Tucker] 05c3e7eff7871326fbc26bbaf012f10e018a948d - Add schema to test output against review at
[Alex Tucker] 4ea8f4dd2d7bd9dd89f3c70e811cf0abeef77b14 - Add trigger from ref_alcohol.
No changes
[vtula2000] c6b71a6d2881888d4ecd6813245f226d85110756 - ag3
[Alex Tucker] a92a690fcdb67782f789b0fe79daf2078599f52e - Remove value from primaryKey; the combinations of dimensions need to be
No changes No changes No changes
No changes No changes No changes No changes No changes No changes No changes No changes No changes No changes No changes
[Alex Tucker] d82b13f35b53782a0e4f2a6f5c49bab4bc935f5d - Add test based on
[Alex Tucker] d73e6af2c0dea77acb9e96ca65708e74cc48210c - Add pipeline-utility-steps for readJSON
[Alex Tucker] fc1d75997fc176e81954e7ab6ffbdedbfc22f458 - Add configFileProvider and credentials binding plugins, for testing
[Alex Tucker] 757778395ce8eae2042318dab89507bf0da4df0e - Try implementing with callable global to set things up and compiled
[Alex Tucker] ff1f8c9bb849849e6ac2da7c8479e2993f958361 - Use Apache http components directly in cube import pipeline, with
[Alex Tucker] f776522d6cfe23a942dabfe1b24a4de48f444ec6 - Start verifying pipeline requests.
[Alex Tucker] 8ed2d1ed353d92fc61f6cc2d7ebde03d22a7486c - Use husdon.FilePath() to get file InputStream. May need special handling
[Alex Tucker] 9602186fd1815ffd26b2c32b9c32454293fe7712 - Apache components HttpHost uses -1 as default port for scheme; see if
[Alex Tucker] f5317f5a145b41d87055f98e139b6208a5b932be - Implement Drafter.publishDraftset()
[Alex Tucker] a1a9642147e2df65a73d873a5ab32e32eddc44dd - Test for and add cache buster config as part of publish.
[Alex Tucker] cf982038bd5549cba8db2be5a19ca9f567a192c7 - Test for jobDraft.replace() issue. Extend Exception rather than
[Alex Tucker] 03eb0af4dfc6218b69531819411002ac91b86058 - Implement codelist pipeline using HTTP Components direclty.
[Alex Tucker] a2e05b0886617515e6dafbbfbc290c2e6b03150f - British spelling of slugize :(
[Alex Tucker] 59ce786f5495d91bfe0be05f735b3719d651e5d6 - Use WORKSPACE env variable to find file to upload.
[Alex Tucker] ec8e2a1bf5b697cfccff3f12ec496c871eadf150 - Add test for write-lock (503) and implement retry/holdoff polling of
[Alex Tucker] 170a94578ff14f51ee25c75fb10752c6e386ba8c - Implement components pipeline call. Remove un-used methods.
[Alex Tucker] 74eca1533cfa548ab8196be54e077c0083b762d7 - Prefix file with workspace directory.
[Alex Tucker] 11592644cf0e40dbb91f4d4f885ab00b399dd11d - Typo, csvv -> csv.
[Alex Tucker] 3c869ff7583e91deea0d26910ae48712dc10c146 - Allow adding data from a remote HTTP source.
[Alex Tucker] 9703d169a2d7f0e576dc12070d3e75a1c8f2b631 - Need to return to break out from retry loop.
[Alex Tucker] 57b810eee25ce1249435af236755a151382dca37 - Attempt to avoid issues fetching external mapping (columns.csv) for upload.
[Alex Tucker] f7975dc9d2642014366c73686660a2e37708745c - Explicitly use addBinaryBody.
[Alex Tucker] 540ba45d5aa50426e9e1d3f7a1ec0411ddc164d4 - Write lock URI needs to have prepended.
[Alex Tucker] 6290fc536b2603617b26728abc883ac9169f23bf - Missed a missing /v1/status
.
[Alex Tucker] 5ee1bd86aebac936c0390926b177426944210e69 - Add optional argument for dataset metadata trig file.
[Alex Tucker] a75d492bb510a698967fb5411843dc5422b88016 - Make metadata param relative to CWD.
No changes No changes No changes No changes
[Alex Tucker] d304a5acc8766e52976306021fa62c6ab7bae04c - Add template transformation pipeline.
[vtula2000] 9a912db3b428e0cfba4903a3c3be2f6c005b2c5b - Duplicate errors
[Alex Tucker] 7eda5c2f5f1a251462cd0a2820b201263fd36e11 - Add getDraftsetEndpoint
[Alex Tucker] 7c9c4e98b4ee0c634379ab5253c3293b426e7301 - Add SPARQL tests step and publish results.
[Alex Tucker] 806951bf2ee882eb722ed68d14041b7f0e928fea - SPARQL tests need union-with-live=true
[vtula2000] 37b9f8617bc034a3cf436908038a1ab1c57d90dd - Update
[vtula2000] 560d3e9eb8ed7a4215403a969b4c06866bfe9711 - Code
[vtula2000] 4ff82326c20701c66426653f5f63ae57f10b5d33 - Code
No changes No changes
[vtula2000] 666fc9ab7a60d94e1db1485436d7f96099030f5c - Alcohol and Drugs data
[Alex Tucker] d747d17b909dea7f689436a623263ff531631c94 - Don't trigger GDP-tests as they're now run on the unpublished draftset.
[Alex Tucker] 62649fad57b72a99ab79e909cd88123217afcc80 - Use pipeline template.
No changes
[Alex Tucker] 57b7cae64f2422e744b548d8533c87ea96b0c7b0 - Template for multiple datasets.
[Alex Tucker] 554340c2f38e69909c77daea277188852640b339 - Disambiguate use of 'dataset'
[Alex Tucker] 1452178f3d07debcb12de21cb3782810370ff2c0 - Use $refFamily
No changes
[Alex Tucker] 0ab4797047cdc3a26e01fe2cfd6da3da461c57f3 - Try to always update Trello card.
[Alex Tucker] 2c3a2d2dcad68f95080061335209f3d7241b6af9 - If main.py exists, convert to notebook using jupytext.
[Alex Tucker] 1acd29462408540f9fbc087e739c4dd458b20af7 - Convert any .py files to .ipynb using jupytext.
No changes
No changes
No changes
[Alex Tucker] cc2bca87d857753755272fa5aaa08034ec2428f6 - Add template for ref_* pipelines.
[Alex Tucker] fd491cc35f5f1a690f227435207d77378bce174e - Also validate columns.csv and components.csv.
No changes
No changes
No changes No changes
Build 'GSS_data/Health/ISD-Drug-and-Alcohol-Treatment-Waiting-Times' is failing!
Last 50 lines of build output:
[...truncated 213 lines...]
[0;32m---> 88[0;31m [0mragged_rows[0m[0;34m=[0m[0mragged_rows[0m[0;34m,[0m[0;34m[0m[0;34m[0m[0m
[0m[1;32m 89[0m )
[1;32m 90[0m [0mt1[0m [0;34m=[0m [0mperf_counter[0m[0;34m([0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
[0;32m~usr/local/lib/python3.7/site-packages/xlrd/book.py[0m in [0;36mbiff2_8_load[0;34m(self, filename, file_contents, logfile, verbosity, use_mmap, encoding_override, formatting_info, on_demand, ragged_rows)[0m
[1;32m 637[0m [0;32mif[0m [0mself[0m[0;34m.[0m[0mmem[0m[0;34m:[0m [0;32mbreak[0m[0;34m[0m[0;34m[0m[0m
[1;32m 638[0m [0;32melse[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[0;32m--> 639[0;31m [0;32mraise[0m [0mXLRDError[0m[0;34m([0m[0;34m"Can't find workbook in OLE2 compound document"[0m[0;34m)[0m[0;34m[0m[0;34m[0m[0m
[0m[1;32m 640[0m [0;32melse[0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[1;32m 641[0m [0;32mfor[0m [0mqname[0m [0;32min[0m [0;34m[[0m[0;34m'Workbook'[0m[0;34m,[0m [0;34m'Book'[0m[0;34m][0m[0;34m:[0m[0;34m[0m[0;34m[0m[0m
[0;31mReadError[0m: Can't read Excel file: XLRDError("Can't find workbook in OLE2 compound document")
ReadError: Can't read Excel file: XLRDError("Can't find workbook in OLE2 compound document")
[Pipeline] }
[Pipeline] // ansiColor
[Pipeline] }
[Pipeline] // script
[Pipeline] }
$ docker stop --time=1 2da3a3dc63c37f34be5459d86d1cc46c27730ea663acc027131bd37c495ef645
$ docker rm -f 2da3a3dc63c37f34be5459d86d1cc46c27730ea663acc027131bd37c495ef645
[Pipeline] // withDockerContainer
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Validate CSV)
Stage "Validate CSV" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Upload Tidy Data)
Stage "Upload Tidy Data" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Test draft dataset)
Stage "Test draft dataset" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Publish)
Stage "Publish" skipped due to earlier failure(s)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Declarative: Post Actions)
[Pipeline] script
[Pipeline] {
[Pipeline] step
Changes since last successful build: No changes
[Alex Tucker] 5328e76cfe9081687e10cc995cbe19af43d54cc6 - Re-enabled first two scripts. Use 'alcohol' for dataset family for now.
[vtula2000] 884eaa3bb9e1da50192878cbeb119a9847cdd484 - Period/age/Trust/Measure type/Unit updates
[Alex Tucker] 05c3e7eff7871326fbc26bbaf012f10e018a948d - Add schema to test output against review at
[Alex Tucker] 4ea8f4dd2d7bd9dd89f3c70e811cf0abeef77b14 - Add trigger from ref_alcohol.
No changes
[vtula2000] c6b71a6d2881888d4ecd6813245f226d85110756 - ag3
[Alex Tucker] a92a690fcdb67782f789b0fe79daf2078599f52e - Remove value from primaryKey; the combinations of dimensions need to be
No changes No changes No changes
No changes No changes No changes No changes No changes No changes No changes No changes No changes No changes No changes
[Alex Tucker] d82b13f35b53782a0e4f2a6f5c49bab4bc935f5d - Add test based on
[Alex Tucker] d73e6af2c0dea77acb9e96ca65708e74cc48210c - Add pipeline-utility-steps for readJSON
[Alex Tucker] fc1d75997fc176e81954e7ab6ffbdedbfc22f458 - Add configFileProvider and credentials binding plugins, for testing
[Alex Tucker] 757778395ce8eae2042318dab89507bf0da4df0e - Try implementing with callable global to set things up and compiled
[Alex Tucker] ff1f8c9bb849849e6ac2da7c8479e2993f958361 - Use Apache http components directly in cube import pipeline, with
[Alex Tucker] f776522d6cfe23a942dabfe1b24a4de48f444ec6 - Start verifying pipeline requests.
[Alex Tucker] 8ed2d1ed353d92fc61f6cc2d7ebde03d22a7486c - Use husdon.FilePath() to get file InputStream. May need special handling
[Alex Tucker] 9602186fd1815ffd26b2c32b9c32454293fe7712 - Apache components HttpHost uses -1 as default port for scheme; see if
[Alex Tucker] f5317f5a145b41d87055f98e139b6208a5b932be - Implement Drafter.publishDraftset()
[Alex Tucker] a1a9642147e2df65a73d873a5ab32e32eddc44dd - Test for and add cache buster config as part of publish.
[Alex Tucker] cf982038bd5549cba8db2be5a19ca9f567a192c7 - Test for jobDraft.replace() issue. Extend Exception rather than
[Alex Tucker] 03eb0af4dfc6218b69531819411002ac91b86058 - Implement codelist pipeline using HTTP Components direclty.
[Alex Tucker] a2e05b0886617515e6dafbbfbc290c2e6b03150f - British spelling of slugize :(
[Alex Tucker] 59ce786f5495d91bfe0be05f735b3719d651e5d6 - Use WORKSPACE env variable to find file to upload.
[Alex Tucker] ec8e2a1bf5b697cfccff3f12ec496c871eadf150 - Add test for write-lock (503) and implement retry/holdoff polling of
[Alex Tucker] 170a94578ff14f51ee25c75fb10752c6e386ba8c - Implement components pipeline call. Remove un-used methods.
[Alex Tucker] 74eca1533cfa548ab8196be54e077c0083b762d7 - Prefix file with workspace directory.
[Alex Tucker] 11592644cf0e40dbb91f4d4f885ab00b399dd11d - Typo, csvv -> csv.
[Alex Tucker] 3c869ff7583e91deea0d26910ae48712dc10c146 - Allow adding data from a remote HTTP source.
[Alex Tucker] 9703d169a2d7f0e576dc12070d3e75a1c8f2b631 - Need to return to break out from retry loop.
[Alex Tucker] 57b810eee25ce1249435af236755a151382dca37 - Attempt to avoid issues fetching external mapping (columns.csv) for upload.
[Alex Tucker] f7975dc9d2642014366c73686660a2e37708745c - Explicitly use addBinaryBody.
[Alex Tucker] 540ba45d5aa50426e9e1d3f7a1ec0411ddc164d4 - Write lock URI needs to have prepended.
[Alex Tucker] 6290fc536b2603617b26728abc883ac9169f23bf - Missed a missing /v1/status
.
[Alex Tucker] 5ee1bd86aebac936c0390926b177426944210e69 - Add optional argument for dataset metadata trig file.
[Alex Tucker] a75d492bb510a698967fb5411843dc5422b88016 - Make metadata param relative to CWD.
No changes No changes No changes No changes
[Alex Tucker] d304a5acc8766e52976306021fa62c6ab7bae04c - Add template transformation pipeline.
[vtula2000] 9a912db3b428e0cfba4903a3c3be2f6c005b2c5b - Duplicate errors
[Alex Tucker] 7eda5c2f5f1a251462cd0a2820b201263fd36e11 - Add getDraftsetEndpoint
[Alex Tucker] 7c9c4e98b4ee0c634379ab5253c3293b426e7301 - Add SPARQL tests step and publish results.
[Alex Tucker] 806951bf2ee882eb722ed68d14041b7f0e928fea - SPARQL tests need union-with-live=true
[vtula2000] 37b9f8617bc034a3cf436908038a1ab1c57d90dd - Update
[vtula2000] 560d3e9eb8ed7a4215403a969b4c06866bfe9711 - Code
[vtula2000] 4ff82326c20701c66426653f5f63ae57f10b5d33 - Code
No changes No changes
[vtula2000] 666fc9ab7a60d94e1db1485436d7f96099030f5c - Alcohol and Drugs data
[Alex Tucker] d747d17b909dea7f689436a623263ff531631c94 - Don't trigger GDP-tests as they're now run on the unpublished draftset.
[Alex Tucker] 62649fad57b72a99ab79e909cd88123217afcc80 - Use pipeline template.
No changes
[Alex Tucker] 57b7cae64f2422e744b548d8533c87ea96b0c7b0 - Template for multiple datasets.
[Alex Tucker] 554340c2f38e69909c77daea277188852640b339 - Disambiguate use of 'dataset'
[Alex Tucker] 1452178f3d07debcb12de21cb3782810370ff2c0 - Use $refFamily
No changes
[Alex Tucker] 0ab4797047cdc3a26e01fe2cfd6da3da461c57f3 - Try to always update Trello card.
[Alex Tucker] 2c3a2d2dcad68f95080061335209f3d7241b6af9 - If main.py exists, convert to notebook using jupytext.
[Alex Tucker] 1acd29462408540f9fbc087e739c4dd458b20af7 - Convert any .py files to .ipynb using jupytext.
No changes
No changes
No changes
[Alex Tucker] cc2bca87d857753755272fa5aaa08034ec2428f6 - Add template for ref_* pipelines.
[Alex Tucker] fd491cc35f5f1a690f227435207d77378bce174e - Also validate columns.csv and components.csv.
No changes
No changes
No changes No changes No changes
@ajtucker @MartynBSpooner have disabled this pipeline and put it back on the backlog where I fished it out from. It's a bit of a black hole one right now.
the exception Can't find workbook in OLE2 compound document
is bubbling up because the worksheet in question is protected (a few tabs anyway), and the python excel libraries underneath pandas and databaker can't read protected worksheets.
some more info here: https://github.com/pandas-dev/pandas/issues/25650
as to why someone has password protected parts of their open data.....
Build 'GSS_data/Health/ISD-Drug-and-Alcohol-Treatment-Waiting-Times' is failing!
Last 50 lines of build output:
Changes since last successful build: No changes
[Alex Tucker] 5328e76cfe9081687e10cc995cbe19af43d54cc6 - Re-enabled first two scripts. Use 'alcohol' for dataset family for now.
[vtula2000] 884eaa3bb9e1da50192878cbeb119a9847cdd484 - Period/age/Trust/Measure type/Unit updates
[Alex Tucker] 05c3e7eff7871326fbc26bbaf012f10e018a948d - Add schema to test output against review at
[Alex Tucker] 4ea8f4dd2d7bd9dd89f3c70e811cf0abeef77b14 - Add trigger from ref_alcohol.
No changes
[vtula2000] c6b71a6d2881888d4ecd6813245f226d85110756 - ag3
[Alex Tucker] a92a690fcdb67782f789b0fe79daf2078599f52e - Remove value from primaryKey; the combinations of dimensions need to be
No changes No changes No changes
No changes No changes No changes No changes No changes No changes No changes No changes No changes No changes No changes
[Alex Tucker] d82b13f35b53782a0e4f2a6f5c49bab4bc935f5d - Add test based on
[Alex Tucker] d73e6af2c0dea77acb9e96ca65708e74cc48210c - Add pipeline-utility-steps for readJSON
[Alex Tucker] fc1d75997fc176e81954e7ab6ffbdedbfc22f458 - Add configFileProvider and credentials binding plugins, for testing
[Alex Tucker] 757778395ce8eae2042318dab89507bf0da4df0e - Try implementing with callable global to set things up and compiled
[Alex Tucker] ff1f8c9bb849849e6ac2da7c8479e2993f958361 - Use Apache http components directly in cube import pipeline, with
[Alex Tucker] f776522d6cfe23a942dabfe1b24a4de48f444ec6 - Start verifying pipeline requests.
[Alex Tucker] 8ed2d1ed353d92fc61f6cc2d7ebde03d22a7486c - Use husdon.FilePath() to get file InputStream. May need special handling
[Alex Tucker] 9602186fd1815ffd26b2c32b9c32454293fe7712 - Apache components HttpHost uses -1 as default port for scheme; see if
[Alex Tucker] f5317f5a145b41d87055f98e139b6208a5b932be - Implement Drafter.publishDraftset()
[Alex Tucker] a1a9642147e2df65a73d873a5ab32e32eddc44dd - Test for and add cache buster config as part of publish.
[Alex Tucker] cf982038bd5549cba8db2be5a19ca9f567a192c7 - Test for jobDraft.replace() issue. Extend Exception rather than
[Alex Tucker] 03eb0af4dfc6218b69531819411002ac91b86058 - Implement codelist pipeline using HTTP Components direclty.
[Alex Tucker] a2e05b0886617515e6dafbbfbc290c2e6b03150f - British spelling of slugize :(
[Alex Tucker] 59ce786f5495d91bfe0be05f735b3719d651e5d6 - Use WORKSPACE env variable to find file to upload.
[Alex Tucker] ec8e2a1bf5b697cfccff3f12ec496c871eadf150 - Add test for write-lock (503) and implement retry/holdoff polling of
[Alex Tucker] 170a94578ff14f51ee25c75fb10752c6e386ba8c - Implement components pipeline call. Remove un-used methods.
[Alex Tucker] 74eca1533cfa548ab8196be54e077c0083b762d7 - Prefix file with workspace directory.
[Alex Tucker] 11592644cf0e40dbb91f4d4f885ab00b399dd11d - Typo, csvv -> csv.
[Alex Tucker] 3c869ff7583e91deea0d26910ae48712dc10c146 - Allow adding data from a remote HTTP source.
[Alex Tucker] 9703d169a2d7f0e576dc12070d3e75a1c8f2b631 - Need to return to break out from retry loop.
[Alex Tucker] 57b810eee25ce1249435af236755a151382dca37 - Attempt to avoid issues fetching external mapping (columns.csv) for upload.
[Alex Tucker] f7975dc9d2642014366c73686660a2e37708745c - Explicitly use addBinaryBody.
[Alex Tucker] 540ba45d5aa50426e9e1d3f7a1ec0411ddc164d4 - Write lock URI needs to have prepended.
[Alex Tucker] 6290fc536b2603617b26728abc883ac9169f23bf - Missed a missing
/v1/status
.[Alex Tucker] 5ee1bd86aebac936c0390926b177426944210e69 - Add optional argument for dataset metadata trig file.
[Alex Tucker] a75d492bb510a698967fb5411843dc5422b88016 - Make metadata param relative to CWD.
No changes No changes No changes No changes
[Alex Tucker] d304a5acc8766e52976306021fa62c6ab7bae04c - Add template transformation pipeline.
[vtula2000] 9a912db3b428e0cfba4903a3c3be2f6c005b2c5b - Duplicate errors
[Alex Tucker] 7eda5c2f5f1a251462cd0a2820b201263fd36e11 - Add getDraftsetEndpoint
[Alex Tucker] 7c9c4e98b4ee0c634379ab5253c3293b426e7301 - Add SPARQL tests step and publish results.
[Alex Tucker] 806951bf2ee882eb722ed68d14041b7f0e928fea - SPARQL tests need union-with-live=true
[vtula2000] 37b9f8617bc034a3cf436908038a1ab1c57d90dd - Update
[vtula2000] 560d3e9eb8ed7a4215403a969b4c06866bfe9711 - Code
[vtula2000] 4ff82326c20701c66426653f5f63ae57f10b5d33 - Code
No changes No changes
[vtula2000] 666fc9ab7a60d94e1db1485436d7f96099030f5c - Alcohol and Drugs data
[Alex Tucker] d747d17b909dea7f689436a623263ff531631c94 - Don't trigger GDP-tests as they're now run on the unpublished draftset.
[Alex Tucker] 62649fad57b72a99ab79e909cd88123217afcc80 - Use pipeline template.
No changes
[Alex Tucker] 57b7cae64f2422e744b548d8533c87ea96b0c7b0 - Template for multiple datasets.
[Alex Tucker] 554340c2f38e69909c77daea277188852640b339 - Disambiguate use of 'dataset'
[Alex Tucker] 1452178f3d07debcb12de21cb3782810370ff2c0 - Use $refFamily
No changes
[Alex Tucker] 0ab4797047cdc3a26e01fe2cfd6da3da461c57f3 - Try to always update Trello card.
[Alex Tucker] 2c3a2d2dcad68f95080061335209f3d7241b6af9 - If main.py exists, convert to notebook using jupytext.
[Alex Tucker] 1acd29462408540f9fbc087e739c4dd458b20af7 - Convert any .py files to .ipynb using jupytext.
No changes
View full output