Closed ajtucker closed 5 years ago
Build 'GSS_data/Health/DoH-NI-drug-alcohol-treatment-services' is failing!
Last 50 lines of build output:
[...truncated 153 lines...] [Pipeline] ansiColor [Pipeline] { [Pipeline] fileExists [Pipeline] findFiles [Pipeline] sh + csvlint --no-verbose -s out/observations.csv-schema.json https://gss-cogs.github.io/ref_alcohol/codelists/service-type.csv is VALID https://gss-cogs.github.io/ref_alcohol/codelists/residential-status.csv is VALID https://gss-cogs.github.io/ref_alcohol/codelists/treatment-type.csv is VALID https://gss-cogs.github.io/ref_alcohol/codelists/health-social-care-trusts.csv is VALID /var/jenkins_home/workspace/GSS_data/Health/DoH-NI-drug-alcohol-treatment-services/out/observations.csv is INVALID 1. unmatched_foreign_key_reference. Row: 5,6. ["Under 18s"] 2. unmatched_foreign_key_reference. Row: 6,6. ["18 and over"] 3. unmatched_foreign_key_reference. Row: 9,7. ["prison"] [Pipeline] } [Pipeline] // ansiColor [Pipeline] } [Pipeline] // script [Pipeline] } $ docker stop --time=1 57923f8d0dd6511cdf9d508dcd171c40122473f04f7f6f39cece2d9aff5a967c $ docker rm -f 57923f8d0dd6511cdf9d508dcd171c40122473f04f7f6f39cece2d9aff5a967c [Pipeline] // withDockerContainer [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Upload Tidy Data) Stage "Upload Tidy Data" skipped due to earlier failure(s) [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Test draft dataset) Stage "Test draft dataset" skipped due to earlier failure(s) [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Publish) Stage "Publish" skipped due to earlier failure(s) [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Declarative: Post Actions) [Pipeline] script [Pipeline] { [Pipeline] step
Changes since last successful build:
[Alex Tucker] 57b810eee25ce1249435af236755a151382dca37 - Attempt to avoid issues fetching external mapping (columns.csv) for upload.
[Alex Tucker] f7975dc9d2642014366c73686660a2e37708745c - Explicitly use addBinaryBody.
[Alex Tucker] 540ba45d5aa50426e9e1d3f7a1ec0411ddc164d4 - Write lock URI needs to have prepended.
[Alex Tucker] 6290fc536b2603617b26728abc883ac9169f23bf - Missed a missing /v1/status.
/v1/status
[Alex Tucker] 5ee1bd86aebac936c0390926b177426944210e69 - Add optional argument for dataset metadata trig file.
[Alex Tucker] a75d492bb510a698967fb5411843dc5422b88016 - Make metadata param relative to CWD.
No changes No changes No changes No changes
[Alex Tucker] d304a5acc8766e52976306021fa62c6ab7bae04c - Add template transformation pipeline.
[Alex Tucker] 7eda5c2f5f1a251462cd0a2820b201263fd36e11 - Add getDraftsetEndpoint
[Alex Tucker] 7c9c4e98b4ee0c634379ab5253c3293b426e7301 - Add SPARQL tests step and publish results.
[Alex Tucker] 806951bf2ee882eb722ed68d14041b7f0e928fea - SPARQL tests need union-with-live=true
No changes
[Alex Tucker] d747d17b909dea7f689436a623263ff531631c94 - Don't trigger GDP-tests as they're now run on the unpublished draftset.
[Alex Tucker] 57b7cae64f2422e744b548d8533c87ea96b0c7b0 - Template for multiple datasets.
[Alex Tucker] 554340c2f38e69909c77daea277188852640b339 - Disambiguate use of 'dataset'
[Alex Tucker] 1452178f3d07debcb12de21cb3782810370ff2c0 - Use $refFamily
[Alex Tucker] 0ab4797047cdc3a26e01fe2cfd6da3da461c57f3 - Try to always update Trello card.
[Alex Tucker] 2c3a2d2dcad68f95080061335209f3d7241b6af9 - If main.py exists, convert to notebook using jupytext.
[Alex Tucker] 1acd29462408540f9fbc087e739c4dd458b20af7 - Convert any .py files to .ipynb using jupytext.
No changes No changes
[Alex Tucker] 0ab9caa46fd9a9ce37f92f6ff1886ef7d0fad336 - Use GitHub issues rather than updating a Trello card.
[Alex Tucker] b57d083813b089ab8107b2342f26cf94bf589f8b - Use gsscogs Docker images.
[Alex Tucker] cc2bca87d857753755272fa5aaa08034ec2428f6 - Add template for ref_* pipelines.
[Alex Tucker] fd491cc35f5f1a690f227435207d77378bce174e - Also validate columns.csv and components.csv.
No changes No changes No changes
[lperryman] 07849015efa94aaddb91889c3d7b996013e1fb94 - Created new schema.json
[lperryman] a8bc07c8a6a8294f33eb23aeaebaf559ef715f41 - Hard coded fix for problem with merged cell - Overall Total
[lperryman] 95312084781ecfce36a526fdecea677f1f673a5f - Hard coded fix for problem with merged cell - Overall Total
[lperryman] 5e658787fbb4539b7981000054a1c7526cee5fae - Commit without comparison table as problem with merged cell
[lperryman] 7e5b1a0a83cb4b2cc64c2f87f692a33e0db670e9 - Added comparison table back in
[lperryman] 4eaff0f57f134d98fc097b8a9e6c63aa3dabb2fd - Added comparison table back in
[Alex Tucker] ef905fd5f2db85565dc4eb0bde049534e4846b0f - Use --no-verbose to cut down line length of csvlint output, so it can be
[lperryman] 1b4fe4c46b924fdf85df299bd722f6391e6c23d5 - Trying to sort out mess of merged rowsn
[lperryman] 47b4c40cd9b26b8a37d8067173556a4d4b3ce4c0 - Trying to sort out mess of merged rowsn
[lperryman] c6481939fdaaf4ed8a5796c8c36b1a188823bd10 - Trying to sort out mess of merged rows
[lperryman] 951ae128ddcada208dfeb18a709a4bfaf8c09b2d - Still looking at the No Header problem
[lperryman] a9ac129d9c65b60235102b96ea7fb5b9d097486f - Still looking at the No Header problem
[lperryman] 7cf77e2a2c1de594439eed86c1e27d2f38575f40 - Still looking at the No Header problem
[lperryman] 44b7bfadc36213f345233060a5b620cb73e38b00 - trying to alline headers
[lperryman] 7135bf30c1e53efb5fc13d1745c58aa184f76a4b - adjusted some column values to match codelist values in ref_alcohol
[vtula2000] 4ddc89b29d5986f89ffea47a894a294c6e3f0fec - .py and JSON update
[vtula2000] 4d453d23825c5b1dafd80c6fe3dad536ebacf0f5 - Update scraper
[vtula2000] 054783c6bb689fc16042b36c14bdcb44d8798dd7 - Closes # 2,3,5
[vtula2000] 5cdd9fa3ea011a122373a5d514dae52cc9edcdc7 - Closes #5
View full output
Build was fixed!
Build 'GSS_data/Health/DoH-NI-drug-alcohol-treatment-services' is failing!
Last 50 lines of build output:
Changes since last successful build:
[Alex Tucker] 57b810eee25ce1249435af236755a151382dca37 - Attempt to avoid issues fetching external mapping (columns.csv) for upload.
[Alex Tucker] f7975dc9d2642014366c73686660a2e37708745c - Explicitly use addBinaryBody.
[Alex Tucker] 540ba45d5aa50426e9e1d3f7a1ec0411ddc164d4 - Write lock URI needs to have prepended.
[Alex Tucker] 6290fc536b2603617b26728abc883ac9169f23bf - Missed a missing
/v1/status
.[Alex Tucker] 5ee1bd86aebac936c0390926b177426944210e69 - Add optional argument for dataset metadata trig file.
[Alex Tucker] a75d492bb510a698967fb5411843dc5422b88016 - Make metadata param relative to CWD.
No changes No changes No changes No changes
[Alex Tucker] d304a5acc8766e52976306021fa62c6ab7bae04c - Add template transformation pipeline.
[Alex Tucker] 7eda5c2f5f1a251462cd0a2820b201263fd36e11 - Add getDraftsetEndpoint
[Alex Tucker] 7c9c4e98b4ee0c634379ab5253c3293b426e7301 - Add SPARQL tests step and publish results.
[Alex Tucker] 806951bf2ee882eb722ed68d14041b7f0e928fea - SPARQL tests need union-with-live=true
No changes
[Alex Tucker] d747d17b909dea7f689436a623263ff531631c94 - Don't trigger GDP-tests as they're now run on the unpublished draftset.
[Alex Tucker] 57b7cae64f2422e744b548d8533c87ea96b0c7b0 - Template for multiple datasets.
[Alex Tucker] 554340c2f38e69909c77daea277188852640b339 - Disambiguate use of 'dataset'
[Alex Tucker] 1452178f3d07debcb12de21cb3782810370ff2c0 - Use $refFamily
No changes
[Alex Tucker] 0ab4797047cdc3a26e01fe2cfd6da3da461c57f3 - Try to always update Trello card.
[Alex Tucker] 2c3a2d2dcad68f95080061335209f3d7241b6af9 - If main.py exists, convert to notebook using jupytext.
[Alex Tucker] 1acd29462408540f9fbc087e739c4dd458b20af7 - Convert any .py files to .ipynb using jupytext.
No changes No changes
[Alex Tucker] 0ab9caa46fd9a9ce37f92f6ff1886ef7d0fad336 - Use GitHub issues rather than updating a Trello card.
[Alex Tucker] b57d083813b089ab8107b2342f26cf94bf589f8b - Use gsscogs Docker images.
No changes
[Alex Tucker] cc2bca87d857753755272fa5aaa08034ec2428f6 - Add template for ref_* pipelines.
[Alex Tucker] fd491cc35f5f1a690f227435207d77378bce174e - Also validate columns.csv and components.csv.
No changes
No changes No changes No changes
[lperryman] 07849015efa94aaddb91889c3d7b996013e1fb94 - Created new schema.json
[lperryman] a8bc07c8a6a8294f33eb23aeaebaf559ef715f41 - Hard coded fix for problem with merged cell - Overall Total
[lperryman] 95312084781ecfce36a526fdecea677f1f673a5f - Hard coded fix for problem with merged cell - Overall Total
[lperryman] 5e658787fbb4539b7981000054a1c7526cee5fae - Commit without comparison table as problem with merged cell
No changes
[lperryman] 7e5b1a0a83cb4b2cc64c2f87f692a33e0db670e9 - Added comparison table back in
[lperryman] 4eaff0f57f134d98fc097b8a9e6c63aa3dabb2fd - Added comparison table back in
[Alex Tucker] ef905fd5f2db85565dc4eb0bde049534e4846b0f - Use --no-verbose to cut down line length of csvlint output, so it can be
[lperryman] 1b4fe4c46b924fdf85df299bd722f6391e6c23d5 - Trying to sort out mess of merged rowsn
[lperryman] 47b4c40cd9b26b8a37d8067173556a4d4b3ce4c0 - Trying to sort out mess of merged rowsn
[lperryman] 1b4fe4c46b924fdf85df299bd722f6391e6c23d5 - Trying to sort out mess of merged rowsn
[lperryman] 47b4c40cd9b26b8a37d8067173556a4d4b3ce4c0 - Trying to sort out mess of merged rowsn
[lperryman] c6481939fdaaf4ed8a5796c8c36b1a188823bd10 - Trying to sort out mess of merged rows
No changes
[lperryman] 951ae128ddcada208dfeb18a709a4bfaf8c09b2d - Still looking at the No Header problem
[lperryman] a9ac129d9c65b60235102b96ea7fb5b9d097486f - Still looking at the No Header problem
[lperryman] 7cf77e2a2c1de594439eed86c1e27d2f38575f40 - Still looking at the No Header problem
No changes
No changes
[lperryman] 44b7bfadc36213f345233060a5b620cb73e38b00 - trying to alline headers
[lperryman] 7135bf30c1e53efb5fc13d1745c58aa184f76a4b - adjusted some column values to match codelist values in ref_alcohol
No changes No changes
[vtula2000] 4ddc89b29d5986f89ffea47a894a294c6e3f0fec - .py and JSON update
[vtula2000] 4d453d23825c5b1dafd80c6fe3dad536ebacf0f5 - Update scraper
[vtula2000] 054783c6bb689fc16042b36c14bdcb44d8798dd7 - Closes # 2,3,5
[vtula2000] 5cdd9fa3ea011a122373a5d514dae52cc9edcdc7 - Closes #5
View full output