Open danfowler opened 7 years ago
I've figured out the missing value things. The non-castable value is going to be a problem—we do have to deal with dates BCE.
Just as a status update, your review has triggered a much-needed and comprehensive review of our export process. Expect new data very soon, now with additional oversight!
@workergnome that's excellent! Let me know where I can help!
Hiya, Dan. New data's up, if you want to try your magic data tools on it.
magic data tools
✨
$ pip install --pre goodtables
$ goodtables datapackage datapackage.json
Based on the following, it looks like the multi-value cell issue (https://github.com/frictionlessdata/specs/issues/381) needs to be addressed. This causes the many [enumerable-constraint]
errors.
Some rows don't have a date_acquired
value. Perhaps this field could be set to optional (i.e. remove 'required': true
constraint)?
(collection) legend:collection dan (master)$ goodtables datapackage datapackage.json
DATASET
=======
{'error-count': 155, 'table-count': 2, 'time': 3.902, 'valid': False}
TABLE [1]
=========
{'datapackage': 'datapackage.json',
'error-count': 155,
'headers': ['title',
'creation_date',
'creation_date_earliest',
'creation_date_latest',
'medium',
'accession_number',
'id',
'credit_line',
'date_acquired',
'department',
'physical_location',
'item_width',
'item_height',
'item_depth',
'item_diameter',
'web_url',
'provenance_text',
'classification',
'image_url',
'artist_id',
'party_type',
'full_name',
'cited_name',
'role',
'nationality',
'birth_date',
'death_date',
'birth_place',
'death_place'],
'row-count': 1000,
'source': '/Users/dan/open_knowledge/datasets/collection/cmoa.csv',
'time': 3.856,
'valid': False}
---------
[17,21] [enumerable-constraint] The value Person|Person in row 17 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[18,21] [enumerable-constraint] The value Person|Person in row 18 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[19,21] [enumerable-constraint] The value Person|Person in row 19 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[20,21] [enumerable-constraint] The value Person|Person in row 20 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[23,21] [enumerable-constraint] The value Person|Organization in row 23 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[26,21] [enumerable-constraint] The value Person|Organization in row 26 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[27,21] [enumerable-constraint] The value Person|Organization in row 27 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[28,21] [enumerable-constraint] The value Person|Organization in row 28 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[29,21] [enumerable-constraint] The value Person|Organization in row 29 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[30,21] [enumerable-constraint] The value Person|Organization in row 30 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[31,21] [enumerable-constraint] The value Person|Organization in row 31 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[35,21] [enumerable-constraint] The value Person|Person in row 35 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[36,9] [required-constraint] Column 9 is a required field, but row 36 has no value
[37,9] [required-constraint] Column 9 is a required field, but row 37 has no value
[40,21] [enumerable-constraint] The value Person|Organization in row 40 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[92,21] [enumerable-constraint] The value Person|Person in row 92 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[99,21] [enumerable-constraint] The value Person|Person in row 99 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[100,9] [required-constraint] Column 9 is a required field, but row 100 has no value
[101,9] [required-constraint] Column 9 is a required field, but row 101 has no value
[102,9] [required-constraint] Column 9 is a required field, but row 102 has no value
[103,9] [required-constraint] Column 9 is a required field, but row 103 has no value
[104,9] [required-constraint] Column 9 is a required field, but row 104 has no value
[129,21] [enumerable-constraint] The value Person|Organization in row 129 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[130,21] [enumerable-constraint] The value Person|Organization|Organization in row 130 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[133,21] [enumerable-constraint] The value Collaboration in row 133 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[160,21] [enumerable-constraint] The value Person|Person in row 160 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[180,21] [enumerable-constraint] The value Organization|Person|Person in row 180 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[181,21] [enumerable-constraint] The value Organization|Person|Person in row 181 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[182,21] [enumerable-constraint] The value Organization|Person|Organization in row 182 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[183,21] [enumerable-constraint] The value Organization|Person|Person|Organization in row 183 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[184,21] [enumerable-constraint] The value Organization|Person|Organization in row 184 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[185,21] [enumerable-constraint] The value Organization|Person|Person|Organization in row 185 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[186,21] [enumerable-constraint] The value Organization|Person|Person|Organization in row 186 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[187,21] [enumerable-constraint] The value Organization|Person|Person in row 187 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[188,21] [enumerable-constraint] The value Organization|Person|Person in row 188 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[189,21] [enumerable-constraint] The value Organization|Person|Person in row 189 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[190,21] [enumerable-constraint] The value Organization|Person|Person in row 190 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[191,21] [enumerable-constraint] The value Organization|Person|Person in row 191 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[192,21] [enumerable-constraint] The value Organization|Person|Person in row 192 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[193,21] [enumerable-constraint] The value Organization|Person|Organization in row 193 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[194,21] [enumerable-constraint] The value Organization|Person|Person in row 194 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[195,21] [enumerable-constraint] The value Organization|Person|Person|Organization in row 195 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[196,21] [enumerable-constraint] The value Organization|Person|Person|Organization in row 196 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[197,21] [enumerable-constraint] The value Organization|Person|Person|Organization in row 197 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[198,21] [enumerable-constraint] The value Organization|Person|Organization in row 198 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[204,9] [required-constraint] Column 9 is a required field, but row 204 has no value
[206,21] [enumerable-constraint] The value Organization|Person in row 206 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[207,21] [enumerable-constraint] The value Person|Organization in row 207 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[208,21] [enumerable-constraint] The value Organization|Person in row 208 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[209,21] [enumerable-constraint] The value Person|Person|Organization in row 209 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[214,21] [enumerable-constraint] The value Person|Person in row 214 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[218,21] [enumerable-constraint] The value Organization|Person in row 218 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[223,21] [enumerable-constraint] The value Person|Person in row 223 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[225,21] [enumerable-constraint] The value Person|Person in row 225 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[241,21] [enumerable-constraint] The value Person|Person in row 241 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[243,21] [enumerable-constraint] The value Person|Organization in row 243 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[244,21] [enumerable-constraint] The value Person|Organization in row 244 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[245,21] [enumerable-constraint] The value Person|Organization in row 245 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[246,21] [enumerable-constraint] The value Person|Organization in row 246 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[247,21] [enumerable-constraint] The value Person|Organization in row 247 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[248,21] [enumerable-constraint] The value Person|Organization in row 248 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[249,21] [enumerable-constraint] The value Person|Organization in row 249 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[250,21] [enumerable-constraint] The value Person|Organization in row 250 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[258,21] [enumerable-constraint] The value Person|Person in row 258 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[259,21] [enumerable-constraint] The value Person|Person in row 259 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[260,21] [enumerable-constraint] The value Person|Person in row 260 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[262,21] [enumerable-constraint] The value Person|Person in row 262 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[270,21] [enumerable-constraint] The value Person|Organization in row 270 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[327,21] [enumerable-constraint] The value Person|Organization in row 327 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[333,21] [enumerable-constraint] The value Person|Organization in row 333 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[359,21] [enumerable-constraint] The value Person|Person in row 359 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[406,21] [enumerable-constraint] The value Person|Person|Organization in row 406 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[414,21] [enumerable-constraint] The value Person|Person in row 414 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[415,21] [enumerable-constraint] The value Person|Person|Person in row 415 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[416,21] [enumerable-constraint] The value Person|Person|Person in row 416 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[421,21] [enumerable-constraint] The value Person|Person in row 421 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[422,21] [enumerable-constraint] The value Person|Person in row 422 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[423,21] [enumerable-constraint] The value Person|Person|Person|Person in row 423 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[428,21] [enumerable-constraint] The value Person|Person in row 428 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[563,21] [enumerable-constraint] The value Person|Organization in row 563 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[564,21] [enumerable-constraint] The value Person|Organization in row 564 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[593,21] [enumerable-constraint] The value Person|Organization in row 593 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[595,21] [enumerable-constraint] The value Person|Person in row 595 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[623,21] [enumerable-constraint] The value Person|Person|Organization in row 623 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[626,21] [enumerable-constraint] The value Person|Organization in row 626 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[628,21] [enumerable-constraint] The value Person|Person in row 628 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[647,21] [enumerable-constraint] The value Person|Organization in row 647 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[660,21] [enumerable-constraint] The value Person|Person in row 660 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[661,21] [enumerable-constraint] The value Person|Person in row 661 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[740,21] [enumerable-constraint] The value Person|Person in row 740 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[750,21] [enumerable-constraint] The value Person|Person in row 750 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[762,9] [required-constraint] Column 9 is a required field, but row 762 has no value
[771,21] [enumerable-constraint] The value Person|Person in row 771 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[774,21] [enumerable-constraint] The value Organization|Organization in row 774 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[775,21] [enumerable-constraint] The value Organization|Organization in row 775 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[776,21] [enumerable-constraint] The value Organization|Organization in row 776 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[777,21] [enumerable-constraint] The value Organization|Organization in row 777 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[778,21] [enumerable-constraint] The value Organization|Organization in row 778 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[779,21] [enumerable-constraint] The value Organization|Organization in row 779 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[780,21] [enumerable-constraint] The value Organization|Organization in row 780 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[781,21] [enumerable-constraint] The value Organization|Organization in row 781 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[782,21] [enumerable-constraint] The value Organization|Organization in row 782 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[783,21] [enumerable-constraint] The value Organization|Organization in row 783 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[784,21] [enumerable-constraint] The value Organization|Organization in row 784 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[785,21] [enumerable-constraint] The value Organization|Organization in row 785 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[786,21] [enumerable-constraint] The value Organization|Organization in row 786 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[787,21] [enumerable-constraint] The value Organization|Organization in row 787 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[788,21] [enumerable-constraint] The value Organization|Organization in row 788 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[789,21] [enumerable-constraint] The value Organization|Organization in row 789 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[811,21] [enumerable-constraint] The value Organization|Organization in row 811 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[816,21] [enumerable-constraint] The value Person|Organization in row 816 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[817,21] [enumerable-constraint] The value Person|Organization in row 817 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[820,21] [enumerable-constraint] The value Person|Organization|Organization in row 820 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[824,21] [enumerable-constraint] The value Person|Person in row 824 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[825,21] [enumerable-constraint] The value Person|Person in row 825 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[826,21] [enumerable-constraint] The value Person|Person in row 826 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[827,21] [enumerable-constraint] The value Person|Person in row 827 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[828,21] [enumerable-constraint] The value Person|Person in row 828 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[829,21] [enumerable-constraint] The value Person|Person in row 829 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[832,21] [enumerable-constraint] The value Person|Organization in row 832 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[835,21] [enumerable-constraint] The value Person|Organization in row 835 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[836,21] [enumerable-constraint] The value Person|Organization in row 836 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[838,21] [enumerable-constraint] The value Person|Organization in row 838 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[859,3] [non-castable-value] Row 859 has non castable value -0001-01-03 in column 3 (type: date, format: default)
[861,21] [enumerable-constraint] The value Person|Organization in row 861 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[862,21] [enumerable-constraint] The value Person|Organization in row 862 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[865,9] [required-constraint] Column 9 is a required field, but row 865 has no value
[866,21] [enumerable-constraint] The value Person|Organization in row 866 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[868,21] [enumerable-constraint] The value Person|Person|Organization in row 868 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[875,21] [enumerable-constraint] The value Person|Person in row 875 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[878,21] [enumerable-constraint] The value Person|Organization in row 878 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[879,21] [enumerable-constraint] The value Person|Organization in row 879 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[908,9] [required-constraint] Column 9 is a required field, but row 908 has no value
[908,21] [enumerable-constraint] The value Person|Person in row 908 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[909,9] [required-constraint] Column 9 is a required field, but row 909 has no value
[910,9] [required-constraint] Column 9 is a required field, but row 910 has no value
[911,9] [required-constraint] Column 9 is a required field, but row 911 has no value
[912,9] [required-constraint] Column 9 is a required field, but row 912 has no value
[917,21] [enumerable-constraint] The value Person|Organization in row 917 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[918,21] [enumerable-constraint] The value Person|Organization in row 918 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[919,21] [enumerable-constraint] The value Person|Organization in row 919 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[920,21] [enumerable-constraint] The value Person|Organization in row 920 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[921,21] [enumerable-constraint] The value Person|Organization in row 921 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[922,21] [enumerable-constraint] The value Person|Organization in row 922 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[923,21] [enumerable-constraint] The value Person|Organization in row 923 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[924,21] [enumerable-constraint] The value Person|Organization in row 924 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[928,21] [enumerable-constraint] The value Person|Organization in row 928 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[929,21] [enumerable-constraint] The value Person|Organization in row 929 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[931,21] [enumerable-constraint] The value Person|Organization in row 931 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[942,21] [enumerable-constraint] The value Person|Organization in row 942 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[943,21] [enumerable-constraint] The value Person|Organization in row 943 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[954,21] [enumerable-constraint] The value Collaboration in row 954 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[998,21] [enumerable-constraint] The value Person|Organization in row 998 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[999,21] [enumerable-constraint] The value Person|Organization in row 999 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
[1000,21] [enumerable-constraint] The value Person|Organization in row 1000 and column 21 does not conform to the given enumeration: ['Organization', 'Person', ' Collaboration']
TABLE [2]
=========
{'datapackage': 'datapackage.json',
'error-count': 0,
'headers': ['title',
'creation_date',
'creation_date_earliest',
'creation_date_latest',
'medium',
'accession_number',
'id',
'credit_line',
'date_acquired',
'department',
'physical_location',
'item_width',
'item_height',
'item_depth',
'item_diameter',
'web_url',
'provenance_text',
'classification',
'image_url',
'artist_id',
'party_type',
'full_name',
'cited_name',
'role',
'nationality',
'birth_date',
'death_date',
'birth_place',
'death_place'],
'row-count': 1000,
'source': '/Users/dan/open_knowledge/datasets/collection/teenie.csv',
'time': 3.805,
'valid': True}
So interesting.
So, date_acquired (which is, as you might guess, the date that we acquired the work) is, in fact, a required field. 650 works in our collection don't have one of those, which means that we're now going back and fixing those records.
I forked this repository and slightly edited the
datapackage.json
to remove the schema references which now work differently (http://specs.frictionlessdata.io/tabular-data-resource/). Unfortunately, this involves literally copying the schema across two different resources. This is necessary to use the tools until they catch up to v1 of the specs and support JSON Pointers.After that, I ran
goodtables datapackage datapackage.json
(https://github.com/frictionlessdata/goodtables-py) which will test the first 1000 rows. It looks like the[missing-value]
errors result from having too few columns (commas) for these rows. It looks like several columns look something like below:as opposed to:
Finally, on row 991, there is an incorrectly formatted date:
-0001-01-03
.There may be more errors like this. This is only for the first 1000 rows.