inspirehep / inspire-next

The INSPIRE repo.
https://inspirehep.net
GNU General Public License v3.0
59 stars 69 forks source link

Validation errors in record migration #979

Closed jalavik closed 8 years ago

jalavik commented 8 years ago

NOTE that some codepaths will be different on Invenio 3 version of INSPIRE.

(from QA) but should be applicable in v3 as well. All recid references can be resolved on inspirehep.net/record/{{ recid }}/export/xme

[2016-03-08 14:42:09,559: WARNING/Worker-2] ValidationError: Record 1399215: ('E', 'E') is not of type u'string'

Failed validating u'type' in schema[u'properties'][u'hidden_notes'][u'items'][u'properties'][u'value']:
    {u'type': u'string'}

On instance[u'hidden_notes'][2][u'value']:
    ('E', 'E')
2016-03-08 14:42:09,818: WARNING/Worker-2] ValidationError: Record 1243363: 'Czech Technical University in Prague' is not one of [u'arXiv', u'AIP', u'APS', u'Annual Reviews', u'Astronomical Society of the Pacific', u'Author', u'Bulgarian Academy of Sciences', u'CERN', u'CERN/SLAC', u'Cambridge University Press', u'Canadian Center of Science and Education', u'DESY', u'DESY/SLAC', u'EDP Sciences', u'ELSEVIER', u'Education and Upbringing', u'Elsevier', u'European Astronomical Society', u'HEPDATA', u'HINDAWI', u'IEEE', u'INDICO', u'INSPIRE', u'IOP', u'IOS Press', u'IPAP', u'Indian National Science Academy', u'International Press', u'International Society for Optics and Photonics', u'Internet Academy', u'JACoW', u'Kharkov Institute of Physics and Technology', u'MDPI', u'MPI Grav. Phys., Potsdam', u'NRC Research Press', u'National Academy of Sciences of Armenia', u'Niscair', u'Oxford Journals', u'Oxford University Press', u'Physical Society of Japan', u'Polish Physical Society', u'Publisher', u'Royal Society', u'SIGMA', u'Springer', u'Tomsk State Pedagogical University', u'T\xdcB\u0130TAK', u'WILEY', u'WS', u'WSP', u'World Scientific']

Failed validating u'enum' in schema[u'properties'][u'abstracts'][u'items'][u'properties'][u'source']:
[2016-03-09 11:25:49,095: WARNING/Worker-4] ValidationError: Record 19325: ('CERN', 'INSPIRE:HEP') is not of type u'string'

Failed validating u'type' in schema[u'properties'][u'oai_pmh'][u'items'][u'properties'][u'previous_set']:
    {u'type': u'string'}

On instance[u'oai_pmh'][0][u'previous_set']:
    ('CERN', 'INSPIRE:HEP')
[2016-03-08 11:41:56,396: WARNING/Worker-1] ValidationError: Record 1280730: ('O. Sawada', 'S. Sugamoto') is not of type u'string'

Failed validating u'type' in schema[u'properties'][u'references'][u'items'][u'properties'][u'editors']:
    {u'type': u'string'}

On instance[u'references'][30][u'editors']:
    ('O. Sawada', 'S. Sugamoto')
[2016-03-10 02:49:02,683: WARNING/Worker-11] ValidationError: Record 902825: [{'source': 'DESY_AFF', 'value': ('GOTHENBURG CHALMERS UNIV',)}, {'source': 'DESY_AFF', 'value': ('GOETEBORG TECH UNIV',)}, {'source': 'DESY_AFF', 'value': ('GOETEBORG CHALMERS UNIV TECHNOL',)}, {'source': 'DESY_AFF', 'value': ('GOETEBORG CHALMERS UNIV TECHNOL',)}, {'source': 'DESY', 'value': ('Goeteborg Chalmers U. Technol.',)}] has non-unique elements

Failed validating u'uniqueItems' in schema[u'properties'][u'name_variants']:
    {u'items': {u'properties': {u'source': {u'description': u'FIXME: Do we really care about the source?',
                                            u'enum': [u'DESY',
                                                      u'DESY_AFF',
                                                      u'ADS'],
                                            u'title': u'Name variant source',
                                            u'type': u'string'},
                                u'value': {u'title': u'Name variant',
                                           u'type': u'array'}},
                u'title': u'Name variant',
                u'type': u'object'},
     u'title': u'Name variants',
     u'type': u'array',
     u'uniqueItems': True}

On instance[u'name_variants']:
    [{'source': 'DESY_AFF', 'value': ('GOTHENBURG CHALMERS UNIV',)},
     {'source': 'DESY_AFF', 'value': ('GOETEBORG TECH UNIV',)},
     {'source': 'DESY_AFF', 'value': ('GOETEBORG CHALMERS UNIV TECHNOL',)},
     {'source': 'DESY_AFF', 'value': ('GOETEBORG CHALMERS UNIV TECHNOL',)},
     {'source': 'DESY', 'value': ('Goeteborg Chalmers U. Technol.',)}]
jalavik commented 8 years ago

Superseded by #1206