search

cessda / cessda.cdc.versions

Issue track and wiki for the CESSDA Data Catalogue
https://datacatalogue.cessda.eu/
Apache License 2.0
0 stars 0 forks source link

Create standalone validation route for XML files harvested from OAI-PMH endpoints #323

Closed cessda-bitbucket-importer closed 3 years ago

cessda-bitbucket-importer commented 3 years ago

Original report on BitBucket by John Shepherdson (GitHub: john-shepherdson).

As first step towards integrating EQB Harvester and CMV into CDC, we propose to combine EQB Harvester with CMV, plus a file store for the XML files and a database to record the validation results (pass/fail) and details of any violations.

In the short term, this will act as both proof of concept and feedback mechanism for SPs, so they have the opportunity to fix their metadata before rejection of invalid inputs becomes part of CDC.

In the medium term, CDC will be modified to use this combination of components to support both validation of inputs and incorporation of the OAI-PMH based aggregation functionality being built by FSD.

This issue acts as an umbrella - links to relevant issues will be added, as and when they are created.

cessda-bitbucket-importer commented 3 years ago

Original comment by John Shepherdson (GitHub: john-shepherdson).

See related issues:

issue #324 issue #325, issue #326, issue #327, issue #328, issue #329, issue #330, issue #331, issue #332, issue #333

cessda-bitbucket-importer commented 3 years ago

Original comment by John Shepherdson (GitHub: john-shepherdson).

See also diagram https://drive.google.com/file/d/1kYXcgI6m5fg-ofaK2wAUEp3r2Hj4_0fP/view?usp=sharing

cessda-bitbucket-importer commented 3 years ago

Original comment by John Shepherdson (GitHub: john-shepherdson).

Work in progress

cessda-bitbucket-importer commented 3 years ago

Original comment by John Shepherdson (GitHub: john-shepherdson).

All related issues have been resolved/closed so this umbrella issue can be closed.