new data source: copernicus

subhh / HOS-MetadataTransformations

DEPRECATED - no longer actively maintained. Automated workflow for harvesting, transforming and indexing of metadata using metha, OpenRefine and Solr. Part of the Hamburg Open Science "Schaufenster" software stack.

http://openscience.hamburg.de

GNU General Public License v3.0

19 stars 1 forks source link

new data source: copernicus #37

Open felixlohmeier opened 5 years ago

felixlohmeier commented 5 years ago

codename: copernicus
collection: copernicus.org
oai pmh endpoint: https://oai-pmh.copernicus.org/oai.php

felixlohmeier commented 5 years ago

first commits: https://github.com/subhh/HOS-MetadataTransformations/commit/42e30d859f85eb54112ee83f25f8581460c81fe6 and https://github.com/subhh/HOS-MetadataTransformations/commit/4fdb2a5f2208bbd5e2583b45860b5b165151e77f

felixlohmeier commented 5 years ago

error message during oai harvesting

INFO[0034] written /home/etl/.metha/I29haV9kYyNodHRwczovL29haS1wbWguY29wZXJuaWN1cy5vcmcvb2FpLnBocA/2018-09-30-00000142.xml-tmp-427131848
INFO[0034] https://oai-pmh.copernicus.org/oai.php?resumptionToken=87251618&verb=ListRecords
FATA[0034] XML syntax error on line 344: invalid UTF-8