search

netwerk-digitaal-erfgoed / dataset-register

Components (API and crawler) for the NDE Dataset Register
https://datasetregister.netwerkdigitaalerfgoed.nl/api/
European Union Public License 1.2
4 stars 3 forks source link

Time-out on NA datacatalog #931

Closed coret closed 3 months ago

coret commented 3 months ago

The NA has updated their hydra-paged catalog https://archief.nl/id/datacatalog/toegang (added OAI-PMH distributions), but these changes don't end up in the triplestore of the Dataset Register.

Registering https://archief.nl/id/datacatalog/toegang via the Dataset Register API shows a time-out error (which I think isn't caused by NA infrastructure, but by the handling of the large quantity of dataset descriptions):

curl 'https://datasetregister.netwerkdigitaalerfgoed.nl/api/datasets' \
            -H 'link: <http://www.w3.org/ns/ldp#RDFSource>; rel="type",<http://www.w3.org/ns/ldp#Resource>; rel="type"' \
            -H 'content-type: application/ld+json' \
            --data-binary '{"@id":"https://archief.nl/id/datacatalog/toegang"}'
<html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>
ddeboer commented 3 months ago

Fixed. The datasets now have an OAI-PMH distribution; see for example https://datasetregister.netwerkdigitaalerfgoed.nl/show.php?lang=en&uri=https://archief.nl/id/dataset/toegang/2.04.101.