Provide OAI-PMH endpoint for Wikidata

InvasionBiologyHypotheses / Documentation

Documentation related to building an open, zoomable atlas for invasion science and beyond

Creative Commons Zero v1.0 Universal

1 stars 0 forks source link

Provide OAI-PMH endpoint for Wikidata #10

Open Daniel-Mietchen opened 3 years ago

Daniel-Mietchen commented 3 years ago

This is necessary since Open Knowledge Maps works on the basis of BASE.

Daniel-Mietchen commented 2 years ago

Several points to consider here, as per separate email discussions.

How to pull the data from WIkidata
- This could be done, e.g., via
- SPARQL
  - Wikidata Query Service
  - LDF
  - dedicated Wikidata endpoint
- dumps
- API
How to convert the data into a format compatible with BASE (details)
- perhaps via citation.js
How to get these data into BASE ( cf. #11 )
How to make it generic for any Wikibase
- see slide 8 in this presentation for a related initiative

Daniel-Mietchen commented 2 years ago

Some more background:

We want to enable Open Knowledge Maps to visualize literature indexed (and curated) in Wikidata, as discussed in the proposal. OAI-PMH is not mentioned there, but seems a reasonable option, since OKM works through BASE and BASE via OAI-PMH.
In terms of timing, we plan to have a working Wikidata to OKM prototype up by about mid-February 2022, but this does not have to be the final setup.
One issue yet to address is that of deduplication, since most publications known to Wikidata are likely already known to BASE via some channel.

Daniel-Mietchen commented 2 years ago

I had a call with the Archives nationales de Luxembourg today to explore what we could be doing together. They have been using OAI-PMH for years and have begun the above-mentioned Wikibase project, in the framework of which they have also been exploring some bridging between OAI-PMH and Wikibase. They need it in both directions, though (i.e. they want to roundtrip), which is hardly possible, so not their priority right now. Still, they are happy to advise us.

Daniel-Mietchen commented 2 years ago

For OAI-PMH to Wikidata, see also https://twitter.com/LibrErli/status/1456971768170745856 .

Daniel-Mietchen commented 2 years ago

The Wikipedia Citations Database might also be relevant in this space, as it runs on Wikibase and would probably benefit from having an OAI-PMH endpoint.

More via this email.

Daniel-Mietchen commented 2 years ago

There was a presentation last week about the Luxembourg project mentioned above — no mention of OAI-PMH, but CIDOC-CRM instead:

Representing the Luxembourg Shared Authority File based on CIDOC-CRM in Wikibase

Daniel-Mietchen commented 2 years ago

I shrinked the scope of this ticket a bit because we have

14

for the more generic OAI-PMH endpoint for Wikibase.