search

geosolutions-it / ckanext-dataverse

A CKAN harvester for dataverse.org catalogues
0 stars 1 forks source link

dataverse harvester #1

Open etj opened 2 years ago

etj commented 2 years ago

Create an initial version of the dataverse harvester.

This is the API guide https://guides.dataverse.org/en/latest/api/

etj commented 2 years ago

We may use https://data.inrae.fr as a test endpoint

In the gather stage we'll use https://data.inrae.fr/api/search?q=* as a first query to get info about how many dataset are there, and then loop through all the pages.

As for the identifier part, sinhce the DOI do not change, we could use the global_id field as the external id.