IQSS / dataverse.harvard.edu

Custom code for dataverse.harvard.edu and an issue tracker for the IQSS Dataverse team's operational work, for better tracking on https://github.com/orgs/IQSS/projects/34
5 stars 1 forks source link

Investigate why Harvard Dataverse is unable to harvest from International Potato Center and ICRISAT Research Data Repository #259

Open jggautier opened 3 months ago

jggautier commented 3 months ago

Harvard Dataverse isn't able to harvest from two repositories that are using Dataverse - International Potato Center and ICRISAT Research Data Repository.

Harvard Dataverse's managing harvesting client page has been reporting that trying to harvest from these two repositories fails.

And when I try to edit these clients or create new clients, I get an error that the installation's harvesting URLs, https://data.cipotato.org/oai and https://dataverse.icrisat.org/oai, are invalid and that Harvard Dataverse couldn't establish connection and receive a valid server response.

It looks like the repositories have OAI enabled, since https://data.cipotato.org/oai?verb=Identify and https://dataverse.icrisat.org/oai?verb=Identify seem to work.

jggautier commented 2 weeks ago

When I used Python's request library to get records from International Potato Center today (July 10, 2024), I got a warning about an SSLCertVerificationError, which made me wonder if Harvard Dataverse and Demo Dataverse don't want to harvest from International Potato Center because of that SSL certificate error.

I didn't get this SSL certificate error when I tried to use Python's request library to get records from ICRISAT Research Data Repository.

pdurbin commented 2 weeks ago

records from International Potato Center today (July 10, 2024), I got a warning about an SSLCertVerificationError

Yes, I'm seeing similar errors from Java (server.log) when I show the detailed error: https://groups.google.com/g/dataverse-community/c/lpYLX4RkxO4/m/5KTRZQ-3AQAJ