research-software-directory / RSD-as-a-service

This repo contains the new RSD-as-a-service implementation
https://research.software
27 stars 14 forks source link

Bulk importing Crossref mentions fails #1270

Closed ewan-escience closed 2 months ago

ewan-escience commented 3 months ago

When using the bulk import feature to import many Crossref mentions, this fails, because the the env variable CROSSREF_CONTACT_EMAIL is not used in the requests, resulting in failed or slow API requests to Crossref. See #808 for examples of mentions to bulk import. The cause seems to be that the function getCrossrefItemByDoi in frontend/utils/getCrossref.ts does not use the function addPoliteEmail in the same file.

ewan-escience commented 3 months ago

Just adding the email to the requests is at the moment nog enough, as, apparently, there are additional limits on the amount of concurrent requests one can make to the API. I'm in contact with Crossref about this. See also this blog post.