[Parser Fix]: Add missing funding and license information from Mendeley - Githubissues

NIAID-Data-Ecosystem / nde-crawlers

Harvesting infrastructure to collect and standardize dataset and computational tool metadata

Apache License 2.0

0 stars 1 forks source link

[Parser Fix]: Add missing funding and license information from Mendeley #164

Open gtsueng opened 2 weeks ago

gtsueng commented 2 weeks ago

Issue Name

Add missing funding and license information from Mendeley

Issue Description

Funding and license information appear to be missing from Mendeley records:

Example of a record in the Discovery Portal: https://data.niaid.nih.gov/resources?id=mendeley_nbgsfj9zhm

The same record in Mendeley:

Potential cause of issue: The OAI Dublin core export of the record is missing the funding information: https://data.mendeley.com/oai?verb=GetRecord&metadataPrefix=oai_dc&identifier=oai:data.mendeley.com/nbgsfj9zhm.1

However, the OAI DataCite export of the record has this information intact: https://data.mendeley.com/oai?verb=GetRecord&metadataPrefix=datacite&identifier=oai:data.mendeley.com/nbgsfj9zhm.1

Issue Example

No response

Related WBS task

[ ] Check here if this repository is funded by NIAID (https://github.com/NIAID-Data-Ecosystem/nde-roadmap/issues/11)
[ ] Check here if this repository only has IID data (https://github.com/NIAID-Data-Ecosystem/nde-roadmap/issues/12)
[X] Check here if this is a generalist repository with IID data (https://github.com/NIAID-Data-Ecosystem/nde-roadmap/issues/12)

For internal use only. Assignee, please select the status of this issue

[ ] Not yet started
[ ] In progress
[ ] Blocked
[ ] Will not address

Status Description

No response

gtsueng commented 1 week ago

As of 2024.09.06, the Mendeley parser has been updated to include funding and license information and this information is now on all servers; however, the EXTRACT information is now missing. The EXTRACT pipeline will be run over the weekend for the ~30K new records in Mendeley.