Epic: Harvard Dataverse Repository NIH Metrics

[cmbz]

Overview

Tracking issue for monthly reports of NIH-funded datasets in Harvard Dataverse.

Resources

• https://github.com/IQSS/dataverse-pm/issues/118
• https://github.com/IQSS/dataverse-pm/issues/124
• Datasets published in Harvard Dataverse Repository through of 2024-03-31 from NIH-funded research

How these metrics are gathered for the monthly reports

At the beginning of each month @jggautier runs a Python script that:

• uses Dataverse's Native and Search APIs to gather the persistent IDs, months of publications, storage sizes, and metadata matches of datasets published in the previous month where the metadata includes the names and acronyms of NIH centers and institutes (see Search details for more information)
• scrapes each dataset's page to get its file download count
• uses the DataCite API to get each published dataset's citation count
• creates a CSV file with the following information for each published dataset: PID URL, publication month, citation count, file download count, storage size, and where NIH institute names and acronyms appear in the metadata
• prints the PIDs of any datasets that were removed (i.e. in the previous month's report but aren't in the current month's) and were added (i.e. in the current month's report but not in the previous month's)

@jggautier then reviews any datasets that were included in previous months but removed, reviews the metadata of newly added datasets to make sure there's actually some indication of NIH funding, removes any datasets that aren't from NIH-funded research, and adjusts the script so that those datasets are ignored when the script is used again. The script is also adjusted to include datasets that @jggautier and colleagues know have been funded by the NIH and are missing such indications in their metadata.

Search details The Python script uses the Search API to look across four metadata fields - Funding Information Agency, Contributor Name, Description, and Notes - for the full name of the NIH and its acronym and the full names of all NIH centers and institutes and most of their acronyms.

When looking through metadata in the Description field and Notes field, the script also looks for variations of the words "fund", "sponsor", "award", and "support" to increase the chances that it finds only datasets with metadata that acknowledges NIH funding.

[cmbz]

Status: March 2024

• Total NIH funded items: 290
• Total storage used by NIH-funded items: 3.11 TB
• Total downloads of NIH-funded items: 738,696
• Total citations of NIH-funded items: 22

[cmbz]

Status: April 2024

• Total NIH funded items: 290
  • 3 datasets were found (one published in April 2024 and two published earlier)
  • 3 non-NIH funded datasets were removed
• Total storage used by NIH-funded items: 3.11 TB
• Total downloads of NIH-funded items: 763,697
• Total citations of NIH-funded items: 22

[cmbz]

Status: May 2024

• Harvard Dataverse datasets have been indexed in the NIH's Dataset Catalog since the catalog launched in Feb. 2024
• NIH-funded datasets in Harvard Dataverse
  • Total NIH funded items: 293
  • 3 datasets were found (one published in May 2024 and two published earlier)
  • Total storage used by NIH-funded items: 3.11 TB
  • Total downloads of NIH-funded items: 840,550
  • Total citations of NIH-funded items: 23

[cmbz]

Status: June 2024

• Total NIH funded items: 295
  • 2 datasets were found (both published in June 2024)
• Total storage used by NIH-funded items: 3.11 TB
• Total downloads of NIH-funded items: 853,080
• Total citations of NIH-funded items: 49