pulibrary / pdc-osti

2 stars 0 forks source link

Bug: Fix handling of DOI and ARK for output TSV files #75

Closed astrochun closed 2 weeks ago

astrochun commented 2 weeks ago

Expected behavior

An issue occurred when we re-ran it. Because of the use of ARKs and many records are NaN, this results in a shortened list. We need to switch over to DOI and ultimately remove ARKs moving forward.

Actual behavior

A list of 18 records should have been generated in pdc_entry_form.tsv and pdc_form_input.tsv

Steps to replicate

Run scraper

Impact of this bug

This will result in an incomplete submission to DOE/OSTI