NASA-PDS / deep-archive

PDS Open Archival Information System (OAIS) utilities, including Submission Information Package (SIP) and Archive Information Package (AIP) generators
https://nasa-pds.github.io/deep-archive/
Other
7 stars 4 forks source link

Software appears to be excluding all the products associated with the collections #69

Closed jordanpadams closed 4 years ago

jordanpadams commented 4 years ago

Describe the bug When running deep archive on this EPOXI bundle (pds-gamma:/data/local/starbase/data/pds4/test-bundles/pds4-epoxi_mri-v1.0) all the data files under hartley2_photometry/data/ are missing.

To Reproduce Steps to reproduce the behavior:

  1. Download the data from above
  2. Run pds-deep-archive -s PDS_SBN -b https://pdssbn.astro.umd.edu/holdings/ pds4-epoxi_mri-v1.0/bundle.xml

Expected behavior the SIP and AIP should contain all the product references in pds4-epoxi_mri-v1.0/hartley2_photometry/inventory.csv

Note some of the weirdness with this bundle:

Refs #32

jordanpadams commented 4 years ago

Update: It appears the software is only outputting bundles/collections and not any of the associated products. It appears all the files are getting written to the database, just not the AIP/SIP.

nutjob4life commented 4 years ago

Note to self (i.e., @nutjob4life): we parse for "P" lines in any <file_name> so long as the root element is a <Product_Collection>. We don't have to key off of .tab files like we currently are doing.