[nssdca-delivery] urn:nasa:pds:gbo.ast.catalina.survey::1.0 20220420

[beatricemueller]

Discipline Node Information

• Delivering Node: please enter your DN here for record keeping purposes

• PDS_PSI

• NSSDCA Delivery Package: please upload the files output by PDS Deep Archive as a TAR.GZ or ZIP file here, or supply a URL to download from

• https://sbnarchive.psi.edu/pds4/surveys/catalina_extras/sips/deltas/20220420_deltas.zip

• Validation report: please upload a TXT report or screenshot of PDS4 Validate Tool run on your bundle. NSSDCA only accepts valid PDS4 bundles. be sure you run validate with the -R pds4.bundle flag enabled to ensure all integrity checks are completed successfully.

• https://sbnarchive.psi.edu/pds4/surveys/catalina_extras/validation/20220420.tar.gz

NOTE: If you have multiple delivery packages, we strongly encourage you to submit these in batches of 3 to 10 per issue with one ZIP file of the packages and another ZIP file of the validation reports. Please use a descriptive title, such as "Node Mission misc batch #".

---

Engineering Node Process

See the internal EN process at https://pds-engineering.jpl.nasa.gov/content/nssdca_interface_process

[beatricemueller]

@c-suh: Note that the validation report might have errors, but any file that throws an error is pulled and is not submitted and will be submitted subsequently once fixed. This is an acceptable approach as discussed in https://github.com/NASA-PDS/operations/issues/252

[c-suh]

Hello @beatricemueller, this set has been posted for NSSDCA processing. From tomorrow, you can check the status at https://nssdc.gsfc.nasa.gov/psi/ReportPDS4.jsp using the SIP LID below:

SIP LID:

• urn:nasa:pds:system_bundle:product_sip_deep_archive:gbo.ast.catalina.survey_v1.0_20220420_delta_20220908200751165540

---

A friendly reminder to have Jesse upgrade the Validate tool to the latest version as we have been pushing out a number of fixes. It is currently at v2.3.0, compared to the v2.0.6 shown in the submitted reports, and upgrading Validate will address some of the errors mentioned above. Thank you!

[smclaughlin7]

Hi @c-suh @beatricemueller @jstone-psi, the NSSDCA's front-end could not process this SIP LID

urn:nasa:pds:system_bundle:product_sip_deep_archive:gbo.ast.catalina.survey_v1.0_20220420_delta_20220908200751165540

because the extension of the actual manifest (.tab.out) does not match the value in the SIP XML file (.tab):

URL to SIP XML file: https://pds.nasa.gov/data/pds4/manifests/2022/gbo.ast.catalina.survey_v1.0_20220420_sip_delta_20220908200751165540_v1.0.xml

specified in SIP XML: https://pds.nasa.gov/data/pds4/manifests/2022/gbo.ast.catalina.survey_v1.0_20220420_sip_delta_20220908200751165540_v1.0.tab Actual manifest filename: https://pds.nasa.gov/data/pds4/manifests/2022/gbo.ast.catalina.survey_v1.0_20220420_sip_delta_20220908200751165540_v1.0.tab.out Catherine: Instead of having Bea make a new version of this SIP, could you please rename the manifest file from **_.tab.out_** to **_.tab_** in your EN manifest repository? When done, please let me know then we/NSSDCA will delete that unprocessed SIP from our queue so that our automated SIP puller will reget the SIP and the renamed file early tomorrow morning. Does this make sense to you? Bea: Perhaps check why the manifest file was given the extension **_.tab.out_** in the Deep Archive Package? I think this is the first we've encounterd this for CSS deliveries. Thanks!

[c-suh]

@smclaughlin7 the file has been renamed and its associated files touched with today's timestamp so that your automated puller will get it tonight. If I don't hear from you tomorrow or Monday, I'll assume that it's gone well!

[smclaughlin7]

@c-suh Thank you for renaming the SIP manifest file and touching its associated files! That should work. @beatricemueller

[jstone-psi]

Thanks, everyone! I believe that I have resolved the issue on our end, so this should no longer happen.

[smclaughlin7]

@jstone-psi Great! Thanks Jesse!

[smclaughlin7]

@beatricemueller @jstone-psi @c-suh Hi Beatrice, Jesse: Good news! We successfully ingested all the products contained in this SIP LID (i.e., downloaded and registered all the products) and are archiving to tape now:

urn:nasa:pds:system_bundle:product_sip_deep_archive:gbo.ast.catalina.survey_v1.0_20220420_delta_20220908200751165540

I'd like to note that we detected several primary basic product LIDVIDs listed in one or more collection inventory files contained/delivered in this SIP but those products are not online and were not listed in this SIP (not a problem because they're not online). I attached a list of the LIDVIDs. If these products are not online, perhaps they should be removed from future collection inventories?

This does not affect our ingest process; we just remark on this finding. Thanks!

gbo.ast.catalina.survey_v1.0_20220420_delta_20220908200751165540_ProdsInCollsButNotOnline.txt

[jstone-psi]

Thanks, Stef! I think I looked into this issue previously, and the missing files had failed validation, so weren't being included moved to the archive, but they were being added to the collection anyway. I've since resolved this issue, so we should be able to filter them out of future collections.

[smclaughlin7]

Hi Jesse. Ah, so you did look into this before. I totally forgot and am glad you remembered! Thank you for confirming this issue is resolved.

[c-suh]

@beatricemueller, the set for gbo.ast.catalina.survey_v1.0_20220420_delta_20220908200751165540 has been archived to tape by the NSSDCA.