search

NASA-PDS / operations

Tickets for the PDSEN Operations Team
Other
5 stars 1 forks source link

[nssdca-delivery] urn:nasa:pds:orex.ovirs::11.0 #409

Closed beatricemueller closed 2 months ago

beatricemueller commented 1 year ago

Discipline Node Information

NOTE: If you have multiple delivery packages, we strongly encourage you to submit these in batches of 3 to 10 per issue with one ZIP file of the packages and another ZIP file of the validation reports. Please use a descriptive title, such as "Node Mission misc batch #".

Engineering Node Process

See the internal EN process at https://pds-engineering.jpl.nasa.gov/content/nssdca_interface_process

beatricemueller commented 1 year ago

@c-suh : The validation report contains a readme file explaining the various files and validation failures.

smclaughlin7 commented 1 year ago

@beatricemueller Thanks for asking (in #329) about this big bundle (2,342,801 records, ~1.2 TB) before submitting it to github for EN. @c-suh Our ingest team said it's OK to post the submission. Thanks!

c-suh commented 12 months ago

@smclaughlin7 apologies for the delay. I'm verifying the contents of the validation reports and readme and will post this for you as soon as possible (possibly by the middle of next week).

nutjob4life commented 11 months ago

Needing to ask Jordan about it

c-suh commented 11 months ago

@jordanpadams just a reminder to take a look at this ticket when you have a chance, please and thank you!

jordanpadams commented 11 months ago

@beatricemueller it looks like from your validation report it notes:

Identifier urn:nasa:pds:orex.ovirs:data_raw::4.0 already defined (old location: file:/sbn/staging/orex/orex.ovirs.v11/orex.ovirs/data_raw/SUPERSEDED/v3_0/collection_ovirs_data_raw.xml)

That would indicate that v3_0/collection_ovirs_data_raw.xml is not actually v3.0 after all. When this data is eventually registered, even the superseded versions, this will error out, or worse, overwrite the correct version. Is this intended?

Per the validate bug, have you tried running this with the latest version of validate and/or has this bug been filed so we can fix it? The bundle/collection referential integrity is really the thing that has to be right before we deliver to the NSSDCA. If that is invalid, it will just get punted back to us.

beatricemueller commented 11 months ago

Jordan,

That problem was fixed and just that file was re-validated. The validation file ovirs.val.v11.raw.txt was included in the validation report but its relevance might have been shrouded.

Jesse checked, and everything is fine on our archive site. The superseded products don't appear to be included in the SIP file, so it shouldn't affect ingestion. So the error can be ignored.

Beatrice

On Jul 28, 2023, at 07:41, Jordan Padams @.***> wrote:

@beatricemueller https://www.google.com/url?q=https://github.com/beatricemueller&source=gmail-imap&ust=1691160116000000&usg=AOvVaw03iYFf9A_mBFL9sasokbMu it looks like from your validation report it notes:

Identifier urn:nasa:pds:orex.ovirs:data_raw::4.0 already defined (old location: file:/sbn/staging/orex/orex.ovirs.v11/orex.ovirs/data_raw/SUPERSEDED/v3_0/collection_ovirs_data_raw.xml) That would indicate that v3_0/collection_ovirs_data_raw.xml is not actually v3.0 after all. When this data is eventually registered, even the superseded versions, this will error out, or worse, overwrite the correct version. Is this intended?

Per the validate bug, have you tried running this with the latest version of validate and/or has this bug been filed so we can fix it? The bundle/collection referential integrity is really the thing that has to be right before we deliver to the NSSDCA. If that is invalid, it will just get punted back to us.

— Reply to this email directly, view it on GitHub https://www.google.com/url?q=https://github.com/NASA-PDS/operations/issues/409%23issuecomment-1655806635&source=gmail-imap&ust=1691160116000000&usg=AOvVaw3cVjy7I-QD42lIQq8mluu8, or unsubscribe https://www.google.com/url?q=https://github.com/notifications/unsubscribe-auth/AKLIING7YL4T5UXZQM3PFF3XSPFTHANCNFSM6AAAAAAZQTBOWU&source=gmail-imap&ust=1691160116000000&usg=AOvVaw1LXfd2D4IyFAUWdAmleXN3. You are receiving this because you were mentioned.

Beatrice E. A. Mueller Planetary Science Institute 1700 E. Ft. Lowell Rd., Suite 106 Tucson AZ 85719 mueller at psi . edu phone: 520-547-3950 FAX: 520-795-3697

c-suh commented 11 months ago

@beatricemueller and @smclaughlin7, this set has been posted for NSSDCA processing! From tomorrow, you can check the status at https://nssdc.gsfc.nasa.gov/psi/ReportPDS4.jsp using the SIP LID below:

SIP LID:

oddes commented 8 months ago

10/16/2023: Status is Pre-Ingest.

oddes commented 7 months ago

10/12/2023: Status is Pre-Ingest.

jordanpadams commented 7 months ago

Status verified on 11/30/2023: SIPs are still awaiting ingest

jordanpadams commented 6 months ago

@beatricemueller all packages have been validated by NSSDCA and submitted to Ingest. NSSDCA has now taken responsibility for an additional copy of this data

jordanpadams commented 6 months ago

RE-opening. These are still in pre-ingest

c-suh commented 5 months ago

Status: urn:nasa:pds:system_bundle:product_sip_deep_archive:orex.ovirs_v11.0_20230616 has been Submitted to Ingest.

c-suh commented 4 months ago

Status is the same.

c-suh commented 4 months ago

Status is the same.

c-suh commented 3 months ago

Same status for urn:nasa:pds:system_bundle:product_sip_deep_archive:orex.ovirs_v11.0_20230616.

c-suh commented 3 months ago

Status for this package is the same - submitted to ingest.

c-suh commented 2 months ago

Status is the same.

jordanpadams commented 2 months ago

@smclaughlin7 do we have a status on this delivery? This was posted >8 months ago.

beatricemueller commented 2 months ago

It is listed as ingested on 2024-04-15 on the NSSDC website.

Bea

On Apr 23, 2024, at 13:22, Jordan Padams @.***> wrote:

@smclaughlin7 https://www.google.com/url?q=https://github.com/smclaughlin7&source=gmail-imap&ust=1714508560000000&usg=AOvVaw2YxJzC46myIYAkXwSvf-Ej do we have a status on this delivery? This was posted >8 months ago.

— Reply to this email directly, view it on GitHub https://www.google.com/url?q=https://github.com/NASA-PDS/operations/issues/409%23issuecomment-2073377941&source=gmail-imap&ust=1714508560000000&usg=AOvVaw21kktKdOOC9QrvZkNw5omE, or unsubscribe https://www.google.com/url?q=https://github.com/notifications/unsubscribe-auth/AKLIINEQMSWCDBOKP7ZDNDLY627I3AVCNFSM6AAAAAAZQTBOWWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANZTGM3TOOJUGE&source=gmail-imap&ust=1714508560000000&usg=AOvVaw39Cac4xHlixAyZuq66hzsF. You are receiving this because you were mentioned.

Beatrice E. A. Mueller Planetary Science Institute 1700 E. Ft. Lowell Rd., Suite 106 Tucson AZ 85719 mueller at psi . edu phone: 520-547-3950 FAX: 520-795-3697

smclaughlin7 commented 2 months ago

Beatrice, that's correct. We finished ingesting this SIP on 2024-04-15, urn:nasa:pds:system_bundle:product_sip_deep_archive:orex.ovirs_v11.0_20230616.

c-suh commented 2 months ago

Thank you for the updates! NSSDCA has now taken responsibility.