NASA-PDS / harvest

Standalone Harvest client application providing the functionality for capturing and indexing product metadata into the PDS Registry system (https://github.com/nasa-pds/registry).
https://nasa-pds.github.io/registry
Other
4 stars 3 forks source link

"null" output when trying to run harvest on LADEE bundle #105

Closed jordanpadams closed 1 year ago

jordanpadams commented 2 years ago

πŸ› Describe the bug

πŸ“œ To Reproduce

  1. Run harvest against https://sbnarchive.psi.edu/pds4/ldex/ladee_ldex_20161118/ (may want to just download a small subset for time being)

  2. See output:

    2022-09-06 11:58:31,666 [SUMMARY] Reading configuration from /home/itrejo/ldex.cfg
    2022-09-06 11:58:31,766 [SUMMARY] Output directory: /home/atmos4/PDS/harvest/out
    2022-09-06 11:58:31,810 [SUMMARY] Elasticsearch URL: https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com:443, index: registry
    2022-09-06 11:58:32,437 [INFO] Connecting to Elasticsearch
    2022-09-06 11:58:35,441 [INFO] Loading PDS to ES data type mapping from /home/atmos4/PDS/harvest-3.6.0/elastic/data-dic-types.cfg
    2022-09-06 11:58:35,463 [INFO] Loading PDS to ES data type mapping from /home/atmos4/PDS/harvest-3.6.0/elastic/data-dic-types.cfg
    2022-09-06 11:58:35,468 [INFO] Loading PDS to ES data type mapping from /home/atmos4/PDS/harvest-3.6.0/elastic/data-dic-types.cfg
    2022-09-06 11:58:35,469 [INFO] Processing bundle directory /PDS/data/anonymous/PDS/data/PDS4/LADEE/ldex_bundle
    2022-09-06 11:58:35,513 [INFO] Processing bundle /PDS/data/anonymous/PDS/data/PDS4/LADEE/ldex_bundle/bundle_ladee_ldex.xml
    2022-09-06 11:58:35,866 [ERROR] null

πŸ•΅οΈ Expected behavior

Ingests the data

πŸ“š Version of Software Used

3.6.0

🩺 Test Data / Additional context

https://sbnarchive.psi.edu/pds4/ldex/ladee_ldex_20161118/

πŸ–₯ System Info

Linux OS


πŸ¦„ Related requirements

βš™οΈ Engineering Details

NOTE: This is a very old bundle so it will be quirky. We still want to figure out a way we can ingest basic information from the labels if at all possible, or at minimum, output some useful errors.

jordanpadams commented 1 year ago

cannot replicate with latest harvest, but still many issues with the data. per discussions with ATM, closing as wontfix. The data will be fixed.