Registry manager should report Elasticsearch API errors.
π To Reproduce
Steps to reproduce the behavior:
Harvest a label with invalid / unsupported date field, e.g.,
<cassini:earth_received_start_time>1999-010T05:44:46.821</cassini:earth_received_start_time>NOTE: This date could not be loaded into Elasticsearch without conversion to "ISO instant" format.
Harvest does the conversion, but only for fields which have "date" in their names.
Make sure that cassini:earth_received_start_time has data type date in Elasticsearch data dictionary index (registry-dd)
Load harvested data with registry manager
There are no errors in registry manager output, but the document is not loaded into Elasticsearch.
π΅οΈ Expected behavior
Registry manager should report an error similar to this:
failed to parse field [cassini:VIMS_Specific_Attributes/cassini:earth_received_start_time]
of type [date] in document with id 'urn:nasa:pds:cassini_vims_cruise:data_raw:1294638283::1.0'.
Preview of field's value: '1999-010T05:44:46.821'
We have to figure out how to fix Harvest. Probably introduce a "list of date fields" option in Harvest configuration file.
The reason "time" fields are not automatically converted is because there are a lot of different mission specific formats, like
π Describe the bug
Registry manager should report Elasticsearch API errors.
π To Reproduce
Steps to reproduce the behavior:
<cassini:earth_received_start_time>1999-010T05:44:46.821</cassini:earth_received_start_time>
NOTE: This date could not be loaded into Elasticsearch without conversion to "ISO instant" format. Harvest does the conversion, but only for fields which have "date" in their names.cassini:earth_received_start_time
has data typedate
in Elasticsearch data dictionary index (registry-dd
)π΅οΈ Expected behavior
Registry manager should report an error similar to this:
π©Ί Test Data / Additional context
1294638283.zip
We have to figure out how to fix Harvest. Probably introduce a "list of date fields" option in Harvest configuration file. The reason "time" fields are not automatically converted is because there are a lot of different mission specific formats, like
:unicorn: Applicable requirements