Update DwC Terms in the Preingestion

[cha801p]

The terms used in the pipeline are outdated and must be updated to reflect current standards and practices. Example - The ingestion pipelines only recognise the term within the meta.xml file. As a result, no other GBIF and DwC terms have been processed. This limitation leads to the eventType not being captured on events.test.

[cha801p]

Ticket Update: June 3, 2024 (6:30 PM) Objective: EventType Update Verification

Test Dataset: dr22687

Test Steps:

Dataset Deletion:

• Navigate to the Elastic Search instance: aws-events-es-2022-2.ala
• Delete the dataset with the key dr22687.

Modification in DwCA:

• Open the meta.xml file in the Darwin Core Archive (DwCA) for dataset dr22687
• Change the field definition from: to:

Data Re-ingestion:

• Re-ingest the modified DwCA data.
• Trigger the Elastic_dataset_indexing DAG to index the dataset.

Verification:

• After the indexing process is complete, navigate to the dataset view at events.test.ala.org.au.
• Verify that the eventType field appears correctly.

Expected Outcome: The eventType field should appear correctly in the dataset view at events.test.ala.org.au, confirming that the DwC Terms have been updated.

Issue Observed: While the eventType appears correctly on the web interface, the eventType column in the DwCA-exports is coming up empty.

Status:

• [ ] The DwC Terms update has been successfully reflected on the events web interface.
• [ ] Further investigation is required to determine why the eventType column is empty in the DwCA-exports.

[adam-collins]

The DwCA export is generated by a different DAG. Added some notes on the linked issue.