AD AVH Data - Data Refresh

[cha801p]

Ticket Update: June 26, 2024 (10:30 AM)

Issue: Data Refresh (https://collections.ala.org.au/public/show/dr15865) The data provider informed us that recent data has not been updated.

Ticket: (https://support.ehelp.edu.au/a/tickets/204872)

Actions Taken:

• [x] Checked data on uploads sever - data found
• [x] Reviewed the last run on EMR - 20th June
• [x] Checked all historic runs and logs - everything looks fine
• [x] Data review
• [x] Date format checked
• [x] Duplicates checked
• [x] Data uploaded to collector
• [x] Triggered pre-ingestion
• [x] Logs checked

Logs: 24/06/25 05:24:19 INFO ALAUUIDMintingPipeline: Checking the percentage change in new UUIDs: 24/06/25 05:24:19 INFO ALAUUIDMintingPipeline: newUuids: 3971.0, preservedUuids: 742749.0, orphanedUniqueKeys: 964.0 24/06/25 05:24:19 INFO ALAUUIDMintingPipeline: Percentage UUID change: 0, allowed percentage: 50, override percentage check: false 24/06/25 05:24:19 INFO ALAUUIDMintingPipeline: Backing up existing UUIDs to hdfs:///pipelines-data/dr15865/1/identifiers/ala_uuid_backup_1719293059876 24/06/25 05:24:19 INFO ALAUUIDMintingPipeline: Pipeline complete.

Status: Data Loaded on prod Data provider has been informed