Data Refresh for Australian Platypus Conservancy platypus and rakali - March-May 2024

[cha801p]

Ticket Update: June 3, 2024 (6:30 PM)

Issue: Refresh of APC data for March to May

Resolution: The new dataset has been successfully loaded into biocache. (Verified by loading on databox)

Actions Taken:

• [x] Modified "catalogueNumber" to "catalogNumber".
• [x] Fixed date format; This problem may have arisen due to the xlsx file format.
• [x] _incrementalload:true
• [x] The data has been loaded into databox and prod.
• [x] I have verified the UUID count and will ensure it reflects on prod tomorrow after indexing.

Logs (PROD): _INFO [2024-06-03 07:55:12,502+0000] [main] au.org.ala.pipelines.beam.ALAUUIDMintingPipeline: newUuids: 174.0, preservedUuids: 7401.0, orphanedUniqueKeys: 108.0 INFO [2024-06-03 07:55:12,503+0000] [main] au.org.ala.pipelines.beam.ALAUUIDMintingPipeline: Percentage UUID change: 2, allowed percentage: 50, override percentage check: false INFO [2024-06-03 07:55:12,503+0000] [main] au.org.ala.pipelines.beam.ALAUUIDMintingPipeline: Backing up existing UUIDs to /data/pipelines-data/dr8128/1/identifiers/ala_uuid_backup1717401312503 INFO [2024-06-03 07:55:12,503+0000] [main] au.org.ala.pipelines.beam.ALAUUIDMintingPipeline: Pipeline complete.

Useful Links: Databox: https://collections-test.ala.org.au/public/show/dr8128 Prod: https://collections.ala.org.au/public/show/dr8128

Count: 7,401 Records + 174 records = 7,575 records

Status: Waiting for indexing

[cha801p]

7,526 records returned of 7,575 for Data resource: Australian Platypus Conservancy
Data Successfully ingested