dr21957- Zoatrack

[rosemaryjoconnor]

Extract datasets from Zoatrak PGres DB Convert to event core for loading in ALA

[rosemaryjoconnor]

• DB connection and ssh tunnel all fine
• Running Doug's databox code successfully
• Occurrence data updating successfully
• Events not. Elastic search indexing failing as footprintWKT field is too long - limit is 32766 bytes. This field contains all the points in a track for a specific organism. For the cassowary dataset (Id 1) one track has over 4000 occurrence records, concatenating all the locations has caused the problem.
• Elastic Search Index config being investigted

[peggynewman]

This is with Peggy for review atm

[rosemaryjoconnor]

09/04/2024

• Mtg with SR from Ecocean who have been using ZoaTrack for many years for public outreach and are willing to support our data migration activities

[rosemaryjoconnor]

22/04/2024

• [x] New code in directory sourceCode in gitHub
• [x] Code to create DWCA from one or a list of projects from Zoatrack
• [x] Code to create a single DWCA from projects or one for each project
• [x] Initial test code to create new DR in collectory-test for a Project
• [x] Code to update DR in collectory-test with Project metadata

[rosemaryjoconnor]

02/05/2024

• [x] Create new DRs code finalised
• [x] Process datasets and create DWCAs code finalised
• [x] Created DRs in collectory for published and ECOCEAN datasets
• [x] Processed data, created DWCAs for published and ECOCEAN datasets (one done as a test. Waiting on licence clarification)
• [x] Preingest/Load databox for published datasets
• [ ] Solr Index databox for published datasets
• [ ] Preingest/Load databox for ECOCEAN datasets
• [ ] Solr Index databox for ECOCEAN datasets

Next Steps:

• [ ] Need further list of datasets/projects to process
• [ ] Still waiting on ECOCEAN re licensing - emailed SR on 29/04/2024