2023-2024 Mobilisation - DAF QDPI Insects

[rosemaryjoconnor]

The Data Mobilisation activity proposed here will deliver approximately 27,000 validated specimen-based records for Australian-collected true fruit flies (Diptera: Tephritidae).

Consisting partly of existing in-house database records and new records produced from currently un-databased specimens, these constitute the entirety of the Australian-collected tephritid specimens held in the Queensland Primary Industries Insect Collection (QDPC).

The project will also deliver to the ALA photographs of paratype specimens representing 77 tephritid species.

[rosemaryjoconnor]

19/12/2023

• [x] No contact or updates to date
• [x] Follow up with JS

[rosemaryjoconnor]

08/01/2024

• [x] JS to follow up further

[rosemaryjoconnor]

11/01/2024

• [x] Still no updates and JS continuing to follow up

[rosemaryjoconnor]

14/02/2204 Meeting held.

• DAF are using EmU and the DWC extension.

• Sample dataset to be provided in next few weeks

• Possibility of additional species

• Images - only going to be about 77 images in total

• [x] Email support documentation

Next Meeting scheduled for 07/03/2024

[rosemaryjoconnor]

01/03/2024

• [x] DAF provided Test dataset - converted to CSV
• [x] Collectory - dr22432 created
• [x] Ran preingest locally - dwca created successfully
• [x] Databox Load
• [x] Data check

Next Meeting scheduled for 07/03/2024

[rosemaryjoconnor]

04/03/2024

• Databox data load with updated Institiuton/Collection codes successful. Provider Map working
• Responded to JB re occurrenceRemarks, typeStatus, Taxon names
• Sample data for images to be provided soon

[rosemaryjoconnor]

05/03/2024 JB response

• Sample image data should be available early April

• Images and data for testing by mid-April at least

• Metadata will come with test data

• [x] Contact early April

[rosemaryjoconnor]

07/03/2024 Meeting

• [x] Confirmed test data and metadata to be available early April
• [x] Only 70 images so will be manually uploaded to images service

[rosemaryjoconnor]

17/04/2024

• [x] 04/04/2024 - Email re: QDAF for an extension to end September
• [x] Test: dr22432
• [x] Extension of program granted

[rosemaryjoconnor]

29/07/2024

• Extension now until 30/12/2024

[rosemaryjoconnor]

18/09/2024

JB emailed.

"We’ve validated 22,944 records. So, with just over 4,000 records left to validate, we’re very much on track. . . . and, given our current validation rate of about 100 records / hour, I am expecting that, by the time I get back, we’ll be within a whisker of hitting the target of 27,000 records, if we haven’t already. So I will aim to send you some data for testing by October 11th."

[rosemaryjoconnor]

14/10/2024

Dataset with approx 23K records provided - this is not final.

A few things:

• Field/column names were not Darwin Core Terms
• Column 2 had no header at all - I set it to institutionCode as it was the field with only value being 'DAF'
• Institution code needs to be: 'QDPC'
• Trailing '-' characters in dates that a YYYY-MM only
• The 'from' and 'To' visit dates have been combined in to a single 'eventDate' field separated by a '/'

After combining the two tabs from the spreadsheets there were about 62 duplicate records - I've attached those for you.

Emailed JB with all information. Provided files with:

• DWC column mappings
• duplicates
• ALA metadata template

dr22342 successfully loaded in databox: https://collections-test.ala.org.au/public/show/co52

[rosemaryjoconnor]

06/11/2024 Ongoing discussion re images - may only have single access for image server for initial load JB to confirm JB indicated they should be able to:

• have rest of data (additional 4K records) within 10 days or so. Flagged to check on 15/11/2024
• provide images by end Dec

[rosemaryjoconnor]

15/11/2024

• JB email indicates further checks on final occurrence dataset required.
• JB away until approximately 21-15/11/2024. Will progress when back.

[rosemaryjoconnor]

17/11/2024

• Further checks on sensitive data required by DAF
• Occurrences dataset hopefully by end Nov