Getting State/Private Collection data

[fontikar]

• [x] Get a big list of data providers
• [x] Sort through data providers based on past experience
• [x] PB to share general workflow/email templates to data providers to A Team
• [x] Divide and conquer of reduced list of data providers to @JoshNitschke @Ashbyi and other IA volunteers?
• [ ] Request data begins
• [ ] Develop save data where protocol - nicely labelled folders with conventions etc in Google Drive

[payalbal]

State data repositories (as per NESP Project 8.3.1 by Jess Marsh & Payal Bal)

• South Australia BDBSA: bdbsa-data-request-procedure-fact.pdf (environment.sa.gov.au) - data charges quoted at $119
• NSW BioNet: NSW BioNet | NSW Environment, Energy and Science
• Queensland WildNet: WildNet database | Environment, land and water | Queensland Government (www.qld.gov.au)
• Victoria VBA: Victorian Biodiversity Atlas (environment.vic.gov.au)
• WA NatureMap: NatureMap (dbca.wa.gov.au) (this has now been taken offline)
• Tasmania BVD: Biodiversity Values Database | Forest Practices Authority (fpa.tas.gov.au) through https://www.naturalvaluesatlas.tas.gov.au/#HomePage
• ACT: Maps and data management - Environment, Planning and Sustainable Development Directorate - Environment (act.gov.au)
• NT: Environment data - NT.GOV.AU: https://nt.gov.au/environment/environment-data-maps/fauna-atlas
• ~ANIC: https://www.csiro.au/en/about/facilities-collections/collections/anic - data is too messy~

[payalbal]

Data request were through online forms of emails with the generic description of the project for which the data was sought. See example text below:

Data requested: Occurrence data on all invertebrates, terrestrial and freshwater, for Australia available within the database.

• Spatial definition: All of Australia, including off land islands and territories
• Taxonomic definition: All invertebrates (provide a list of relevant phyla if needed)

Project description: The data will be used in conjunction with ALA data and data obtained from states, museums and private data holders to build a database of ecological and life history traits for Australian invertebrate species. The work extends the assessment framework of Marsh et al 2021. Our aim is to provide a tool for robust assessment of fire impacts, to help identify most at-risk species from future fires and guide targeted management. This is an ARDC funded project and we are happy to provide further details on the projects if necessary.

[payalbal]

Processing of non ALA data is recorded in these scripts from the NESP project: https://github.com/payalbal/nesp_bugs/blob/master/scripts/nonala_processing.R

Note, that decisions/scripts will need to be updated based on updates structures of the data obtained from the providers.

[fontikar]

State data repositories (as per NESP Project 8.3.1 by Jess Marsh & Payal Bal)

• South Australia BDBSA: bdbsa-data-request-procedure-fact.pdf (environment.sa.gov.au) - data charges quoted at $119
• NSW BioNet: NSW BioNet | NSW Environment, Energy and Science
• Queensland WildNet: WildNet database | Environment, land and water | Queensland Government (www.qld.gov.au)
• Victoria VBA: Victorian Biodiversity Atlas (environment.vic.gov.au)
• WA NatureMap: NatureMap (dbca.wa.gov.au) (this has now been taken offline)
• Tasmania BVD: Biodiversity Values Database | Forest Practices Authority (fpa.tas.gov.au) through https://www.naturalvaluesatlas.tas.gov.au/#HomePage
• ACT: Maps and data management - Environment, Planning and Sustainable Development Directorate - Environment (act.gov.au)
• NT: Environment data - NT.GOV.AU: https://nt.gov.au/environment/environment-data-maps/fauna-atlas
• ANIC: https://www.csiro.au/en/about/facilities-collections/collections/anic - data is too messy

• [ ] Go through links and find the data request form/email/pathway through
• [ ] ANIC data is too messy, lets ditch
• [ ] Most will say its in ALA - good to check what data resource name they submit under
• [ ] Some may have no invert data for NESP but may have now
• [x] BDBSA needs a fee
• [ ] JM for museums (likely to have undigitised)
• [ ] Invert phyla

[fontikar]

Current Project Description for Hotspots:

Description:

76% of insect species are inadequately represented by protected areas and nearly 1900 species have no coverage at all. Knowledge of where invertebrate hotspots are will allow decision makers to prioritise conservation efforts to creating new and/or expanding existing protected areas to ensure the protection of Australia’s invertebrates. At Invertebrates Australia we are identifying invertebrate hotspots using a multifaceted approach. Combining phylogenetic knowledge, taxonomic reliability and spatial restrictiveness (short range endemism) of each Invertebrate order. We require state-held data to supplement citizen science data in our spatial analyses. Our ultimate goal is to map out the key areas of interest and inform decision-makers the key areas that require protection and prioritisation.

[fontikar]

https://collections.ala.org.au/public/showDataResource/dr836

[fontikar]

@JoshNitschke taking on SA for a start 🚀

[fontikar]

@Ashbyi taking on WA protocol 🚀

[JoshNitschke]

Emailed DEW (South Aus) (DEWBioDataRequests@sa.gov.au) who quoted $119 to extract all invert occurrence data for SA - fee is standard unless the project has direct links to the department. They provided a helpful summary of the data - it sounds like the stuff that isn't already on ala is pretty limited, except for maybe a decent butterfly dataset:

(as of 5/4/24)

28,654 invertebrate records

24,260 public records (available through ALA or NatureMaps) 2,305 restricted records that I can supply under a DLA (data license agreement) without seeking permission. 2,089 restricted records that can only be supplied with written permission from the data supplier.

Restricted records supplied under a DLA:

345 records from the BIOBLITZ EVENTS - DISCOVERY CIRCLE project, which is publicly available on ALA here 111 records from APRASIA AURITA SURVEYS - SE – only identified to SCORPIONES sp. or CHILOPODA sp. 2 records from WHYALLA C P FAUNA AND PLANTS – only identified to Beetle or insect 1790 records from STATUS ASSESSMENT OF BUTTERFLIES IN SA – these are likely the most valuable records to you. 46 records from REED REMOVAL TRIAL RIVER TORRENS – RBTFP – a mix of aquatic invertebrate records. 11 records from KI DUNNART (KI LAND FOR WILDLIFE) – only Identified to insect, centipede or scorpion sp.

Restricted records needing written permission:

85 records from NON-INSECT INVERTEBRATE FAUNA – KI, Jess Marsh (involved in Invertebrates Australia) is the information authority on these so it would be worth contacting her directly for the records as she likely has them in a richer format. 1970 records from SCIENTIFIC PERMIT DATA -NOT APPROVED, these come from many sources, so we won’t be able chase them up for permission. 20 records ST KILDA MANGROVE SURVEY – only identified to BIVALVIA sp., MALACOSTACA sp., GASTROPODA sp. 14 records MARNA BANGGARA SURVEYS – camera trap records only identified to LEPIDOPTERA sp.

Metadata for these projects (Capitalised text) in BDBSA can be found here https://apps.environment.sa.gov.au/emap/envmaps-query.do?cmd=su.SurveySummaryMain

Standard supertable fields they would provide: https://data.environment.sa.gov.au/Content/Publications/bdbsa-supertable-field-definitions-fact.pdf Also said they could add family and order for some species but not all.

[fontikar]

Before these enhancements are implemented, please continue to send requests for biodiversity data that you would have previously obtained via NatureMap to flora.data@dbca.wa.gov.au, using ‘NatureMap search request’ in the subject of your email. Please specify the requested search area (central coordinates/administrative boundary/attach a shapefile), search radius (km), chart datum (if relevant) and any other information relevant to the search.

@Ashbyi

[fontikar]

https://bio.wa.gov.au/dandjoos-api https://bio.wa.gov.au/download-centre