Freshdesk: #195848 BDBSA Fauna data load - extract FrogWatch records

AtlasOfLivingAustralia / data-management

Data management issue tracking

7 stars 0 forks source link

Freshdesk: #195848 BDBSA Fauna data load - extract FrogWatch records #1042

Closed peggynewman closed 2 weeks ago

peggynewman commented 3 months ago

Frogwatch SA - https://collections.ala.org.au/public/showDataResource/dr10043

This dataset will now be delivered via BDBSA. Next time the SA Flora/Fauna data load happens, in about 3 months, extract the Frogwatch SA data from the Fauna file and load it into its own data resource.

The SA load is in a fetcher I believe.

rosemaryjoconnor commented 3 months ago

27/03/2024

Freshdesk: https://support.ehelp.edu.au/a/tickets/195848

BDBSA Fetcher currently caters for multiple drs - dr365/dr366. Adding Frogwatch dr10043 will be easy to do here. Need information re Frogwatch data file upload.

Currently we receive 2 files from BDSA:

dewnr-sa/saflora-all_.csv
dewnr-sa/saflora-all_,data.csv

Need to know the name of the new file for Frogwatch and if it will be in the same format as saflora/safauna

To do:

[x] Verify filter value to use
[ ] Add dr10043 extract logic to config and fetcher

rosemaryjoconnor commented 2 months ago

08/04/2024 Emailed Lilian for information re Frogwatch files/data

Response The FrogWatch SA data will come within the safauna-all.csv file as it will be stored in our database. You will be able to delineate the data where SURVEYNAME = ‘FROGWATCH SA’ (which matches in ALA to eventID). Or, if we happen to include it in our extract, where SURVEYNR = 1008.

rosemaryjoconnor commented 2 weeks ago

Duplicate issue - refer to: https://github.com/AtlasOfLivingAustralia/data-management/issues/1055