Data load : Australian Platypus Conservancy Sep-Nov 2019

[peggynewman]

• [x] After creation, add this issue to the Data Management project board https://github.com/orgs/AtlasOfLivingAustralia/projects/9

• [x] Map dataset to Darwin Core Terms if necessary http://rs.tdwg.org/dwc/terms/

• [x] Upload the dataset to collections.ala.org.au

• [x] Load/sample/process dataset http://aws-scjenkins.ala:9193/job/Parameterised%20Load%20Sample%20Process/

• [x] Note the statistics for total and new records from the end of the log file for the load by pasting the relevant lines here:

  aws-bstore-4b 2019-12-17 15:19:55,751 INFO : [DataLoader] - Unique terms: catalogNumber
  aws-bstore-4b 2019-12-17 15:19:55,751 INFO : [DataLoader] - Column headers: catalogNumber,basisOfRecord,recordedBy,scientificName,vernacularName,identificationQualifier,eventDate,stateProvince,locality,decimalLatitude,decimalLongitude,coordinateUncertaintyInMeters,individualCount,associatedMedia,occurrenceRemarks
  aws-bstore-4b 2019-12-17 15:19:56,174 WARN : [DataLoader] - Skipping line: 91, missing unique term value. Number skipped: 1
  aws-bstore-4b 2019-12-17 15:19:56,175 INFO : [DataLoader] - Unique term: catalogNumber : 
  aws-bstore-4b 2019-12-17 15:19:56,267 INFO : [DataLoader] - There are 123 records in the file. The number of NEW records: 118

• [x] Wait for next complete reindex

• [x] Check that the number of records accessible match the loaded numbers using https://biocache.ala.org.au/occurrence/search?q=data_resource_uid:dr8128

• [ ] Ask the data provider to review the new records using the same URL

[ansell]

There are 1,157 records for dr8128 currently in biocache:

https://biocache.ala.org.au/occurrences/search?q=data_resource_uid:dr8128

Was likely a partial load so record counts can't be used for QA in this case.