Data load : NT Flora and Fauna

[peggynewman]

• [x] After creation, add this issue to the Data Management project board https://github.com/orgs/AtlasOfLivingAustralia/projects/9

Files on the FTP server: /upload/ftp-nt

File	Data Resource
DENRFaunadata_2020.csv	https://collections.ala.org.au/public/show/dr362
DENRFloradata_2020.csv	https://collections.ala.org.au/public/show/dr361

• [x] Map dataset to Darwin Core Terms if necessary http://rs.tdwg.org/dwc/terms/
• [x] Upload the dataset to collections.ala.org.au
• [x] Load/sample/process dataset http://aws-scjenkins.ala:9193/job/Parameterised%20Load%20Sample%20Process/
• [x] Note the statistics for total and new records from the end of the log file for the load by pasting the relevant lines here:

  [Log entries..... ]

• [x] Wait for next complete reindex
• [ ] Check that the number of records accessible match the loaded numbers using https://biocache.ala.org.au/occurrence/search?q=data_resource_uid:drNNN
• [ ] Ask the data provider to review the new records using the same URL

[patkyn]

dr362 aws-bstore-4b 2020-08-26 13:11:19,861 INFO : [DataLoader] - There are 949701 records in the file. The number of NEW records: 132667 aws-bstore-4b 2020-08-26 13:11:19,861 INFO : [DataLoader] - Load finished for dr362.csv

[patkyn]

aws-bstore-4b 2020-08-26 14:09:17,621 INFO : [DataLoader] - There are 1026021 records in the file. The number of NEW records: 62739 aws-bstore-4b 2020-08-26 14:09:17,621 INFO : [DataLoader] - Load finished for dr361.csv