patkyn
commented
4 years ago Before loading there are 322 records
During load, there were 360 new records.
aws-bstore-4b 2020-08-10 16:18:54,816 INFO : [DataLoader] - Loading: https://www.facebook.com/photo.php?fbid=10159428340218438&set=gm.1035053073501815&type=3&theater&ifg=1
aws-bstore-4b 2020-08-10 16:18:54,830 INFO : [RemoteMediaStore] - Remote media store host not recognised: https://www.facebook.com/photo.php?fbid=10159428340218438&set=gm.1035053073501815&type=3&theater&ifg=1 for uuid=b0b4f421-71ee-4e7a-94ab-16c944c343db
aws-bstore-4b 2020-08-10 16:18:55,231 WARN : [RemoteMediaStore] - Unable to persist image from URL. Response code 400. Image service response body: {"success":false,"message":"Unable to retrieve image from https://www.facebook.com/photo.php?fbid=10159428340218438&set=gm.1035053073501815&type=3&theater&ifg=1"}
aws-bstore-4b 2020-08-10 16:18:55,232 WARN : [DataLoader] - Unable to save file: https://www.facebook.com/photo.php?fbid=10159428340218438&set=gm.1035053073501815&type=3&theater&ifg=1
aws-bstore-4b 2020-08-10 16:18:55,545 INFO : [DataLoader] - There are 660 records in the file. The number of NEW records: 326
aws-bstore-4b 2020-08-10 16:18:55,545 INFO : [DataLoader] - Load finished for dr10631.csv
After loaded, there were 348 records
See issues in support queue: https://support.ehelp.edu.au/a/tickets/76129 (butterfly) https://support.ehelp.edu.au/a/tickets/76122 (amphibian and reptile data ) Data Resource: https://collections.ala.org.au/dataResource/show/dr10631
[x] After creation, add this issue to the Data Management project board https://github.com/orgs/AtlasOfLivingAustralia/projects/9
[x] Map dataset to Darwin Core Terms if necessary http://rs.tdwg.org/dwc/terms/
[x] Upload the dataset to collections.ala.org.au
[x] Load/sample/process dataset http://aws-scjenkins.ala:9193/job/Parameterised%20Load%20Sample%20Process/
[x] Note the statistics for total and new records from the end of the log file for the load by pasting the relevant lines here:
[x] Wait for next complete reindex
[x] Check that the number of records accessible match the loaded numbers using https://biocache.ala.org.au/occurrence/search?q=data_resource_uid:drNNN
[x] Ask the data provider to review the new records using the same URL