BioCollect harvest enhancement

[sat01a]

Hi @pbrenton & @sbearcsiro, (cc: @patkyn )

As discussed today, creating this ticket to capture the requirements for data harvest.

• [ ] Mismatch of project and harvest record count: Project URL = https://biocollect.ala.org.au/acsa/project/index/fb9b9ca3-79d0-4bf8-b58d-08bdeb770f5d Webservice = https://ecodata.ala.org.au/ws/record/listRecordsForDataResourceId?id=dr9095&max=100&offset=0&sort=asc&status=active&lastUpdated=

• [ ] image_identifier includes null id

• [ ] Keep all BioCollect projects under one Data Provider (Data Provider - 3903)

• [ ] Investigate best approach for including - "Image darwin core attrirbutes"

• [ ] TODO

[patkyn]

As a reference issues found in images for dr364 OzAtlas https://github.com/AtlasOfLivingAustralia/data-management/issues/732

Legacy urls cannot be synced up in pipelines https://github.com/AtlasOfLivingAustralia/biocollect/issues/1343

Missing scientificNames for dr10638 https://github.com/AtlasOfLivingAustralia/biocollect/issues/1339

data resource and data provider cleanup list: https://github.com/AtlasOfLivingAustralia/biocollect/issues/1344

[patkyn]

Legacy urls cannot be synced up in pipelines #1343 - fixed.

Pending changes is the alternate_filename changes for pipelines which affects about ~5k images for ALA species sightings and OzAtlas dr364 in AtlasOfLivingAustralia/data-management#732