Unique keys for data loaded from Darwin Core Archives contain Scala artifacts

AtlasOfLivingAustralia / biocache-store

Occurrence processing, indexing and batch processing

Other

7 stars 24 forks source link

Closed ansell closed 5 years ago

ansell commented 5 years ago

The unique keys for data loaded using DwCALoader contain Scala artifacts which were not present in previous versions of biocache-store:

The form of "unique" keys created using DwCALoader is currently the following:

dr123|Some(A 12345)

Previously, "unique" keys had the following form:

dr123|A 12345

This is creating duplicate records for data resources that were loaded before the switch to biocache-store-2

ansell commented 5 years ago

The fix for this looks like it is working okay so far. Tracking the cleanup in issue 379