AtlasOfLivingAustralia / biocache-store

Occurrence processing, indexing and batch processing
Other
7 stars 24 forks source link

Move GBIF specific requirements from DwCACreator into separate tool #202

Closed ansell closed 7 years ago

ansell commented 7 years ago

The DwCACreator appears to be a fairly generic exporter, but it has GBIF specific requirements built in. In particular, the set of fields is very limited, and does not include all Darwin Core Terms, and it substitutes the unstable ALA UUIDs into the file in place of the relatively more stable original occurrenceID/catalogNumber/etc. keys given by the ALA data providers.

The end goal of this is to have a generic tool that is able to create Darwin Core Archives to standardise the way we offer downloads to users. In particular, it needs to be able to export fields that are not in Darwin Core Terms, which is a case that is already well supported by the Darwin Core Archive spec.

ansell commented 7 years ago

The list of fields in DWCACreator is intentionally limited to unprocessed fields that GBIF are interested in, see #205, so the current functionality needs to be preserved while making the base generically reusable.