search

metno / discovery-metadata-catalog-ingestor

Apache License 2.0
1 stars 1 forks source link

Require MMD data access and storage fields #144

Closed mortenwh closed 1 year ago

mortenwh commented 1 year ago

Currently, Arome Arctic datasets are coming through dmci without any data access fields. We should make that and the storage field required.

magnarem commented 1 year ago

Some datasets use a THREDDS-url instead of lustre-filepath for the - element.

mortenwh commented 1 year ago

Both file path and opendap url should be provided. This will be handled in py-mmd-tools through https://github.com/metno/py-mmd-tools/issues/232 but we also need to check it in DMCI.

johtoblan commented 1 year ago

Needs to be set in mmd_strict

mortenwh commented 1 year ago

Also, we should probably check that the file and the opendap url exists. Is this possible for the file storage, when it is on lustre?

johtoblan commented 1 year ago

This can not be required due to metadata should be able to reference files that are removed. See discussion on the MMD-repo. We will implement a warning to the data-producer in py-mmd-tools if these fields are missing

mortenwh commented 1 year ago

See https://github.com/metno/py-mmd-tools/issues/253