search

steingod / mdharvest

Metadata harvesting
GNU General Public License v2.0
2 stars 3 forks source link

Add GEONOR filter #30

Open ferrighi opened 2 months ago

ferrighi commented 2 months ago

In order to provide data to genorge we need to feed the dedicated endpoint which is based on METNCS and GEONOR collections. GEONOR collection should be added to the filtering process.

ferrighi commented 2 months ago

It is a bit difficult to find a test for the GEONOR collection. So far it would be more based on data producers endpoints. The current filtering is also done using the configuration file, which does not include direct traverse of thredds catalogues. I would suggest to add specific cases into travers_thredds instead of using the filter_mmd_records.py for now like e.g.:

        if 'thredds.***.no' in ds.url:
            mynodegeonor = ET.Element("{http://www.met.no/schema/mmd}collection")
            mynodegeonor.text = 'GEONOR'
            mynodeadc.addnext(mynodegeonor)

or alternatively we could just run the add_collection scrip on the specific folders as a separate job.