search

adamreichold / umwelt-info

umwelt.info metadata index
https://umwelt.info
GNU Affero General Public License v3.0
1 stars 0 forks source link

Add GeoNetwork harvester based on the Q Search API endpoint. #29

Closed adamreichold closed 2 years ago

adamreichold commented 2 years ago

This seems nicer than the CSW endpoint provided by GeoNetwork as it returns the full metadata immediately, but it does not seem to be significantly faster based on small tests.

Closes #7

adamreichold commented 2 years ago

This should also be used in the harvester configuration under version control.

adamreichold commented 2 years ago

A first test showed that improves thing significantly: Harvesting all of geodatenkatalog.de took a bit over 2 hours instead of almost 11.

adamreichold commented 2 years ago

Should make use of the with_retry helper introduced in #12 once that is merged.