twagoo
commented
2 months ago Findings from a quick experiment:
- Harvesting "both" endpoints separately works if we define them explicitly as providers in the harvester configuration with separate names and a list of sets to include (there is no way to exclude). One of the endpoint URLs gets an extra forward slash after the domain.
- We could leave CLARINO (with sets) in the centre registry and only define FIN-CLARIN as an 'external' endpoint
- This approach will lead to no mapping to national project for FIN-CLARIN
- Menzo will include a change in the harvester that will allow overriding of the name of an endpoint (used to name the directory) defined in the centre registry. This will give us the exact solution that we want – we can define both endpoint variants separately in the centre registry. The only requirement for this solution is that we have a finite list of sets to harvest for both variants.
A metadata issue has been identified by Martin Matthiesen on 2024-08-24:
Desciption of the issue:
TL;DR: FIN-CLARIN metadata is listed with "CLARINO" as national project.
Martin reports:
Suggested solution [optional]:
Harvest CLARINO twice as two separate providers with different sets specified. There may be several caveats.
Before doing so we should check if there is an existing mechanism in the VLO to set (override) the national project based on other properties such as collection display name.