Vocabularies harvesting

inveniosoftware / product-rdm

InvenioRDM Product Roadmap

10 stars 0 forks source link

Vocabularies harvesting #187

Open lnielsen opened 7 months ago

lnielsen commented 7 months ago

Goals

Provide automated imports of specific vocabularies (ROR, ORCID, CORDIS, ...)
Improve indexing of authors, affiliations, grants, funders, and other …
Integrate with job system from #186

Resources

CERN has allocated two people to work on this for 4 weeks in May

lnielsen commented 4 months ago

Using the job system (#186), some jobs where build for harvesting RORs and grants, but the harvesters still needs improvements, and not all harvesters where implemented.

CERN will continue work on this task in Jul-Sep.

wgresshoff commented 4 months ago

A Job was built harvesting Subjects with the OAI-PMH-Harvester using the Job system. We had some issues with the Job UI (it's not possible to use Jinja templates which we need for the dates and System id, so currently scheduling is not possible) but otherwise the harvester worked. We will transfer our names harvester (which is currently a celery task) to the Job system as well.