The-Academic-Observatory / oaebu-workflows

Telescopes, Workflows and Data Services for the 'Book Analytics Dashboard Project (2022-2025)', building upon the project 'Developing a Pilot Data Trust for Open Access eBook Usage (2020-2022)'
https://documentation.book-analytics.org/
Apache License 2.0
5 stars 0 forks source link

Feature/bespoke data partners #231

Closed keegansmith21 closed 5 months ago

keegansmith21 commented 5 months ago

SHMP has a lot of historic partners that are implemented in a bespoke way.

This PR adds functionality to the oaebu_partners to be able to create a DataPartner object at runtime based on an input dictionary (or list of dictionaries). The intention here is to define all of the new data partners in the config.yml file and pass them to the ONIX WF this way, rather than have to hardcode a bunch of new partners into the code.

If this turns out to be a simpler way of passing partners, we may also consider doing with this the original data partners, which are currently hardcoded into the oaebu_partners.py file.