resources: fix performance of serializers for OAI-PMH/search results

inveniosoftware / invenio-rdm-records

DataCite-based data model for InvenioRDM flavour.

https://invenio-rdm-records.readthedocs.io

MIT License

15 stars 81 forks source link

resources: fix performance of serializers for OAI-PMH/search results #1716

Closed lnielsen closed 2 months ago

lnielsen commented 3 months ago

Adds is_verified to mappings due to update in Invenio-Communities.
Rely on index data for licenses, subjects, communities, affiliations, and licenses instead of querying.
Fixes datacite, dcat, csl, dublin core, marcxml and schema.org serializer performance (reduced from ~500 queries in an OAI-PMH page down to 5).
INCOMPATIBLE: Needs update of search mappings and reindexing of records.

Integrates #1712 and #1717

Closes https://github.com/inveniosoftware/invenio-rdm-records/issues/1069.

alejandromumo commented 2 months ago

For reviewers: I disentangled the usage of full_record for the serializers tests. This introduced a lot of changes (in number), the relevant changes for this PR amount to:

git diff --shortstat 0b665106a0a8945afc39b9de0cdb48d51ebf22cc f00efbe845966e1e6c739ae5edfd17740d6f6ea4 16bd031cf662c8ce26621c39e03d28c84b4047e6 0f7e8a6916dab2b2af3f70e38c163c08ed12874c  603e64de729168a4cecae85621d5f16d4b050ef5 8dfa7a52f79b32546e62291c886b2cfdacf80ed6 952747cb83dd447141f6dcfc1c1aebf8f00949ff

 11 files changed, 65 insertions(+), 239 deletions(-)

slint commented 2 months ago

Merging, since only Python 3.9 failed because of not picking up invenio-communities v13.0.0 (but other build did and passed)