bie species page performance

AtlasOfLivingAustralia / ala-bie-hub

BIE (Biodiversity Information Explorer) hub - merge of old ala-bie and bie-plugin

Mozilla Public License 2.0

1 stars 6 forks source link

Closed adam-collins closed 6 months ago

adam-collins commented 11 months ago

BIE pages can be slow because of the, up to, hundreds of collectory requests made by the data providers tab. https://bie.ala.org.au/species/https://id.biodiversity.org.au/taxon/apni/51382879#data-partners

Thoughts:

One request instead of hundreds of requests that take >500ms each, at least they do take that long today.
Fix the performance of that request. >500ms for a request like https://collections.ala.org.au/ws/dataResource/dr366

adam-collins commented 11 months ago

adam-collins commented 10 months ago

Identified issues for the collectory

DataHub - Use caching instead of querying the entire table for every request
ExternalIdentifier - Use one to many relationship for entities instead of the current “no relationship”. Change to eager fetch.
DataLink - Replace with entity relationships. Change to eager fetch. e.g. institution one to many data resources, collection one to many data resources, etc.
DataResource.dataProvider - change to eager fetch
DataResource.institution - change to eager fetch
Investigate these eager fetch implications with all documented (openapi) services

adam-collins commented 10 months ago

Moved eager fetching to specific documented services as it was slowing some admin pages.

adam-collins commented 10 months ago

adam-collins commented 10 months ago

More can be done to reduce the number of biocache-service requests in the future.