ec2u / data

EC2U Knowledge Hub
https://data.ec2u.eu
Apache License 2.0
2 stars 0 forks source link

Missing events for Turku University #43

Open hmaskat17 opened 1 year ago

hmaskat17 commented 1 year ago

The API is not returning any upcoming events for the University of Turku.

steps to reproduce

  1. Search for Turku University events https://data.ec2u.eu/events/?%7B%22university%22:%5B%22/universities/turku%22%5D,%22%3E=startDate%22:%222023-08-23T00:00:00Z%22%7D

expected behaviour

All upcoming Turku University events should be listed

actual behaviour

Only three upcoming events are listed with start dates above 2023-08-23

would you share any observation or additional context about the bug?

The Turku University site lists events https://www.utu.fi/fi/event-search that the API is not returning.

@knoan

knoan commented 1 year ago

The problem lies with the public event API at the University of Turku timing out when queried from the cloud deployed version of the script: after manually executing the pipeline from a development workstation the linked page now lists some 137 events; unfortunately API response took some 5 minutes, which exceeds the allotted execution time in the cloud environment.

Will review optimization options, but I don't see much leeway, unless we are able to access the complete documentation for the API and we can reduce the size of the response by filtering by creation/modification date.