ec2u / data

EC2U Knowledge Hub
https://data.ec2u.eu
Apache License 2.0
2 stars 0 forks source link

Missing events for Turku University #43

Open hmaskat17 opened 10 months ago

hmaskat17 commented 10 months ago

The API is not returning any upcoming events for the University of Turku.

steps to reproduce

  1. Search for Turku University events https://data.ec2u.eu/events/?%7B%22university%22:%5B%22/universities/turku%22%5D,%22%3E=startDate%22:%222023-08-23T00:00:00Z%22%7D

expected behaviour

All upcoming Turku University events should be listed

actual behaviour

Only three upcoming events are listed with start dates above 2023-08-23

would you share any observation or additional context about the bug?

The Turku University site lists events https://www.utu.fi/fi/event-search that the API is not returning.

@knoan

knoan commented 10 months ago

The problem lies with the public event API at the University of Turku timing out when queried from the cloud deployed version of the script: after manually executing the pipeline from a development workstation the linked page now lists some 137 events; unfortunately API response took some 5 minutes, which exceeds the allotted execution time in the cloud environment.

Will review optimization options, but I don't see much leeway, unless we are able to access the complete documentation for the API and we can reduce the size of the response by filtering by creation/modification date.