DaanVanVugt / Taxila

Training e-Support Service using Ruby on Rails.
Other
0 stars 0 forks source link

UvA scrapers #59

Closed DaanVanVugt closed 2 years ago

DaanVanVugt commented 2 years ago

They use Hippo CMS (bloomreach now?)

pages:

more events in dutch (perhaps scrape in english first, and then the missing ones in dutch?)

There is a JSON response used to build the page, should be easy to scrape:

https://www.uva.nl/_restapi/list-json?uuid=2595b5f0-2acc-4f61-aa2d-d590dd570e22&mount=d3db457c-cd07-4868-8fa8-b7310b6ea3ac

Though I am not sure how long the uuid and mount will remain available. We may have to pull that one from the webpage.

For a first version it was agreed there is no immediate need to go to the event page to get detailed info (though if we can do it easily we can do it)

DaanVanVugt commented 2 years ago

Fixed!