City-Bureau / city-scrapers-cle

City Scrapers project for Cleveland
https://cityscrapers.org/
MIT License
15 stars 14 forks source link

How to scrape/create meetings that just list '3rd wednesday of the month'? (Veterans Service Commission) #5

Open skorasaurus opened 4 years ago

skorasaurus commented 4 years ago

I noticed that the County Veterans Service Commission's Board board does not list any HTML elements of upcoming meetings; just that they will be held (without listing the dates).

How should these meetings be created to show up in the calendar since there's nothing to exactly scrape?

They do have a calendar but no meetings are listed there.

pjsier commented 4 years ago

I didn't do it here because I wanted to be cautious, but we have done scrapers like this before chi_school_community_action_council is one example.

The risk here is that if they aren't updating the calendar it's hard to say whether they'll update the general time ranges if they ever change. Up to you all what you think the best way of handling that is! One option is to only include meetings a few weeks ahead

skorasaurus commented 2 years ago

Worth mentioning that how to scrape meetings that are on a relative date (e.g. 3rd Wednesday of a month) was done in https://github.com/City-Bureau/city-scrapers-cle/pull/34 ; keeping this issue open because it was not implemented for the VSC.