City-Bureau / city-scrapers

Scrape, standardize and share public meetings from local government websites
https://cityscrapers.org
MIT License
332 stars 310 forks source link

#675 Spider: Illinois International Port District #931

Closed radoslawkrolikowski closed 4 years ago

radoslawkrolikowski commented 4 years ago

This pull request adds the Illinois International Port District Spider, the test file of that spider and target web pages as HTML files.

Spider reads the following meeting details from the http://www.iipd.com/calendar/schedules page:

In Agendas tab (http://www.iipd.com/calendar/agendas), we have got the following files that are scraped:

Board Minutes tab (http://www.iipd.com/about/board-meeting-minutes) contains the Minutes files of meetings that happened in the years 2019 - 2012. All the files are scraped, then corresponding files are added as links to the all meetings listed in the schedule (year 2019).

In test file, while testing the parsed links, the spider returns links as the https urls, but for unkown reasons test files sees them as http, thus target links in assert function were written as http urls.