Sanpele / websitePlaying

Personal website little projects.
0 stars 0 forks source link

Scraping multiple days from one bulletin #20

Open Sanpele opened 2 years ago

Sanpele commented 2 years ago

During omicron when case numbers exploded the metric of choice for the provinces situation changed from case numbers to ICU beds. Similarly the daily covid bulletin was instead released only three-ish times a week. The weekend numbers would be reported on monday and other days totals were lumped together. Thus to gather a more complete picture multiple days should be scraped from one bulletin. This is harder to scrape however for a few reasons. The most important being that this approach was more inconsistent, making my simple static scraping an incomplete solution. To add this feature a more advanced form of scraping would be needed. One that could consistently recognize when multiple days of results are being reported and deceptively scrape and add those values with the correct dates assigned to the database.

Sanpele commented 2 years ago

Another factor is that as the pandemic evovled so did the bulletins. Avenue for future improvement.