Closed esagara closed 11 months ago
They also have archived notices, but only going back to 2018. here
Should we scrape these as well?
I tried scraping the new data portal, but the the url request returns an intermediate page with a button to "skip to content". I don't think that's the main problem, however. When loading the page in browser, the table takes a few seconds to load, so I'm guessing its not getting scraped either. Is there any way to solve this?
I have been trying to scrape the GA new website with Selenium and it kinda was working, but was not able to fully gather all the data. But I also have a direct CSV file from the GA Rapid Response group with all the archived data.
https://www.dropbox.com/sh/05wzmaqhx8of5cj/AABjNnm6tuX_MQcK6Ow8XZYqa?dl=0
For the record, @Ash1R has a pull request here https://github.com/biglocalnews/warn-scraper/pull/530
Fixed with #530
Georgia has changed how it is handling WARN notices and now has a new data portal that does not appear to be working yet. We will need to monitor and create a new scraper to handle this.