search

City-Bureau / city-scrapers

Scrape, standardize and share public meetings from local government websites
https://cityscrapers.org
MIT License
330 stars 310 forks source link

0807 spider il sex offender management #993

Closed cvafaian closed 3 years ago

cvafaian commented 3 years ago

Summary

Issue: #807

Checklist

All checks are run in GitHub Actions. You'll be able to see the results of the checks at the bottom of the pull request page after it's been opened, and you can click on any of the specific checks listed to see the output of each step and debug failures.

Questions

I was able to extract all meeting info except for the one under SOMB Meeting Agendas labeled "September 16, 2020 – WebEx Meeting". This agenda meeting link redirects to a government account protected meeting recording that I could not access. I have excluded that meeting for now, but please let me know if you would like me to implement it differently!

pjsier commented 3 years ago

Made a comment on #807, but I can take a look at this once we sort that out

cvafaian commented 3 years ago

I did a quick run of the program before pushing to make sure everything is in order, and it seems like the metadata for the WebEx video has since disappeared! While there is a proper response for the link, there is only an empty dictionary returned for where the metadata once was. I tried checking through the other information returned in the response to see if the metadata may have moved, but I wasn't able to find anything. I have pushed changes for the revisions suggested, but the current spider is no longer making a meeting for the latest WebEx meeting. How would you like me to proceed?

pjsier commented 3 years ago

Thanks for the updates! It was working before, so I think it's fine to leave the code as-is in case it's added back later