search

biglocalnews / civic-scraper

Tools for downloading agendas, minutes and other documents produced by local government
https://civic-scraper.readthedocs.io
Other
43 stars 14 forks source link

Examples of a Civic Clerk site with functional scrape? #192

Open mtdukes opened 1 week ago

mtdukes commented 1 week ago

I'm trying to scrape a Civic Clerk site here: https://www.twp.ferguson.pa.us/minutes-and-agendas-portal

Or here (which appears to be the full version): https://fergusontwppa.portal.civicclerk.com/

But neither seems to be the appropriate source for using the Civic Clerk version of the scraper. Are there any site examples you can share for this particular platform so I can make sure I'm pointing my scraper at the right place?

zstumgoren commented 1 week ago

Hi @mtdukes 👋 Our CivicClerk support is a bit long in the tooth. You can find sites that it was originally tested on in the test coverage for that platform. But fair warning, YMMV...

zstumgoren commented 1 week ago

@mtdukes Also, it appears that the 2nd link you sent -- the "full version" at https://fergusontwppa.portal.civicclerk.com/ -- matches the format of the first test site in our Civic Clerk test module.

It's possible that the Civic Clerk code is buggy if it doesn't work for the full version of Ferguson. If you want to send me an example of the code you're running, I can try to take a look.