search

City-Bureau / city-scrapers

Scrape, standardize and share public meetings from local government websites
https://cityscrapers.org
MIT License
329 stars 311 forks source link

Wrappers vs scrapers #222

Open easherma opened 6 years ago

easherma commented 6 years ago

I've noticed that some spiders are more API wrappers than traditional scrapers.

We should probably organize or tag these by type, and have some documentation about the differences, how you might decide to make a wrapper instead of a scraper, and a contrib guide for that alternative approach as well.

easherma commented 6 years ago

In addition to traditional scrapers and API wrappers, we have at least one instance of a spider (for ward nights) that reads in data from a csv (Google Sheet in this case): issue: https://github.com/City-Bureau/city-scrapers/issues/83 PR: https://github.com/City-Bureau/city-scrapers/pull/137