search

tattle-made / factchecking-sites-scraper

A repo to store helper functions for scraping + experiments/visualisations
GNU General Public License v3.0
2 stars 7 forks source link

Convert the scraper(s) to a python library #35

Open tarunima opened 2 years ago

tarunima commented 2 years ago

The scrapers should be converted to a python library so that someone maybe able to run the scraper locally. The fact checking sites name can be passed as a parameter with an additional parameter to scrape all sites. Another parameter would be the number of pages to scrape.

dennyabrain commented 2 years ago

An inspiration project - https://newspaper.readthedocs.io/en/latest/