alan-turing-institute / misinformation-crawler

Web crawler to collect snapshots of articles to web archive
MIT License
5 stars 2 forks source link

Daily caller config needs updating #313

Closed edwardchalstrey1 closed 5 years ago

edwardchalstrey1 commented 5 years ago

This site has a politics start page and is paginated, so we should be able to get more relevant articles using an index crawl

In addition, there appears to have been a change in the site meaning we need to update the date and byline xpaths.