TechAndCheck / tech-and-check-alerts

Daily tip sheet for fact checkers
MIT License
13 stars 6 forks source link

Add google spreadsheet scraper #284

Closed slifty closed 4 years ago

slifty commented 4 years ago

This creates the ability to scrape a google spreadsheet, this worker will be used in the queues created for #229 and #280 since google spreadsheets are the initial mechanism for updating things like twitter and priority speaker lists.

This creates a new dependency on a utility package called csv-parse (which I think is necessary because please do not make me write my own CSV parser.)

reefdog commented 4 years ago

It's too late for me to review this but let me just say that it's badass how easily the abstract scraper was able to be turned into a fully-working Google Sheet scraper. ❤