calpoly-csai / csai-scraping

Web scraping for Nimbus
4 stars 4 forks source link

Remove Firebase integration from scrapers #6

Closed austinsilveria closed 4 years ago

austinsilveria commented 4 years ago

Currently each scraper is integrated with FirebaseProxy to store its result in Firebase after the scrape is complete. We have now moved to a MySQL database which will be accessed through the Nimbus API.

Remove each scraper's integration with Firebase and instead have them return a CSV formatted string to be aggregated by the Sustainer.