Errors during scraping are gracefully caught and not raised because we don't want the scraping failures to prevent the computation of points and rankings.
A side effect of this is that those scraping errors (if any) are not logged to Rollbar at all. Explicitly sending the scraping errors to Rollbar using rollbar.report_exc_info() needs to be done. Include the source code of the scraped page in the log.
Errors during scraping are gracefully caught and not raised because we don't want the scraping failures to prevent the computation of points and rankings.
A side effect of this is that those scraping errors (if any) are not logged to Rollbar at all. Explicitly sending the scraping errors to Rollbar using
rollbar.report_exc_info()needs to be done. Include the source code of the scraped page in the log.