Currently, any error in a HTTP request will cause an exception that terminates the calling process. Barring exceptional circumstances, most of these errors can be resolved quickly by simply retrying the request.
Update the Scraper.get_html method such that it will retry failed HTTP requests a certain number of times before raising the exception.
Currently, any error in a HTTP request will cause an exception that terminates the calling process. Barring exceptional circumstances, most of these errors can be resolved quickly by simply retrying the request.
Update the Scraper.get_html method such that it will retry failed HTTP requests a certain number of times before raising the exception.