For reasons that are obscure, and which may not be existent, at some point we stopped using the scrapers class's own head method for getting the bill detail url, and instead used the methods from the requests library.
A consequence of this is that if there was an error when we made the head request, we wouldn't retry it. But, we would like to retry it. So we are reverting.
I've tested this locally a bunch of times, but was not able to trigger an error to retry.
For reasons that are obscure, and which may not be existent, at some point we stopped using the scrapers class's own
headmethod for getting the bill detail url, and instead used the methods from the requests library.A consequence of this is that if there was an error when we made the head request, we wouldn't retry it. But, we would like to retry it. So we are reverting.
I've tested this locally a bunch of times, but was not able to trigger an error to retry.