Open ErSauravAdhikari opened 1 month ago
Can we make it so that instead of crashing down, we use a different account for same request
What might have happened was in a pool of accounts, each account is linked to a proxy and some proxies may end up not working (temporarily).
It will work at a later date, we can ignore this account for a while, and try with different account.
I can add the retry mechanism client side, but I won't have access to which account was being used.
If I did then I could have a retry logic to change the proxy by assigning a failover proxy for this.
Have been receiving HTTPX connection error consistently while trying to scrape for long timeline.