Open sporetec opened 2 years ago
Thanks for submitting a PR @sporetec! Just a heads up, it may be a week or two until I can take a good look at it.
Hey @sporetec - haven't forgotten about this! Hoping to dig into the PR soon.
@sporetec - Would it be possible to tackle this feature first?
"Rotate through all given proxies before letting yagoogle handle the 429 to reduce execution time"
To be clear, you don't want the script to automatically go to sleep if an HTTP 429 is detected, especially if there are other proxies that can be tried?
As it is currently written, since yagooglesearch_manages_http_429s
is not set during the instantiation of a yagooglesearch.SearchClient
object (like is done here https://github.com/opsdisk/pagodo/blob/master/pagodo.py#L200), it defaults to True
https://github.com/opsdisk/yagooglesearch/blob/master/yagooglesearch/__init__.py#L82
would be good to get this into master
This rework lets pagodo: