search

claffin / cloudproxy

Hide your scrapers IP behind the cloud. Provision proxy servers across different cloud providers to improve your scraping success.
https://cloudproxy.io/
MIT License
1.4k stars 80 forks source link

age_limit control flow bugfix #47

Closed henryzxu closed 3 years ago

henryzxu commented 3 years ago

If age_limit is specified for providers other than gcp, the control flow won't update ip_ready with alive proxies.

My proposed solution involves copying the logic from gcp_check_alive() where the age_limit > 0 check is combined with the elapsed check.

claffin commented 3 years ago

Looks good, thank you for your contribution. Will roll out in the next release when I do it but it will be in the latest image immediately.