Bunsly / JobSpy

Jobs scraper library for LinkedIn, Indeed, Glassdoor & ZipRecruiter
https://usejobspy.com
MIT License
555 stars 109 forks source link

Allowed List of Proxies, instead of only one. #156

Closed fasihhussain00 closed 1 month ago

fasihhussain00 commented 1 month ago

I noticed that we only allowed one proxy at a time. It would be great if we could add multiple proxies to reduce the chances of getting hit with a 429 error while scraping.

I tried to implement this myself, but it seems tls_client doesn't support multiple proxies (at least from what I found).

If you could add support for multiple proxies, it would really help a lot. Thanks!