search

pgaref / HTTP_Request_Randomizer

Proxying Python Requests
http://pgaref.com/blog/python-proxy/
MIT License
148 stars 60 forks source link

question #69

Open kattstof opened 3 years ago

kattstof commented 3 years ago

anyway to speed up or set timeout for finding proxies so it doesn't hang for ~5 + minutes trying to find suitable proxy? ie, don't find suitable proxy in x amount of time, skip etc?

pgaref commented 3 years ago

Hey @kattstof -- if you are calling the generate_proxied_request there is a timeout argument you can use (default is 30s per request). From the command line -- you can pass the -t option to set timeout. Also -s option is useful as you might want to filter-out some proxy-providers.

kattstof commented 3 years ago

thanks! also setting log level doesn't seem to work for me, loglevel CRITICAL still shows DEBUG info etc, don;t know if bug or if theres something wrong with my setup so maybe that's worth looking into. but it doesn't bother me too much.