search

reanalytics-databoutique / advanced-scrapy-proxies

Scrapy rotation proxy package with advanced functions
GNU General Public License v2.0
92 stars 3 forks source link

Ban protection? #3

Open Marow opened 1 year ago

Marow commented 1 year ago

When i run it and i get an 429 ban, than i also have 1000 proxies left as before.

So they are not going left, when they get 429? Did you have banprotection or something? :)

Marow commented 1 year ago

and the proxy_mode 0 doenst work like for every request... it only changes for me, when getting 429, but not before...

Its more like, running until i get 429 banned