search

rejoiceinhope / scrapy-proxy-pool

164 stars 33 forks source link

How do i use my own proxies list? #1

Open amitupreti opened 5 years ago

amitupreti commented 5 years ago

I cannot find anything in the docs to use my own proxy. I have an api that returns me bunch of proxies.

Barbait commented 5 years ago

I'm interested as well, please let us know.

amitupreti commented 5 years ago

I'm interested as well, please let us know. I tried this one and it is very easy to use and well documented.

https://github.com/aivarsk/scrapy-proxies

mddarmawan commented 3 years ago

Is this self-promoting or what?

I'm interested as well, please let us know. I tried this one and it is very easy to use and well documented.

https://github.com/aivarsk/scrapy-proxies

vijaykurhade commented 2 years ago

Does it work? i am too frustrated on how to set scrapy to use proxies.txt file with uid/pwd:proxy:port

some how it does not work for me. used rotating-rpoxies-pool that library instead of doing job of scraping only keeps checking Health of my proxies from list.