search

mattes / rotating-proxy

Rotating TOR proxy with Docker
The Unlicense
1.14k stars 257 forks source link

Scrapy #43

Closed Pechimuthu77 closed 3 years ago

Pechimuthu77 commented 3 years ago

How can I use it with Scrapy, Any sample code pls

mattes commented 3 years ago

https://docs.scrapy.org/en/latest/faq.html#does-scrapy-work-with-http-proxies

jacobdanovitch commented 3 years ago

scrapy.Request(url, meta={'proxy': '127.0.0.1:5566'}, ...)

Works perfectly