scrapy with splash and rotating proxies

TeamHG-Memex / scrapy-rotating-proxies

use multiple proxies with Scrapy

MIT License

733 stars 156 forks source link

scrapy with splash and rotating proxies #55

Open mianwaqas94 opened 3 years ago

mianwaqas94 commented 3 years ago

Please guide me how to use scrapy-rotating-proxies with scrapy splash

iamumairayub commented 3 years ago

Hi, I just came up with this post and want to advice you that do not ever use Scrapy-Splash at all Its very buggy, and has worst support. I have 7 years of python/scraping experience and I recently used it, I am trying to help people by letting them know not to use I suggest you use Scrapy Selenium if you want headless browsing Use Selenium driver from your own server or create a Selenoid of DigitalOcean and use that remote driver Make your life easier