it keeps checking my proxy servers Dead or not than actually doing its job of scraping data

TeamHG-Memex / scrapy-rotating-proxies

use multiple proxies with Scrapy

MIT License

741 stars 160 forks source link

it keeps checking my proxy servers Dead or not than actually doing its job of scraping data #66

Open vijaykurhade opened 2 years ago

vijaykurhade commented 2 years ago

Followed instructions on usage page and tried my scrapy crawler. it keeps checking my proxy servers Dead or not than actually doing its job of scraping data

How do i fix it?

Marow commented 2 years ago

Same here. Sometimes take few seconds for checking... can that be disabled somewhere?