I am new to scrapy, I have a very large data set wanna scrape so that I need to using multiple thread like spider to do the crawling so that scrapy seems can achieve this target. Besides, I though if the proxy IP is belong to TOR's IP would be better to protect my operation.
So my question is can I using scrapy-proxy-pool with TOR?
I am new to scrapy, I have a very large data set wanna scrape so that I need to using multiple thread like spider to do the crawling so that scrapy seems can achieve this target. Besides, I though if the proxy IP is belong to TOR's IP would be better to protect my operation. So my question is can I using scrapy-proxy-pool with TOR?