search

reanalytics-databoutique / advanced-scrapy-proxies

Scrapy rotation proxy package with advanced functions
GNU General Public License v2.0
92 stars 3 forks source link

No module named 'advanced_scrapy_proxies' #1

Closed Marow closed 2 years ago

Marow commented 2 years ago

I get that error:

builtins.ModuleNotFoundError: No module named 'advanced_scrapy_proxies'

And yes, i installed with pip install advanced_scrapy_proxies

With scrapy_proxies it works, but not with your advanced version. I get everytime error, whe start running the scrapy crawl. Can you check please? I think there must be something wrong...

Requirement already satisfied: advanced_scrapy_proxies in /usr/local/lib/python3.8/dist-packages (0.1.2) when i type in pip install again

pigivinci commented 2 years ago

There was a typo in the readme. The correct configuration is:

DOWNLOADER_MIDDLEWARES = { 'scrapy.downloadermiddlewares.retry.RetryMiddleware': 90, 'advanced-scrapy-proxies.RandomProxy': 100, 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware': 110 }