search

alecxe / scrapy-fake-useragent

Random User-Agent middleware based on fake-useragent
MIT License
687 stars 98 forks source link

Can't download urls #39

Closed CarterT27 closed 1 year ago

CarterT27 commented 1 year ago

When I try to use my spider, I am running into this error.

scrapy_fake_useragent/middleware.py", line 95, in process_exception if isinstance(exception, self.EXCEPTIONS_TO_RETRY) \ AttributeError: 'RetryUserAgentMiddleware' object has no attribute 'EXCEPTIONS_TO_RETRY'

CarterT27 commented 1 year ago

Changing self.EXCEPTIONS_TO_RETRY to self.exceptions_to_retry in scrapy_fake_useragent/middleware.py fixed the error I was having.