Open WuQLL opened 1 year ago
2023-05-07 23:35:36 [spiderman.model.standalone] ERROR: 爬虫执行失败：2023-05-07 23:35:36 [scrapy.utils.log] INFO: Scrapy 2.6.2 started (bot: SP) 2023-05-07 23:35:36 [scrapy.utils.log] INFO: Versions: lxml 4.9.1.0, libxml2 2.9.12, cssselect 1.1.0, parsel 1.6.0, w3lib 1.21.0, Twisted 22.10.0, Python 3.8.5 (default, Sep 3 2020, 21:29:08) [MSC v.1916 64 bit (AMD64)], pyOpenSSL 23.1.1 (OpenSSL 3.0.8 7 Feb 2023), cryptography 39.0.1, Platform Windows-10-10.0.19041-SP0 2023-05-07 23:35:36 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'SP', 'DUPEFILTER_CLASS': 'scrapy_redis.dupefilter.RFPDupeFilter', 'LOG_FILE': 'D:/GitHub/spiderman/SP_log/20230507/zhifang.log', 'LOG_LEVEL': 'INFO', 'NEWSPIDER_MODULE': 'SP.spiders', 'RETRY_HTTP_CODES': [500, 502, 503, 504, 522, 524, 408, 400, 403, 404], 'RETRY_TIMES': 3, 'SCHEDULER': 'scrapy_redis.scheduler.Scheduler', 'SPIDER_MODULES': ['SP.spiders'], 'USER_AGENT': 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, ' 'like Gecko) Chrome/62.0.3202.75 Safari/537.36'} Unhandled error in Deferred:
作者您好！请问运行demo的时候出现这种错误该如何解决？
2023-05-07 23:35:36 [spiderman.model.standalone] ERROR: 爬虫执行失败：2023-05-07 23:35:36 [scrapy.utils.log] INFO: Scrapy 2.6.2 started (bot: SP) 2023-05-07 23:35:36 [scrapy.utils.log] INFO: Versions: lxml 4.9.1.0, libxml2 2.9.12, cssselect 1.1.0, parsel 1.6.0, w3lib 1.21.0, Twisted 22.10.0, Python 3.8.5 (default, Sep 3 2020, 21:29:08) [MSC v.1916 64 bit (AMD64)], pyOpenSSL 23.1.1 (OpenSSL 3.0.8 7 Feb 2023), cryptography 39.0.1, Platform Windows-10-10.0.19041-SP0 2023-05-07 23:35:36 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'SP', 'DUPEFILTER_CLASS': 'scrapy_redis.dupefilter.RFPDupeFilter', 'LOG_FILE': 'D:/GitHub/spiderman/SP_log/20230507/zhifang.log', 'LOG_LEVEL': 'INFO', 'NEWSPIDER_MODULE': 'SP.spiders', 'RETRY_HTTP_CODES': [500, 502, 503, 504, 522, 524, 408, 400, 403, 404], 'RETRY_TIMES': 3, 'SCHEDULER': 'scrapy_redis.scheduler.Scheduler', 'SPIDER_MODULES': ['SP.spiders'], 'USER_AGENT': 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, ' 'like Gecko) Chrome/62.0.3202.75 Safari/537.36'} Unhandled error in Deferred:
作者您好！请问运行demo的时候出现这种错误该如何解决？