scrapy crawl fb -a email="" -a password="" \
-a page=https://mbasic.facebook.com/story.php?story_fbid=10165072531765725&id=153080620724 \
-a lang=en -o Trump.csv
I get error like:
2020-07-12 12:11:16 [scrapy.core.scraper] ERROR: Error downloading <GET https://mbasic.facebook.com>
Traceback (most recent call last):
File "/home/yichuan/anaconda3/envs/crawl/lib/python3.6/site-packages/twisted/internet/defer.py", line 1416, in _inlineCallbacks
result = result.throwExceptionIntoGenerator(g)
File "/home/yichuan/anaconda3/envs/crawl/lib/python3.6/site-packages/twisted/python/failure.py", line 512, in throwExceptionIntoGenerator
return g.throw(self.type, self.value, self.tb)
File "/home/yichuan/anaconda3/envs/crawl/lib/python3.6/site-packages/scrapy/core/downloader/middleware.py", line 43, in process_request
defer.returnValue((yield download_func(request=request,spider=spider)))
File "/home/yichuan/anaconda3/envs/crawl/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks
current.result = callback(current.result, *args, **kw)
File "/home/yichuan/anaconda3/envs/crawl/lib/python3.6/site-packages/twisted/internet/endpoints.py", line 982, in startConnectionAttempts
"no results for hostname lookup: {}".format(self._hostStr)
twisted.internet.error.DNSLookupError: DNS lookup failed: no results for hostname lookup: mbasic.facebook.com.
I have tested the command yesterday, everything was fine. However, when I run the code today, there is DNS lookup failed error.
Does anyone meet the same problem?
Hi there, When I test the command like:
I get error like:
I have tested the command yesterday, everything was fine. However, when I run the code today, there is DNS lookup failed error. Does anyone meet the same problem?