search

rugantio / fbcrawl

A Facebook crawler
Apache License 2.0
661 stars 229 forks source link

DNSLookupError: DNS lookup failed: no results for hostname lookup: mbasic.facebook.com. #66

Open bigheiniu opened 4 years ago

bigheiniu commented 4 years ago

Hi there, When I test the command like:

scrapy crawl fb -a email="" -a password="" \
-a page=https://mbasic.facebook.com/story.php?story_fbid=10165072531765725&id=153080620724 \
-a lang=en -o Trump.csv

I get error like:

2020-07-12 12:11:16 [scrapy.core.scraper] ERROR: Error downloading <GET https://mbasic.facebook.com>
Traceback (most recent call last):
  File "/home/yichuan/anaconda3/envs/crawl/lib/python3.6/site-packages/twisted/internet/defer.py", line 1416, in _inlineCallbacks
    result = result.throwExceptionIntoGenerator(g)
  File "/home/yichuan/anaconda3/envs/crawl/lib/python3.6/site-packages/twisted/python/failure.py", line 512, in throwExceptionIntoGenerator
    return g.throw(self.type, self.value, self.tb)
  File "/home/yichuan/anaconda3/envs/crawl/lib/python3.6/site-packages/scrapy/core/downloader/middleware.py", line 43, in process_request
    defer.returnValue((yield download_func(request=request,spider=spider)))
  File "/home/yichuan/anaconda3/envs/crawl/lib/python3.6/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks
    current.result = callback(current.result, *args, **kw)
  File "/home/yichuan/anaconda3/envs/crawl/lib/python3.6/site-packages/twisted/internet/endpoints.py", line 982, in startConnectionAttempts
    "no results for hostname lookup: {}".format(self._hostStr)
twisted.internet.error.DNSLookupError: DNS lookup failed: no results for hostname lookup: mbasic.facebook.com.

I have tested the command yesterday, everything was fine. However, when I run the code today, there is DNS lookup failed error. Does anyone meet the same problem?