john-hu / untitled

0 stars 0 forks source link

handle response is not html error #95

Closed john-hu closed 2 years ago

john-hu commented 2 years ago
  File "/home/pi/git/untitled/env/lib/python3.7/site-packages/scrapy/utils/python.py", line 353, in __next__
    return next(self.data)
  File "/home/pi/git/untitled/env/lib/python3.7/site-packages/scrapy/utils/python.py", line 353, in __next__
    return next(self.data)
  File "/home/pi/git/untitled/env/lib/python3.7/site-packages/scrapy/core/spidermw.py", line 56, in _evaluate_iterable
    for r in iterable:
  File "/home/pi/git/untitled/env/lib/python3.7/site-packages/scrapy/spidermiddlewares/offsite.py", line 29, in process_spider_output
    for x in result:
  File "/home/pi/git/untitled/env/lib/python3.7/site-packages/scrapy/core/spidermw.py", line 56, in _evaluate_iterable
    for r in iterable:
  File "/home/pi/git/untitled/env/lib/python3.7/site-packages/scrapy/spidermiddlewares/referer.py", line 342, in <genexpr>
    return (_set_referer(r) for r in result or ())
  File "/home/pi/git/untitled/env/lib/python3.7/site-packages/scrapy/core/spidermw.py", line 56, in _evaluate_iterable
    for r in iterable:
  File "/home/pi/git/untitled/env/lib/python3.7/site-packages/scrapy/spidermiddlewares/urllength.py", line 40, in <genexpr>
    return (r for r in result or () if _filter(r))
  File "/home/pi/git/untitled/env/lib/python3.7/site-packages/scrapy/core/spidermw.py", line 56, in _evaluate_iterable
    for r in iterable:
  File "/home/pi/git/untitled/env/lib/python3.7/site-packages/scrapy/spidermiddlewares/depth.py", line 58, in <genexpr>
    return (r for r in result or () if _filter(r))
  File "/home/pi/git/untitled/env/lib/python3.7/site-packages/scrapy/core/spidermw.py", line 56, in _evaluate_iterable
    for r in iterable:
  File "/home/pi/git/untitled/peeler/scrapy_utils/spiders/generator_base.py", line 65, in parse
    raise ex
  File "/home/pi/git/untitled/peeler/scrapy_utils/spiders/generator_base.py", line 35, in parse
    for item in self.yield_results(response):
  File "/home/pi/git/untitled/peeler/general/spiders/general_result.py", line 74, in yield_results
    recipe_language = self.parse_html_language(response)
  File "/home/pi/git/untitled/peeler/scrapy_utils/spiders/base.py", line 32, in parse_html_language
    html = response.css('html')
  File "/home/pi/git/untitled/env/lib/python3.7/site-packages/scrapy/http/response/__init__.py", line 126, in css
    raise NotSupported("Response content isn't text")