search

john-hu / untitled

0 stars 0 forks source link

Tasty peeler error #101

Closed john-hu closed 2 years ago

john-hu commented 2 years ago 
  File "/home/pi/git/untitled/env/lib/python3.7/site-packages/scrapy/core/spidermw.py", line 56, in _evaluate_iterable
    for r in iterable:
  File "/home/pi/git/untitled/env/lib/python3.7/site-packages/scrapy/spidermiddlewares/referer.py", line 342, in <genexpr>
    return (_set_referer(r) for r in result or ())
  File "/home/pi/git/untitled/env/lib/python3.7/site-packages/scrapy/core/spidermw.py", line 56, in _evaluate_iterable
    for r in iterable:
  File "/home/pi/git/untitled/env/lib/python3.7/site-packages/scrapy/spidermiddlewares/urllength.py", line 40, in <genexpr>
    return (r for r in result or () if _filter(r))
  File "/home/pi/git/untitled/env/lib/python3.7/site-packages/scrapy/core/spidermw.py", line 56, in _evaluate_iterable
    for r in iterable:
  File "/home/pi/git/untitled/env/lib/python3.7/site-packages/scrapy/spidermiddlewares/depth.py", line 58, in <genexpr>
    return (r for r in result or () if _filter(r))
  File "/home/pi/git/untitled/env/lib/python3.7/site-packages/scrapy/core/spidermw.py", line 56, in _evaluate_iterable
    for r in iterable:
  File "/home/pi/git/untitled/peeler/scrapy_utils/spiders/base.py", line 82, in parse
    raise ex
  File "/home/pi/git/untitled/peeler/scrapy_utils/spiders/base.py", line 69, in parse
    item = self.parse_response(response)
  File "/home/pi/git/untitled/peeler/tasty/spiders/recipe_result.py", line 34, in parse_response
    categories=recipe.get('recipeCategory', None),
AttributeError: 'NoneType' object has no attribute 'get'
2021-12-27 10:58:30 [peeler.scrapy_utils.spiders.base] ERROR: Parse url, https://tasty.co/recipe/crema-crepes-4-ways,  30 / 33, error: AttributeError("'NoneType' object has no attribute 'get'")
2021-12-27 10:58:30 [scrapy.core.scraper] ERROR: Spider error processing <GET https://tasty.co/recipe/crema-crepes-4-ways> (referer: None)