Dascienz / phpBB-forum-scraper

Python-based web crawlers for scraping phpBB forum posts.
38 stars 18 forks source link

SyntaxError on line 10 #1

Closed mariobernheim closed 4 years ago

mariobernheim commented 5 years ago

After scrapy crawl phpBB the following occurs

Traceback (most recent call last):
  File "/usr/bin/scrapy", line 10, in <module>
    sys.exit(execute())
  File "/usr/lib64/python2.7/site-packages/scrapy/cmdline.py", line 145, in execute
    cmd.crawler_process = CrawlerProcess(settings)
  File "/usr/lib64/python2.7/site-packages/scrapy/crawler.py", line 267, in __init__
    super(CrawlerProcess, self).__init__(settings)
  File "/usr/lib64/python2.7/site-packages/scrapy/crawler.py", line 145, in __init__
    self.spider_loader = _get_spider_loader(settings)
  File "/usr/lib64/python2.7/site-packages/scrapy/crawler.py", line 347, in _get_spider_loader
    return loader_cls.from_settings(settings.frozencopy())
  File "/usr/lib64/python2.7/site-packages/scrapy/spiderloader.py", line 61, in from_settings
    return cls(settings)
  File "/usr/lib64/python2.7/site-packages/scrapy/spiderloader.py", line 25, in __init__
    self._load_all_spiders()
  File "/usr/lib64/python2.7/site-packages/scrapy/spiderloader.py", line 47, in _load_all_spiders
    for module in walk_modules(name):
  File "/usr/lib64/python2.7/site-packages/scrapy/utils/misc.py", line 73, in walk_modules
    submod = import_module(fullpath)
  File "/usr/lib64/python2.7/importlib/__init__.py", line 37, in import_module
    __import__(name)
  File "/root/phpBB-forum-scraper-master/phpBB_scraper/phpBB_scraper/spiders/phpBB.py", line 29
    yield scrapy.Request(response.urljoin(link),callback=self.parse_topics)
SyntaxError: 'return' with argument inside generator