scrapinghub / frontera

A scalable frontier for web crawlers
BSD 3-Clause "New" or "Revised" License
1.29k stars 216 forks source link

NameError: Module 'frontera.contrib.backends.sqlalchemy' doesn't define any object named 'SQLAlchemyBackend' #339

Closed nmweizi closed 6 years ago

nmweizi commented 6 years ago

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/usr/lib64/python3.6/runpy.py", line 193, in _run_module_as_main "main", mod_spec) File "/usr/lib64/python3.6/runpy.py", line 85, in _run_code exec(code, run_globals) File "/usr/lib/python3.6/site-packages/frontera-0.8.0.post0.dev1-py3.6.egg/frontera/worker/db.py", line 246, in args.no_scoring, partitions=args.partitions) File "/usr/lib/python3.6/site-packages/frontera-0.8.0.post0.dev1-py3.6.egg/frontera/worker/stats.py", line 22, in init super(StatsExportMixin, self).init(settings, *args, kwargs) File "/usr/lib/python3.6/site-packages/frontera-0.8.0.post0.dev1-py3.6.egg/frontera/worker/db.py", line 102, in init self._manager = WorkerFrontierManager.from_settings(settings, db_worker=True) File "/usr/lib/python3.6/site-packages/frontera-0.8.0.post0.dev1-py3.6.egg/frontera/core/manager.py", line 691, in from_settings return WorkerFrontierManager(kwargs) File "/usr/lib/python3.6/site-packages/frontera-0.8.0.post0.dev1-py3.6.egg/frontera/core/manager.py", line 665, in init ComponentsPipelineMixin.init(self, backend, db_worker=db_worker, strategy_worker=strategy_worker) File "/usr/lib/python3.6/site-packages/frontera-0.8.0.post0.dev1-py3.6.egg/frontera/core/manager.py", line 87, in init BackendMixin.init(self, backend, db_worker, strategy_worker) File "/usr/lib/python3.6/site-packages/frontera-0.8.0.post0.dev1-py3.6.egg/frontera/core/manager.py", line 20, in init self._backend = self._load_backend(backend, db_worker, strategy_worker) File "/usr/lib/python3.6/site-packages/frontera-0.8.0.post0.dev1-py3.6.egg/frontera/core/manager.py", line 25, in _load_backend cls = load_object(backend) File "/usr/lib/python3.6/site-packages/frontera-0.8.0.post0.dev1-py3.6.egg/frontera/utils/misc.py", line 43, in load_object raise NameError("Module '%s' doesn't define any object named '%s'" % (module, name)) NameError: Module 'frontera.contrib.backends.sqlalchemy' doesn't define any object named 'SQLAlchemyBackend'

sibiryakov commented 6 years ago

Hi @nmweizi, yep general-spider example is outdated.

sibiryakov commented 6 years ago

fixed in 0.8.0.1