search

scrapinghub / frontera

A scalable frontier for web crawlers
BSD 3-Clause "New" or "Revised" License
1.29k stars 215 forks source link

Module 'frontera.contrib.backends.memory' doesn't define any object named 'FIFO' #376

Open Rockyzsu opened 5 years ago

Rockyzsu commented 5 years ago

Frist time to use frontera, after install frontera and option in https://frontera.readthedocs.io/en/latest/topics/installation.html#options

then run the example under requests/link_followers.py. But it come with error :

raise NameError("Module '%s' doesn't define any object named '%s'" % (module, name))

NameError: Module 'frontera.contrib.backends.memory' doesn't define any object named 'FIFO'

how to fix it or i am missing something ?

ghost commented 5 years ago

my best guess is the example was already outdated, https://github.com/scrapinghub/frontera/commit/1f1f4a14d02509091e308c422efc33f29f9e9bae

I think u should directly go to single mode for trying or testing.

Rockyzsu commented 5 years ago

thx @liho00 So link_followers.py is not the single mode ? This link https://frontera.readthedocs.io/en/latest/topics/quick-start-single.html is the real single mode with scrapy ?

Do you have the latest demo code ?

ghost commented 5 years ago

thx @liho00 So link_followers.py is not the single mode ? This link https://frontera.readthedocs.io/en/latest/topics/quick-start-single.html is the real single mode with scrapy ?

Do you have the latest demo code ?

nope, it just an example. you just follow the documentation will do. I have tried distributed mode, i have never try single mode before.