hyphe_backend.lib missing

[bornakke]

Hi Medialab,

Running sudo bin/deploy_scrapy_spider.sh to install the latest edition of hypher gives me the following error:

Copying config.json from root directory to hyphe_backend/crawler for scrapy deployment... Traceback (most recent call last): File "deploy.py", line 18, in from hyphe_backend.lib import config_hci ImportError: No module named hyphe_backend.lib

It appears that a file most be missing.

Best regards Tobias

[boogheta]

Hello Tobias and thanks for the bug reports. First, you should not use sudo for this command, there is absolutely no reason you would need to be root to run this. Since you ran crawls according to your other tickets, I assume you figured out what the problem was. I imagine what was missing on your config was to run "add2virtualenv ." from hyphe's root directory which is now documented into the README. Do you confirm ?

[bornakke]

Hi Boogheta,

I reinstalled all python modules and ran without the sudo command and then it worked. It however only got me one step closer and I now got this response:

Copying config.json from root directory to hyphe_backend/crawler for scrapy deployment... Importing urllru.py library from HCI hyphe_backend/lib to hcicrawler... Rendering hcicrawler/middlewares.py with proxy config values from config.json... Rendering settings.py with mongo-scrapy config values from config.json... Rendering scrapy.cfg with scrapy config values from config.json... Sending HCI's scrapy egg to scrapyd server... {"status": "error", "message": "ImportError: No module named lru"}

Packing version 1371330679 Deploying to project "hci" in http://localhost:6800/addversion.json Server response (200):

Best Tobias

[boogheta]

This should be fixed now, just a stupid name change propagation forgotten, apologies :/