algolia / docsearch-scraper

DocSearch - Scraper
https://docsearch.algolia.com/
Other
309 stars 107 forks source link

Cannot deploy the new configurations #270

Closed vvo closed 8 years ago

vvo commented 8 years ago

I was not able to deploy the new places configuration, can you provide guidance on how to do so?

The script I used (deployer/deploy) failed with:

Traceback (most recent call last):
  File "/tmp/docsearch_deploy/scraper/deployer/src/index.py", line 6, in <module>
    import fetchers
  File "/tmp/docsearch_deploy/scraper/deployer/src/fetchers.py", line 5, in <module>
    import helpers
  File "/tmp/docsearch_deploy/scraper/deployer/src/helpers.py", line 1, in <module>
    import requests
ImportError: No module named requests
maxiloc commented 8 years ago

Copy the deploy boilerplate which is in root directory put the credentials and run it

vvo commented 8 years ago

I already used the command @ElPicador gave me its providing all the needed keys etc but it's not working.

maxiloc commented 8 years ago

Ah where are you ?

maxiloc commented 8 years ago

Because if you're not at the office you will get block by cloudflare.

vvo commented 8 years ago

I am at the office but the error is linked to just python errors no?

maxiloc commented 8 years ago

What do you see ?

vvo commented 8 years ago
Traceback (most recent call last):
  File "/tmp/docsearch_deploy/scraper/deployer/src/index.py", line 6, in <module>
    import fetchers
  File "/tmp/docsearch_deploy/scraper/deployer/src/fetchers.py", line 5, in <module>
    import helpers
  File "/tmp/docsearch_deploy/scraper/deployer/src/helpers.py", line 1, in <module>
    import requests
ImportError: No module named requests
maxiloc commented 8 years ago

No sorry. Check the dependency on the readme

maxiloc commented 8 years ago

pip install requests

vvo commented 8 years ago

Will just wait for someone to deploy the new configuration I think, and create an index on some other appid in the meantime. Spent way too much already :D

maxiloc commented 8 years ago

pip install -r requirements.txt

maxiloc commented 8 years ago

And then launch it

vvo commented 8 years ago

will try

vvo commented 8 years ago

Managed to launch it. Had trouble because my default python version is 3 and the scripts are currently only compatible with python 2, pip 2 etc..