scrapinghub / portia

Visual scraping for Scrapy
BSD 3-Clause "New" or "Revised" License
9.28k stars 1.41k forks source link

Tutorial to Install Portia on Debian #731

Closed sheedyaja closed 7 years ago

sheedyaja commented 7 years ago

I follow the documentation here http://portia.readthedocs.io/en/latest/installation.html#debian

Strange thing is sudo ./provision.sh install_deps

Since I need to clone the repo first

Any idea where is the exact documentation for installing portia on debian?

ruairif commented 7 years ago

You can try this. I don't guarantee it will work and if you run into issues you'll need to resolve them yourself.

    virtualenv YOUR_ENV_NAME --no-site-packages
    source YOUR_ENV_NAME/bin/activate
    cd YOU_ENV_NAME
    git clone https://github.com/scrapinghub/portia.git
    cd portia
    sudo ./provision.sh install_deps install_splash install_python_deps
    pip install -r /app/slybot/requirements.txt
    pip install -r /app/slyd/requirements.txt
    pip install -r /app/portia_server/requirements.txt
    pip install -e /app/slyd
    pip install -e /app/slybot
    cd portiaui
    npm install && bower install
    cd node_modules/ember-cli && npm install && cd ../../
    ember build
    cd ..
    export PYTHONPATH=$(pwd)/portia_server:$(pwd)/slybot:$(pwd)/slyd:"${PYTHONPATH}"
    ./slyd/bin/slyd -p 9002 -r ./portiaui/dist &
    ./app/portia_server/manage.py runserver

If you can't install using these instructions try using vagrant or docker