search

my8100 / scrapydweb

Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. DEMO :point_right:
https://github.com/my8100/files
GNU General Public License v3.0
3.14k stars 561 forks source link

how to specify python version and requirements.txt #87

Closed harrywang closed 5 years ago

harrywang commented 5 years ago

Thanks for working on this great project. I have followed your instructions to setup scrapyd and scrapydweb on heroku, but ran into issue that there are other package dependencies in my scrapy project such as sqlalchemy.

When I deploy to scrapinghub.com, I specify that in the scrapinghub.yml in my project as follows:

project: 404937

stacks:
    default: scrapy:1.7-py3
requirements:
  file: requirements.txt

How to do this for Scrapydweb?

Thanks a lot!

my8100 commented 5 years ago

Followed up in https://github.com/my8100/scrapyd-cluster-on-heroku/issues/6