Is it possible to run a python script like in Scrapy Cloud?

my8100 / scrapydweb

Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. DEMO :point_right:

https://github.com/my8100/files

GNU General Public License v3.0

3.17k stars 565 forks source link

Is it possible to run a python script like in Scrapy Cloud? #52

Closed aysark closed 5 years ago

aysark commented 5 years ago

Not a bug, just a question. I want to run a python script (as a job), it seems it should be possible to do. You can do this in scrapinghub.

Thanks for the great package!

my8100 commented 5 years ago

I cannot find the entrance to run a python script on Scrapy Cloud. Could you post some screenshots?

aysark commented 5 years ago

Check: https://blog.scrapinghub.com/2016/09/28/how-to-run-python-scripts-in-scrapy-cloud

my8100 commented 5 years ago

ScrapydWeb can't support this feature as Scrapyd doesn't provide the API. The Email notice feature of scrapydweb would do a better job if you only want to monitor your spiders.