search

scrapinghub / shub

Scrapinghub Command Line Client
https://shub.readthedocs.io/
BSD 3-Clause "New" or "Revised" License
125 stars 79 forks source link

Allow scheduling custom scripts #160

Closed jdemaeyer closed 5 years ago

jdemaeyer commented 8 years ago

http://doc.scrapinghub.com/scrapy-cloud.html#running-custom-python-scripts

eliasdorneles commented 8 years ago

This would be lovely! :) We've been using a custom script in an internal project for this.

vshlapakov commented 5 years ago

The issue is quite old: scheduling custom scripts is supported for a long time, the only difference is to add py: prefix to the name of the script and provide it as a spider name on scheduling, like shub schedule py:testargs.py, it described well here with exampes.

andrewbaxter commented 5 years ago

Sorry to dredge up a closed issue :)

Is this something that could go in the documentation? I read through that QA but there wasn't a shub example and it's not clear how to translate the command arguments into shub arguments. I tried -a just in case but the job started with no arguments.