-
We want to able to schedule periodic jobs through `shub` (https://github.com/scrapinghub/shub/issues/220).
For that, we'll need to add this feature here as well.
Probably, it'll be something relat…
-
Hi,
I'm trying to deploy my spider that uses playwright (scrapy-playwright for integration). I have the following configuration:
**_scrapinghub.yml_**
```
requirements:
file: requirements.txt
…
-
Currently scrapinghub is listed as a channel in the `environment.yml` file. There is currently no way to specify this in the `environment.yml` file.
-
It would be nice to be able to configure periodic jobs via the `scrapinghub.yml` file.
Then, when user does `shub deploy`, it would sync the periodic jobs configuration from the file with the proje…
-
With new versions of lxml (I believe above 5.1.0), the extruct dependency breaks (see scrapinghub/extruct#215). Happy to submit a PR pinning the lxml version.
-
If `shub image push` without an explicit versioning in a non Git intialized directory, `shub` fails to find the previously built image because I believed that it used the wrong version as shown in the…
-
It seems that the version of scikit-learn v1.2.0 releases in Dec 2022 is breaking the `formasaurus init` command. See the following output:
```
Training form type detector on 1423 example(s)...
#…
-
Hit this when trying to run a spider against scrapinghub.com: sometimes it responds with `302 moved permanently to scrapinghub.com`. Scheduler agrees and tries to schedule another request for scraping…
-
After the project is deployed, the link to Run your Spider still points to app.scrapinghub.com, it was not a problem as it was being redirected to app.zyte.com, but it seems now we're having some issu…
-
Hi.
I have tried to search on google for the right commands for running scrapinghub and portia using docker, but can't find it. I have docker installed on my macOS Sierra and tried $ docker run -v "$…