-
I am having problems with getting the azure feed exporter plugin to work with scrapyd (https://github.com/scrapy-plugins/scrapy-feedexporter-azure-storage).
When I run this locally with scrapy it d…
-
A small change increases om `website.py` the clarity of the available projects (especially when there are many). I'm just wondering if there is additionally an option to list the project version on th…
-
It would simplify a lot of things and make the harvest more reliable to use kubernetes as a scheduler instead of scrapyd. That seems possible from a quick investigation as long as scrapy is configured…
-
Setting `scrapyd` authentication is crucial for safety. Please add support.
希望能添加对 scrapyd 帐户密码验证的支持。
可以在 YAML 配置文件中增加字段 `SCRAPYD_USERNAME` `SCRAPYD_PASSWORD`,
然后在 `service/scrapyd_service.py` …
-
I have successfully installed and run scrapyd on Windows. However, when i try to deploy to scrapyd I have the following error:
```
Traceback (most recent call last):
File "C:\Users\myuser\AppDa…
-
I have some issue like service not work after restart VM when use wattlebird/scrapyd image.
So any stable image of scrapyd you use?
-
This library doesn't work with scrapy 2.5.0 and above.
If anyone also facing the same issue, downgrade it to `Scrapy==2.4.1`
-
-
Hi!
I'm having a problem with running spider in scrapyd. After egging a spider with a command
`scrapyd-deploy --build-egg gazeta.egg`
and trying to upload it through scrapydweb (or directly throug…
-
### Description
The value of the `TWISTED_REACTOR` setting is not taken into account if the setting is specified in a spider's `custom_settings` attribute.
It works well if the setting is specifie…