-
Add integration tests with Github Actions.
This would setup the cluster, test all endpoints (incl. running the example spider #1 or a test spider returning static data, checking results).
This would …
-
Hi,
do you plan to build and publish a image based on python 3.10?
Both scrapy and scrapyd now support 3.10. Would be very appreciated!
-
Thought it did this but problems reported
Double check the ordering?
-
To get this going quickly for the first time, it would be useful to have an example spider with ready-to-run container images.
- [x] Create sample spider
- [x] Auto-build container images for samp…
-
88k errors on most recent collection: https://open-contracting-partnership.sentry.io/issues/2823958328/?project=6059006&query=is%3Aunresolved&referrer=issue-stream&stream_index=0
There's a local do…
-
配置完成后,修改了scrapy.cfg文档,并使用scrapyd-deploy demo命令,上传并布置好了爬虫。手动运行没问题,但在部署定时任务时,总是出现"Cannot pickle a ZoneInfo file from a file stream."提示,这是为什么?
-
Hi I'm really new to Argus.
Once the scraping ends I get an exception in Tinter callback and can't save the results. I ttach a screenshot of the issue.
Thanks
![Error Argus](https://user-images.g…
-
https://docs.scrapy.org/en/latest/topics/items.html
Once we deploy to Python >= 3.7.
-
I am having problems with getting the azure feed exporter plugin to work with scrapyd (https://github.com/scrapy-plugins/scrapy-feedexporter-azure-storage).
When I run this locally with scrapy it d…
-
A small change increases om `website.py` the clarity of the available projects (especially when there are many). I'm just wondering if there is additionally an option to list the project version on th…