-
I have a kingfisher collect collecting the Paraguayan DNCP records using the [paraguay_dncp_records](https://github.com/open-contracting/kingfisher-collect/blob/master/kingfisher_scrapy/spiders/paragu…
-
I deployed two projects .One of projects is not display spider,else is normal.Why?
please help me. ths!
-
I noticed that if I visit the spider page, I see the following:
`Scrapyd
Available projects: ScrapydWeb_demo
Jobs
Items
Logs
Documentation
How to schedule a spider?
To schedule a spider yo…
-
Requirement is to capture the segmentation under the category finance.
Navigation should happen in the below way.
financials ---> Quarterly / Annual --> Standalone / Consolidated / Segment
…
-
Old title: Armenia download died after downloading 2316 files with a generic ["Connection error"] error.
Found during #100 work
The URL - https://armeps.am/ocds/release?limit=100&offset=15194005…
-
*Original issue title: Explore Item Exporters instead of bespoke system for writing items*
*Original issue description: I haven't had time to look at this closely, but on the surface it seems to do…
-
Im trying to eggify my spider project using
**scrapyd-deploy default** command but it says target machine has refused it. i have tried disabling the firewall but still says the same Error.
![Ca…
-
I'm considering using crawlera+scrapy+scrapydweb. I have setup my spider settings to have `CONCURRENT_REQUESTS = 100`
Now when i run jobs on scrapydweb, i am seeing that the CONCURRENT_REQUESTS th…
-
This is my config file :
[settings]
default = scrapy_app.settings
[deploy]
url = https://cscrapcraw.herokuapp.com/
project = scrapy_app
[scrapyd]
bind_address = 0.0.0.0
The error I am…
-
Hi Adriancast,
I had read your topic in medium. It's very helpful for me. I tried to use django rest with scrapyd to create an api to auto crawl.
My main idea is send url with token (for authentic…