-
I use cralwlera plugin in my scrapy project, so i wonder did it support crawlera?
-
I just pull recent master - looks totally great and I really enjoy all those cool new features.
There is one thing that doens't work for me though. When I try to deploy to some specific target I get …
-
We need to add a deployment section to the documentation covering scrapyd-deploy.
-
ScrapyRT lets you provide url and a callback to crawl a single page. I think this feature should exist in scrapy itself in a form of new Spider class/modification
People usually comment out a test st…
-
Is there any way I can return back to scrapyrt from my spider with a custom HTTP code and message?
Let´s say I´m trying to login but have the wrong user and password. I check for the error text in xp…
busla updated
9 years ago
-
when i try to run scrapy using scrapyrt i am getting this error please help me
![error](https://cloud.githubusercontent.com/assets/11938531/7132128/15ec1cc4-e2a4-11e4-97d0-92ae5dad4598.png)
-
Looking at lsof output - there's only 2-3 tcp connections, 99% of the open files are for the per-spider logs.
When this happens scrapyrt stops responding to requests.
It happens about once a day und…
-
File "/usr/local/lib/python2.7/dist-packages/twisted/internet/defer.py", line 577, in _runCallbacks
current.result = callback(current.result, _args, *_kw)
File "/usr/local/lib/py…