-
While deploying javascript spiders i receive
2015-09-28 14:58:01+0530 [HTTPChannel,8,127.0.0.1] Unhandled Error
Traceback (most recent call last):
File "C:\Python27\lib\site-pac…
-
Hi,
I have an issue related to configuration: I need to be being able to configure a spider differently when running it in my development environment compared how it is configured when running it thr…
-
See the docs here: http://scrapyd.readthedocs.org/en/latest/api.html#daemonstatus-json
Happy for someone to take this on.
-
- I created spider for javascript url. And try to deploy and schedule in scrapyd using commands
- scrapyd-deploy your_scrapyd_target -p project_name
- curl http://your_scrapyd_host:6800/schedule.j…
-
We need to add a deployment section to the documentation covering scrapyd-deploy.
-
I encounter a problem when I use 'logs_filename' to config scrapyd.
Then I checked the code on github and found 'logs_filename' was added not so long ago.
I use pypi to install this wonderful tool, t…
-
HI
I have installed Hyphe release 0.2 on ubuntu 14.04. Everything is OK during the install, but when I run ./bin/hyphe start, server stops :
Starting Hyphe's Python core JsonRPC API...
...started...
…
-
```
settings = {'DOWNLOADER_MIDDLEWARES': {'project.middlewares.ProxyMiddleware': 700}}
scrapyd.schedule('project', 'bot', settings=settings)
```
produces such traceback in /var/log/scrapyd/scrapyd.l…
-
Hi
Is it working in windows or ubuntu?
after run the "vagrant up" command where and how build the portia?
-
Is this one of those settings that cannot be overridden per Spider instance? Is it finalized before instantiation?
```
class SiteSpider(CrawlSpider):
def __init__(self, **kw):
settings.s…
deanq updated
9 years ago