-
**Describe the bug**
启用异步的TWISTED_REACTOR时候,部署就会报错
**Traceback**
Traceback (most recent call last):
File "D:\anaconda\envs\scrapy\lib\site-packages\twisted\web\http.py", line 2369, in …
-
Hello, I created a portia spider and downloaded it as scrapy project. I run Windows 10 with docker and scrapyd is running it's service on port 6800 properly. However, when I schedule a spider to run,…
ghost updated
4 years ago
-
我是直接调用api来删除SpiderKeeper的项目的:
``` python
for i in range(2, 19):
project_delete_url = 'http://localhost:5000/project/{}/delete'.format(i)
r = session.get(project_delete_url, auth=('admin','…
-
http://lab.scrapyd.cn
网站打不开了。
-
In Project Manage page, only can add one project. If can add more than one project?
And, i know, scrapyd can add several scrapy project.
-
前一阵子发现定时任务有时候没有按计划来执行,仔细检查程序输出日志,发现报错如下:
```
2018-10-11 16:18:50,165 - SpiderKeeper.app - DEBUG - [sync_job_execution_status]
Job "sync_job_execution_status_job (trigger: interval[0:00:05], next ru…
-
**Describe the bug**
When using DATABASE_URL from heroku postgres options in scrapydweb, the app crashes because it mistakes the username at the start of the url as the database name when it should b…
-
i am able to run scrapy on server 127.0.0.1:6800 however when i tried to schedule the spider using
`curl http://localhost:6800/schedule.json -d project=default -d spider=toscrape-css`
i get this…
-
**Describe the bug**
A clear and concise description of what the bug is.
scrapyd与gerapy一运行,过一会服务器就会宕机,CPU和内存也都没有飙升,找不到原因,很莫名其妙。。
**To Reproduce**
Steps to reproduce the behavior:
1. Go to '..…
-
Possibly using this: http://supervisord.org/