-
Hi,
I store parsed data in database on remote machine and don't need to have items feed on same server as scrapyd. According to docs this can be done by setting "items_dir" to empty value, which does…
-
When I deploy a project with `version = GIT` and later schedule the job, scrapyd sometimes picks some older version of the project.
If I am correct, this is due to the fact, that `FilesystemEggStorag…
-
We have 7 servers with running scrapyd.
Repo clones to the first server and the deployed to another 6 servers.
---
Already on 'master'
From github.com:....
e51238d...82cb8 master -> origin/m…
-
Current repositories setup requires maintaining an apt repository per codename (precise, quantal, raring, saucy, trusty,...) and it bugs us on every new ubuntu release.
The true is that we build debi…
-
Previously reported by mrkschan on Trac http://dev.scrapy.org/ticket/313
I have a scrapy project that has several spiders in it. Those spiders are scheduled to execute on an hourly-basis.
The scrapy…
-
预计一天完成。
-
When multiple eggs are located in /var/lib/scrapyd/eggs//*.egg
I restart scrapyd service
Then I execute the command "scrapy deploy scrapyd -p project1 --version GIT" on the same folder level as setu…
-
with this pure html page
http://www.freetocharities.org.uk/zimconserve/
-
l
ghost updated
10 years ago
-
w3lib.form.encode_multipart has the following issues:
- there are no tests;
- it uses fixed boundary that can appear in uploaded data;
- it doesn't escape nor keys nor filenames so they can break the …
kmike updated
10 years ago