-
```
vagrant@vagrant-ubuntu-trusty-64:/vagrant$ make test
scripts/runtests.py
nosetests manoseimas --match ^[Tt]est --verbosity=2 --nocapture --nologcapture --all-modules --with-doctest --doctest-tests…
-
S3DownloadHandler tries to connect to s3 on startup, with 1s timeout. This can be seen in Scrapy logs - note 1s delay between "Enabled extensions" and "Enabled downloader middlewares" messages:
```
2…
kmike updated
8 years ago
-
-
I think an article or a brief section in the github readme file explaing the differences from scrapy would be great and attractive.
-
Hello,
Excellent work, but that does not seem to work with HTTP to HTTPS redirection, for example:
http://github.com/fabienvauchelles/scrapoxy
HTTP :
```
$ curl -i --proxy http://127.0.0.1:8888 ht…
-
Everything needs to move to a plugin based system, similar to how Scrapy operates with its middleware components. It should be called something distinct (like plugins) so as to not be confused with Sc…
-
We need to add a deployment section to the documentation covering scrapyd-deploy.
-
I do packaging @ gentoo and I am quite confused / unclear on setting the dependencies for this package given the content of setup.py and tox.ini
First; python implementations supported.
From setup.py…
-
The scrapy is the framework for the scraping
The link is http://scrapy.org/
-
# Scraper error
Scraper appears to be killed immediately after requirement installation, with the message:
> /start: line 24: 21 Killed setuidgid scraper $(eval echo ${command})
…