-
I use the "scrapy crawl woaidu" command to run the crawler, but there are many errors, as below:
ligang.yao@localhost woaidu_crawler$scrapy crawl woaidu
ligang.yao@localhost woaidu_crawler$scrapy craw…
yuany updated
11 years ago
-
The following problem happens when running "scrapy deploy" on MAC:
```
DraixBook:ibcrest martin$ python2.6 $(which scrapy) deploy
Building egg of 51-1311257580
Traceback (most recent call last):
Fi…
-
I have python objects in my scraped item that do have accents in their unicode representation,
Through the debugger, I can see that the text fields containing UTF-8 accents are correctly ascii-encode…
-
I get this error everytime I exit the scrapy shell. I think it is most probably an ipython error but maybe scrapy is doing something strange with threads. This is only in IPython 0.12 the latest stabl…
-
I'm running a standard scrapy shell command and receiving the following response, which occurs after it has finished parsing and enters into the shell
scrapy shell http://doc.scrapy.org/_static/selec…
-
http://groups.google.com/group/scraperwiki/browse_thread/thread/d750d093ca5220bf
... was posted, wanting to use Mechanize to download HTML [since the data was behind a login] and Scrapely to parse it.…