scrapy / scrapely

A pure-python HTML screen-scraping library
1.86k stars 315 forks source link

[MRG] scrapely.tool: add support for non-ascii <text> and <data> arguments #46

Closed kmike closed 10 years ago

kmike commented 10 years ago

I think that there are two separate issues in https://github.com/scrapy/scrapely/pull/45:

1) non-ascii input in scrapely.tool leads to UnicodeDecodeError; 2) non-ascii data is not readable when printed.

This PR addresses (1).