Open luc-phan opened 8 years ago
See related https://github.com/scrapy/parsel/pull/54 which adds a parser_cls attribute to customize the parser. Note that scrapy/parsel favors speed (lxml) over browser-parsing compliance: html5lib is still much slower than lxml (as far as I know, I didn't check recently)
Given the same HTML code, here is what different parsers see :
This is very annoying to parse something when the parsing is different from a web browser parsing. It would be a good addition to provide a way to use something else than lxml.