search

scrapinghub / portia

Visual scraping for Scrapy
BSD 3-Clause "New" or "Revised" License
9.3k stars 1.4k forks source link

Do not replace named html entities in urls #679

Closed ruairif closed 7 years ago

ruairif commented 7 years ago

For example if a url contains the following query string: ?title=a&prop=4&pound=gbp It would previously have been converted to: ?title=a∝=4£=gbp Now it will remain unchanged For a url like: ?title=a&amp;class=&lt;list&gt;&values=&quot;a&quot;,&quot;1&quot,&quot;b&quot It will be converted to: ?title=a&class=<list>&values="a","1","b"