bgarrels / crawler4j

Automatically exported from code.google.com/p/crawler4j
0 stars 0 forks source link

Illegal character in query #228

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago
What steps will reproduce the problem?
1. In Urls that contain illegal character like |
2. 
http://www.ciadasmochilas.com.br/ecommerce_site/index.php?cdg=2468&idcat=45930|3
9345&pg=lista_produtos
3.

Crawler4j dont't encode url before crawl? How can I fix that?

Original issue reported on code.google.com by adri...@indekse.com.br on 17 Jul 2013 at 6:13

GoogleCodeExporter commented 9 years ago

Original comment by avrah...@gmail.com on 18 Aug 2014 at 3:41