search

amir-jakoby / crawler-commons

Automatically exported from code.google.com/p/crawler-commons
0 stars 0 forks source link

Do case-sensitive matching of paths #68

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago 
Based on the updated information at 
https://developers.google.com/webmasters/control-crawl-index/docs/robots_txt, 
Google says to do case-sensitive path matching.

Original issue reported on code.google.com by kkrugler...@transpac.com on 27 Mar 2015 at 10:08

GoogleCodeExporter commented 8 years ago 
Fixed with revision 165.

Original comment by kkrugler...@transpac.com on 27 Mar 2015 at 10:10