normalize urls to prevent multiple instances of urls from being crawled/recorded #18

Closed zhouwein closed 9 years ago