search

sageone / spider

Automatically exported from code.google.com/p/spider
0 stars 0 forks source link

[BUG] Links from directdownload sites with rare characters #5

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago 
When spidering sites, the DD links appear with strange characters that affect 
the FILTER and the downloader program to work with them.
This makes necesary to revise the links files generated to avoid this strange 
characters.

Sample of bad link:
http://www.megaupload.com/?d^@^@^@^@^ [this is the way emacs show the strange 
chars]

Original issue reported on code.google.com by david.fr...@gmail.com on 6 Jul 2011 at 5:53