search

theanti9 / PyCrawler

A python web crawler
212 stars 104 forks source link

Keywords #10

Open ghost opened 12 years ago

ghost commented 12 years ago

when the crawler craw until gives an UnicodeDecodeError the script crawled few sites however when i check database for the keywords, there is lots of empty entries and max 1 keyword.

i will also look into this

theanti9 commented 12 years ago

This is not a very helpful description. Could you add some examples?