deibit / cansina

Web Content Discovery Tool
GNU General Public License v3.0
888 stars 237 forks source link

Decode error using Cyrillic url using #30

Open Nekmo opened 6 years ago

Nekmo commented 6 years ago

Python 2.7.14 Cansina commit version: b9cc6d8dde444e1577a7af542c231cdab80eaa23

Error:

[!] General exception while visiting
'ascii' codec can't decode byte 0xd0 in position 7: ordinal not in range(128)

When using a url with non-ascii characters, multiple errors like this are returned.