scrapy / scurl

Performance-focused replacement for Python urllib
Apache License 2.0
21 stars 6 forks source link

GURL idna encoding #25

Open malloxpb opened 6 years ago

malloxpb commented 6 years ago

Right now GURL could not handle such idna urls. All of the idna urls are marked as invalid. Although Google Chrome does parse these urls correctly!

>>> URL('банки.рф'.encode('idna')).is_valid()
False