Better URLFollow title detection by guessing the encoding

StarlitGhost / PyMoronBot

All development moved to https://github.com/DesertBot/DesertBot - A modular IRC bot with extensive aliasing capabilities, written in Python.

MIT License

9 stars 0 forks source link

Closed ekimekim closed 7 years ago

ekimekim commented 7 years ago

BeautifulSoup seems to have issues with non-BMP UTF-8 when you pass it bytes. Since mostly everything is UTF-8, this is a good enough fix.

A real fix would be to correctly identify the encoding from the http headers, etc.

Fixes #140