search

khorneflaeks / Minipedia

Taking the first paragraph of every English Wikipedia article and storing it in a 5 bit file.
https://minipedia.xyz
GNU General Public License v3.0
0 stars 0 forks source link

Ascii normalizer #1

Closed Webatron11 closed 2 years ago

Webatron11 commented 2 years ago

Turn accented characters into unaccented characters.

Webatron11 commented 2 years ago

https://stackoverflow.com/questions/517923/what-is-the-best-way-to-remove-accents-normalize-in-a-python-unicode-string

Webatron11 commented 2 years ago

This can actually take any non-ascii characters and turn them into ascii characters, thus this is renamed normalizer.

Webatron11 commented 2 years ago

Commit 04d76da has implemented this feature.