tallforasmurf / PPQT

A post-processing tool for PGDP written in Python, PyQt4, and Qt
GNU General Public License v3.0
4 stars 2 forks source link

curly apostrophe should be treated same as straight #175

Closed tallforasmurf closed 10 years ago

tallforasmurf commented 10 years ago

In collecting word-tokens, pqEdit keeps possessives together e.g. "it's" but does not do the same with unicode curly apostrophe U2019 (http://en.wikipedia.org/wiki/Apostrophe#Unicode). It should do that for U2019, but definitely not for the other similar forms (see link) nor for acute or grave accents. All those should lead to split words which would make the error visible.