Single quotes should be escaped as single quotes.

moses-smt / mosesdecoder

Moses, the machine translation system

http://www.statmt.org/moses

GNU Lesser General Public License v2.1

1.58k stars 778 forks source link

Single quotes should be escaped as single quotes. #215

Closed alvations closed 5 years ago

alvations commented 5 years ago

Somehow the normalization script was normalizing the non-ascii single quotes as double quotes. Maybe there was a reason behind this but it doesn't seem to be right, thus this PR.

Are there reasons why the single quotes would be normalized into double quotes?

C.f. https://github.com/alvations/sacremoses/issues/74

hieuhoang commented 5 years ago

cheers