diff acts weird when non-ascii characters

apertium / apertium-regtest

Regression testing system for Apertium language data and translators

https://wiki.apertium.org/wiki/Apertium-regtest

GNU General Public License v3.0

1 stars 0 forks source link

diff acts weird when non-ascii characters #25

Open jonorthwash opened 1 year ago

jonorthwash commented 1 year ago

In a bunch of different words with æ, we get all the characters before æ diffed, and not æ or any of the characters after æ diffed. E.g., (with parts in red bolded and parts in green in italics):

xyXyæhargle
xyzXyzæbargle
xyzaXyzaæfoo

(Note that this issue was encountered while fiddling with modes and we hadn't added back the -g switch, which is why the capitalisation is what's different. That issue is resolved and we are no longer getting these diffs)

jonorthwash commented 1 year ago

Encountered this issue together with @Zachary-Kelly.