issue in the process of tok

jflanigan / jamr

JAMR Parser and Generator

BSD 2-Clause "Simplified" License

193 stars 49 forks source link

issue in the process of tok #45

Open JinanZou opened 4 years ago

JinanZou commented 4 years ago

./tokenize-anything.sh < ~/Documents/ZeroShot/sen/AFP_ENG_20030417.0764 > out_file Invalid range "\x{0CE6}-\x{0BEF}" in transliteration operator at ./support/quote-norm.pl line 149 I met this issue, could you please give me the suggestion to solve it? cheers. @jflanigan

pkouris commented 4 years ago

You can try to delete the line 149 in quote-norm.pl file. It works for me.