"FATAL ERROR: id exceeds numerical limit in string-util.cpp : StringUtilUtf8"

neubig / kytea

The Kyoto Text Analysis Toolkit for word segmentation and pronunciation estimation, etc.

http://www.phontron.com/kytea

Other

202 stars 25 forks source link

"FATAL ERROR: id exceeds numerical limit in string-util.cpp : StringUtilUtf8" #41

Open zzzwan opened 2 years ago

zzzwan commented 2 years ago

Hello, while using kytea library with a long string, we hit the above error when calling mapString. Is there a way to workaround this issue?

zzzwan commented 2 years ago

Way to reproduce: In /api/api-example.cc, replace the content in KyteaString surface_string = util->mapString() with our string and run. I could share this string file if you need