Closed GaetanBaert closed 1 year ago
Hello,
When I try to load my KenLM model using the load_from_dir method on Windows, I got a
UnicodeDecodeError: 'charmap' codec can't decode byte 0x8f in position 1703: character maps to <undefined>
It seems that adding an encoding="utf8" parameter on line 376 of language_model.py solve this problem.
encoding="utf8"
Hello,
When I try to load my KenLM model using the load_from_dir method on Windows, I got a
UnicodeDecodeError: 'charmap' codec can't decode byte 0x8f in position 1703: character maps to <undefined>It seems that adding an
encoding="utf8"parameter on line 376 of language_model.py solve this problem.