flashlight / text

Text utilities, including beam search decoding, tokenizing, and more, built for use in Flashlight.
MIT License
64 stars 14 forks source link

pip install textflight #52

Closed zjc6666 closed 1 year ago

zjc6666 commented 1 year ago

use the follow method to install flishlight-text git clone https://github.com/flashlight/text && cd text pip install .

But when I run "lm = KenLM(os.path.join(data_path, "lm.arpa"), word_dict)", The following error was reported

loading the LM will be faster if you build a binary file. Reading e2e_las_asr/data/target_domain_textdir/chn_beiqilangu_220110_text.3gram.lm ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100


Segmentation fault

jacobkahn commented 1 year ago

@zjc6666 — can you please share the .lm file you're using, as well as a full code sample?

jacobkahn commented 1 year ago

Closing due to inactivity.