Can I dynamically add new ngrams/words into pretrained KenLM model?

kpu / kenlm

KenLM: Faster and Smaller Language Model Queries

http://kheafield.com/code/kenlm/

Other

2.46k stars 514 forks source link

Open naymaraq opened 1 year ago

naymaraq commented 1 year ago

I would like to dynamically add OOV words into pretrained KenLM model without retraining the model? Is it possible?

kpu commented 1 year ago

And what probability do you want them to have?

naymaraq commented 1 year ago

with a fixed high probability.