ERROR: 1-gram discount out of range for adjusted count 3: -0.6738379. This means modified Kneser-Ney smoothing thinks something is weird about your data. To override this error for e.g. a class-based model, rerun with --discount_fallback

kpu / kenlm

KenLM: Faster and Smaller Language Model Queries

http://kheafield.com/code/kenlm/

Other

2.52k stars 511 forks source link

ERROR: 1-gram discount out of range for adjusted count 3: -0.6738379. This means modified Kneser-Ney smoothing thinks something is weird about your data. To override this error for e.g. a class-based model, rerun with --discount_fallback #415

Open Alex-Songs opened 1 year ago

Alex-Songs commented 1 year ago

ERROR: 1-gram discount out of range for adjusted count 3: -0.6738379. This means modified Kneser-Ney smoothing thinks something is weird about your data. To override this error for e.g. a class-based model, rerun with --discount_fallback