Closed rinigus closed 6 years ago
Earlier version rejected ngrams with the given threshold. This PR updates Marisa ngram database generation scripts:
forgotten normalization of Marisa database counts is added for ngramtxt2marisa
threshold is used as a minimal allowed count
Earlier version rejected ngrams with the given threshold. This PR updates Marisa ngram database generation scripts:
forgotten normalization of Marisa database counts is added for ngramtxt2marisa
threshold is used as a minimal allowed count