Open ericlingit opened 2 years ago
When generating a prefix dictionary from dict.txt, duplicate entries are still added to the total variable ltotal.
dict.txt
ltotal
The term frequency for B超 3 n is added twice in gen_pfdict() method. As a result, the returned total is off by 3.
B超 3 n
gen_pfdict()
The sum of term frequency should be 60,101,964, but 60,101,967 is returned.
When generating a prefix dictionary from
dict.txt, duplicate entries are still added to the total variableltotal.The term frequency for
B超 3 nis added twice ingen_pfdict()method. As a result, the returned total is off by 3.The sum of term frequency should be 60,101,964, but 60,101,967 is returned.