wikit-ai / olaf

6 stars 1 forks source link

fix C-value filter out terms with one token #62

Closed ba-talibe closed 5 months ago

ba-talibe commented 5 months ago

Terms with one token have a C-value of zero because the formula multiply all the rest by a log of the number of tokens in the term. (log(1) = 0).