creswick / chatter

A library of Natural Language Processing algorithms for Haskell.
Other
73 stars 24 forks source link

Tagging seems to use the first non-"other" tag seen #1

Closed creswick closed 11 years ago

creswick commented 11 years ago
*NLP.POS> tag (train "the/NN dog/NN jumped/VB") "the dog jumped"
[[("the",Class "NN"),("dog",Class "NN"),("jumped",Class "NN")]]

*NLP.POS> tag (train "the/DT dog/NN jumped/VB") "the dog jumped"
[[("the",Class "DT"),("dog",Class "DT"),("jumped",Class "DT")]]

*NLP.POS> tag (train "the/FOO dog/NN jumped/VB") "the dog jumped"
[[("the",Class "NN"),("dog",Class "NN"),("jumped",Class "NN")]]

Notice that the "FOO" tag is not used in the last example.

creswick commented 11 years ago

fixed in commit 1dab3937e2