WordMAP: Add Lemma Fallback

benjore commented 6 years ago

Story Explanation

As a [type of user], I want [some goal] so that [some reason].

da1nerd commented 5 years ago

There are two implementations of adding lemma to wordMAP

alignment memory will be indexed on both the word and the lemma. Then when calculating confidence we can determine if a prediction matches alignment memory by reading the index for the word an lemma keys.
then the statistical algorithms could be extended to use lemma by basically copy-pasting all the algorithms and changing the index lookup key to the lemma. With that we'd have double the algorithms with slightly different weighting when calculating the final confidence.

cckozie commented 5 years ago

Can't test until #5543 is fixed.

cckozie commented 5 years ago

Appears to work in 1.1.0 (4d06842) . Only did spot testing of a few cases.