improve matching algorithm

[dwhieb]

The matching algorithm already looks at the MD > CW mappings to match entries. Improve this algorithm by using other factors as well:

• [ ] If the inflectional class of the query entry is known or can be guessed, match the entry with the same inflectional class (see #22).
• [ ] Otherwise, match the entry containing a definition that most closely matches the definition of the query entry, when both definitions are normalized (see #20 and #21).
• [ ] As a final fallback, match to the entry with the highest frequency. (Get this data from elsewhere and store it in the database.) (see #51)

Examples

Cree: Words

ayâw  VII-v  it is, it is there                                          /ay-/ + /-â/  ayâ-
ayâw  VTI-2  s/he has s.t., s/he owns s.t.                               /ay-/ + /-â/  ayâ-
ayâw  VAI-v  s/he is, s/he is there; s/he lives there, s/he stays there  /ay-/ + /-â/  ayâ-

Maskwacîs Dictionary

ayaw  He owns: he has.                                                 finance; have_wealth; own_possess
ayaw  He is here/there.  (Animate)  e.g. Ekota ki ayaw. He was there.  here_there; location

• The first entry is VTI-2, but we don’t know this from the entry.
• The second entry is VAI-v, but we don't know this from the entry.

[dwhieb]

R code for guessing at the inflectional class of an MD entry based on the definition:

# VTA:

MD$LC[intersect(grep("^\\<(([S]he)|([H]e)|([T]hey))\\>[^\\.]+\\<((him)|(her)|(them))\\>",MD$MeaningInEnglish), grep("Inanimate",MD$MeaningInEnglish, invert=T))] <- "VTA"

# VTI:

MD$LC[intersect(grep("^\\<(([S]he)|([H]e)|([T]hey))\\>[^\\.]+\\<((him)|(her)|(them))\\>",MD$MeaningInEnglish), grep("Inanimate",MD$MeaningInEnglish))] <- "VTI"

MD$LC[intersect(grep("^\\<(([S]he)|([H]e)|([T]hey))\\>[^\\.]+\\<((it)|(them))\\>",MD$MeaningInEnglish, value=F), which(is.na(MD$LC)))] <- "VTI"

# Fixing individual cases:
MD$LC[which(MD$MeaningInEnglish=="He cuts the legs off (a table) something inanimate.")] <- "VTI"
MD$LC[which(MD$MeaningInEnglish=="He holds the two together. Inanimate.")] <- "VTI"

# VAI:

# Reciprocals
MD$LC[intersect(grep("^\\<(([S]he)|([H]e)|([T]hey))\\>[^\\.]+\\<((himself)|(herself)|(themselves))\\>",MD$MeaningInEnglish, value=F), which(is.na(MD$LC)))] <- "VAI"

# Correction:
MD$LC[grep("^\\<(([S]he)|([H]e)|([T]hey))\\>[^\\.]+\\<((itself))\\>",MD$MeaningInEnglish, value=F)] <- "VAI"

MD$LC[intersect(grep("^\\<(([S]he)|([H]e)|([T]hey))\\>",MD$MeaningInEnglish, value=F), which(is.na(MD$LC)))] <- "VAI"

# VII:
MD$LC[intersect(intersect(grep("^\\<(([Ii]t)|([T]hey))\\>",MD$MeaningInEnglish, value=F), which(is.na(MD$LC))), grep("^v",MD$POS))] <- "VII"