see what you think. working for me (based on trigrams) but code could be tidied up somewhat.
@dhowe Note: RiTa.stripPunctuation does not play entirely nice with the punctuation we use and in relation to trigram and bigram look-ups. I had to adjust the coding for tri- and bigram counts to deal with this.
Question: does RiTa.trimPunctuation only strip off one character layer? i.e.
"here?'" --> "here?" rather than --> "here"
If not, then RiTa.trimPunctuation (and stripPunctuation?) may not be handling "?" correctly.
see what you think. working for me (based on trigrams) but code could be tidied up somewhat.
@dhowe Note: RiTa.stripPunctuation does not play entirely nice with the punctuation we use and in relation to trigram and bigram look-ups. I had to adjust the coding for tri- and bigram counts to deal with this.
Question: does RiTa.trimPunctuation only strip off one character layer? i.e.
"here?'"-->"here?"rather than -->"here"If not, then RiTa.trimPunctuation (and stripPunctuation?) may not be handling "?" correctly.