Update bot to filter certain words from message before predicting tokens

MLH-Fellowship / Auto-Tagger

To automatically tag people in various chat groups

Apache License 2.0

4 stars 3 forks source link

Update bot to filter certain words from message before predicting tokens #13

Closed pncnmnp closed 4 years ago

pncnmnp commented 4 years ago

To reduce false negatives of ML model by removing filter words like "Mr.", "Mrs.", "Dr.", "Mst.", "Madam", "Sir", "Dear". @CallmeMehdi can you review this.

CallmeMehdi commented 4 years ago

For now, this works most of the time but we need to pay attention to more of these " stop words ", merging this with dev branch