n-gram spam detection heuristic

jpcompartir / LimpiaR

Functions for pre-processing text data in Spanish and English

Other

2 stars 1 forks source link

Closed jpcompartir closed 2 years ago

jpcompartir commented 3 years ago

Add function for the n-gram spam detection heuristic workflow
add distinct version of ParseR count_ngram which excludes 'optional & non-optional', so that spam regex and text variable line up - some stop words and other things like punctuation are removed for better matching of patterns

jpcompartir commented 2 years ago

This will be taken care of outside of LimpiaR