Upgrade preprocessing - Githubissues

minerva-ml / open-solution-toxic-comments

Open solution to the Toxic Comment Classification Challenge

https://www.kaggle.com/c/jigsaw-toxic-comment-classification-challenge

MIT License

154 stars 58 forks source link

Upgrade preprocessing #5

Closed jakubczakon closed 6 years ago

jakubczakon commented 6 years ago

added text preprocessing:

drop punctuation, newlines,
lower case all leters updated pipelines to new prepro