search

rominf / profanity-filter

A Python library for detecting and filtering profanity
GNU General Public License v3.0
159 stars 74 forks source link

Parallelize censoring #9

Open rominf opened 5 years ago

rominf commented 5 years ago

I think dask is a good solution because it has a nice API and can be used in a cluster.

The easiest and most effective parallelization is to map words after tokenization.

rominf commented 5 years ago

Blocked by #10.

rominf commented 5 years ago

Do it through REST web service (see #19).