dmlc / gluon-nlp

NLP made easy
https://nlp.gluon.ai/
Apache License 2.0
2.55k stars 538 forks source link

Merge clean_tok_para_corpus and clean_tok_mono_corpus #1490

Closed sxjscience closed 2 years ago

sxjscience commented 3 years ago

Description

We can merge these two files and create clean_tok_corpus.py.