could I use it in bert and how I should do the preprocessing for the data? are emoticons out of vocabulary? - Githubissues

SophonPlus / ChineseNlpCorpus

搜集、整理、发布中文自然语言处理语料/数据集，与有志之士共同促进中文自然语言处理的发展。

5.89k stars 1.4k forks source link

could I use it in bert and how I should do the preprocessing for the data? are emoticons out of vocabulary? #10

Open easywaytodo opened 5 years ago