分词的时候能否保留标点符号呢？

mangotv / ik-analyzer

Automatically exported from code.google.com/p/ik-analyzer

1 stars 0 forks source link

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago

比如说：
我爱你，你呢？
分割后保留，和？。

Original issue reported on code.google.com by chao08...@gmail.com on 21 Dec 2013 at 3:48