中文停用词好像不过滤

gz-dedou / ik-analyzer

Automatically exported from code.google.com/p/ik-analyzer

0 stars 0 forks source link

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago

在stopword.dic加入中文停用词比如 的 但是分词结果还会出来 
的这个字

Original issue reported on code.google.com by yangz...@gmail.com on 27 Jul 2012 at 1:52

GoogleCodeExporter commented 8 years ago

英文的好像也不可以 停用词 和扩展词确实读入内存了 
但是没有起作用

Original comment by yangz...@gmail.com on 27 Jul 2012 at 7:20

GoogleCodeExporter commented 8 years ago

已找到原因 将词典文件保存为无bom的utf8文件即可

Original comment by yangz...@gmail.com on 27 Jul 2012 at 1:00

GoogleCodeExporter commented 8 years ago

Original comment by linliang...@gmail.com on 10 Aug 2012 at 1:41