mountainmoon / paoding

Automatically exported from code.google.com/p/paoding
0 stars 0 forks source link

请问,如何限定分词的长度?我发现有些超级长的分词,想滤掉 #60

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago
v8b-10jcatf22v10c-15pcatmega128-16auatmega128l-8au
 jcat27c256r-15jiat28c16-15piat28c17e-15piat28c256-
 jcat29c040a-12tuat29c040a-90tiat29c512-12pcat45db0
 jc44atf1502as-15jc44atf1504as-15ac100atf16v8b-10jc
 jc44atf1504as-15ac100atf16v8b-10jcatf22v10c-15pcat
 jcatf22v10c-15pcatmega128-16auatmega128l-8auatmega

呵呵,居然把这些词都分出来了,我想滤掉,想设定一个分��
�长度上线,可以吗?

Original issue reported on code.google.com by yuweimin...@gmail.com on 19 Apr 2010 at 3:35

GoogleCodeExporter commented 9 years ago
可以的。

按照reno.gan的计划,5.1左右可以发布。reno.gan可以考虑在配置�
��件中作一个最大长度设置?

Original comment by qieqie.wang on 20 Apr 2010 at 4:35

GoogleCodeExporter commented 9 years ago
好啊,期待期待

Original comment by yuweimin...@gmail.com on 21 Apr 2010 at 1:28

GoogleCodeExporter commented 9 years ago
请问可以限定分词长度的新版本release了没有?
如果遇到长分词,是截取分词,还是过滤掉呢?这里还有两��
�策略可选喔

Original comment by yuweimin...@gmail.com on 16 May 2010 at 3:46