search

yuntians / paoding

Automatically exported from code.google.com/p/paoding
0 stars 0 forks source link

paoding分词器 词典大于30M 出现错误 #76

Open GoogleCodeExporter opened 8 years ago

GoogleCodeExporter commented 8 years ago 

出现的错误如下： 

在paoding maker里啦！ 
处理词典完毕！ 
compiler.readCompliedDictionaries(p); 
get knivf 完毕 
knives length:0 当前i=0 
net.paoding.analysis.exception.PaodingAnalysisException: 
        at net.paoding.analysis.knife.PaodingMaker.implMake(PaodingMaker.java:43 
2) 
        at net.paoding.analysis.knife.PaodingMaker.make(PaodingMaker.java:115) 
        at net.paoding.analysis.analyzer.PaodingAnalyzer.init(PaodingAnalyzer.ja 
va:73) 
        at net.paoding.analysis.analyzer.PaodingAnalyzer.<init>(PaodingAnalyzer. 
java:59) 
        at net.paoding.analysis.analyzer.estimate.TryPaodingAnalyzer.analysing(T 
ryPaodingAnalyzer.java:99) 
        at net.paoding.analysis.analyzer.estimate.TryPaodingAnalyzer.main(TryPao 
dingAnalyzer.java:73) 
Caused by: java.lang.StringIndexOutOfBoundsException: String index out of 
range: 
-1 
        at java.lang.String.substring(Unknown Source) 
        at net.paoding.analysis.dictionary.support.filewords.SimpleReadListener2 
.onWord(SimpleReadListener2.java:78) 
        at net.paoding.analysis.dictionary.support.filewords.FileWordsReader.rea 
dWords(FileWordsReader.java:120) 
        at net.paoding.analysis.dictionary.support.filewords.FileWordsReader.rea 
dWords(FileWordsReader.java:52) 
        at net.paoding.analysis.analyzer.impl.CompiledFileDictionaries.getDictio 
naryWords(CompiledFileDictionaries.java:287) 
        at net.paoding.analysis.analyzer.impl.CompiledFileDictionaries.getVocabu 
laryWords(CompiledFileDictionaries.java:298) 
        at net.paoding.analysis.analyzer.impl.CompiledFileDictionaries.getVocabu 
laryDictionary(CompiledFileDictionaries.java:183) 
        at net.paoding.analysis.knife.CJKKnife.setDictionaries(CJKKnife.java:48) 

        at net.paoding.analysis.knife.PaodingMaker.setDictionaries(PaodingMaker. 
java:532) 
        at net.paoding.analysis.knife.PaodingMaker.access$300(PaodingMaker.java: 
54) 
        at net.paoding.analysis.knife.PaodingMaker$1.run(PaodingMaker.java:406) 
        at net.paoding.analysis.knife.PaodingMaker.implMake(PaodingMaker.java:39 
1) 
        ... 5 more

Original issue reported on code.google.com by congliu...@gmail.com on 29 Sep 2010 at 7:32

GoogleCodeExporter commented 8 years ago 
有patch可以提交否？

Original comment by qieqie.wang on 29 Sep 2010 at 7:34

GoogleCodeExporter commented 8 years ago 
qieqie
patch是什么？

Original comment by congliu...@gmail.com on 7 Oct 2010 at 7:03

GoogleCodeExporter commented 8 years ago 
你来fix这个bug，没问题的话我就可以配置提交权限给您

Original comment by qieqie.wang on 8 Oct 2010 at 1:03

GoogleCodeExporter commented 8 years ago 
哎 我现在凑合用小点的词典了

为了混口饭吃，我平时没多少时间来fix

中国的开源，受制于程序员糊口问题

Original comment by congliu...@gmail.com on 6 Dec 2010 at 9:35