search

ashokpant / dkpro-tc

Automatically exported from code.google.com/p/dkpro-tc
Other
0 stars 0 forks source link

NERSequenceDemo 0.6.0 version fails for 16 sentences #165

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 
NERSequenceDemo 0.6.0 version fails for 16 sentences from the Germeval NER 
training dataset (attached) with the following error (I set -Xmx4g on a machine 
with 8g RAM)

INFO: Per-token results for Testing
Exception in thread "main" 
de.tudarmstadt.ukp.dkpro.lab.engine.ExecutionException: 
de.tudarmstadt.ukp.dkpro.lab.engine.ExecutionException: 
de.tudarmstadt.ukp.dkpro.lab.engine.ExecutionException: 
java.lang.OutOfMemoryError: Java heap space
    at de.tudarmstadt.ukp.dkpro.lab.engine.impl.ExecutableTaskEngine.run(ExecutableTaskEngine.java:68)
    at de.tudarmstadt.ukp.dkpro.lab.engine.impl.DefaultTaskExecutionService.run(DefaultTaskExecutionService.java:48)
    at de.tudarmstadt.ukp.dkpro.lab.Lab.run(Lab.java:97)
    at de.tudarmstadt.ukp.dkpro.tc.examples.single.sequence.NERSequenceDemo.runCrossValidation(NERSequenceDemo.java:79)
    at de.tudarmstadt.ukp.dkpro.tc.examples.single.sequence.NERSequenceDemo.main(NERSequenceDemo.java:64)
Caused by: de.tudarmstadt.ukp.dkpro.lab.engine.ExecutionException: 
de.tudarmstadt.ukp.dkpro.lab.engine.ExecutionException: 
java.lang.OutOfMemoryError: Java heap space
    at de.tudarmstadt.ukp.dkpro.lab.engine.impl.ExecutableTaskEngine.run(ExecutableTaskEngine.java:68)
    at de.tudarmstadt.ukp.dkpro.lab.task.impl.BatchTask.runNewExecution(BatchTask.java:350)
    at de.tudarmstadt.ukp.dkpro.lab.task.impl.BatchTask.executeConfiguration(BatchTask.java:255)
    at de.tudarmstadt.ukp.dkpro.lab.task.impl.BatchTask.execute(BatchTask.java:185)
    at de.tudarmstadt.ukp.dkpro.tc.mallet.task.BatchTaskCrossValidation.execute(BatchTaskCrossValidation.java:226)
    at de.tudarmstadt.ukp.dkpro.lab.engine.impl.ExecutableTaskEngine.run(ExecutableTaskEngine.java:55)
    ... 4 more
Caused by: de.tudarmstadt.ukp.dkpro.lab.engine.ExecutionException: 
java.lang.OutOfMemoryError: Java heap space
    at de.tudarmstadt.ukp.dkpro.lab.engine.impl.ExecutableTaskEngine.run(ExecutableTaskEngine.java:68)
    at de.tudarmstadt.ukp.dkpro.lab.task.impl.BatchTask.runNewExecution(BatchTask.java:350)
    at de.tudarmstadt.ukp.dkpro.lab.task.impl.BatchTask.executeConfiguration(BatchTask.java:255)
    at de.tudarmstadt.ukp.dkpro.lab.task.impl.BatchTask.execute(BatchTask.java:185)
    at de.tudarmstadt.ukp.dkpro.tc.mallet.task.BatchTaskCrossValidation$1.execute(BatchTaskCrossValidation.java:159)
    at de.tudarmstadt.ukp.dkpro.lab.engine.impl.ExecutableTaskEngine.run(ExecutableTaskEngine.java:55)
    ... 9 more
Caused by: java.lang.OutOfMemoryError: Java heap space
    at cc.mallet.fst.MaxLatticeDefault$WeightCache.<init>(MaxLatticeDefault.java:132)
    at cc.mallet.fst.MaxLatticeDefault$WeightCache.<init>(MaxLatticeDefault.java:127)
    at cc.mallet.fst.MaxLatticeDefault.getCache(MaxLatticeDefault.java:148)
    at cc.mallet.fst.MaxLatticeDefault.access$100(MaxLatticeDefault.java:45)
    at cc.mallet.fst.MaxLatticeDefault$ViterbiNode$PreviousStateIterator.<init>(MaxLatticeDefault.java:87)
    at cc.mallet.fst.MaxLatticeDefault$ViterbiNode$PreviousStateIterator.<init>(MaxLatticeDefault.java:77)
    at cc.mallet.fst.MaxLatticeDefault$ViterbiNode.getNextStates(MaxLatticeDefault.java:123)
    at cc.mallet.util.search.SearchNode$NextNodeIterator.<init>(SearchNode.java:30)
    at cc.mallet.util.search.AStarNode$NextNodeIterator.<init>(AStarNode.java:17)
    at cc.mallet.util.search.AStarNode.getNextNodes(AStarNode.java:41)
    at cc.mallet.util.search.AStar.search(AStar.java:77)
    at cc.mallet.util.search.AStar.lookAhead(AStar.java:48)
    at cc.mallet.util.search.AStar.hasNext(AStar.java:53)
    at cc.mallet.fst.MaxLatticeDefault.bestViterbiNodeSequences(MaxLatticeDefault.java:317)
    at cc.mallet.fst.MaxLatticeDefault.bestOutputAlignments(MaxLatticeDefault.java:383)
    at cc.mallet.fst.MaxLatticeDefault.bestOutputSequence(MaxLatticeDefault.java:410)
    at cc.mallet.fst.Transducer.transduce(Transducer.java:124)
    at de.tudarmstadt.ukp.dkpro.tc.mallet.util.PerClassEvaluator.evaluateInstanceList(PerClassEvaluator.java:140)
    at de.tudarmstadt.ukp.dkpro.tc.mallet.util.TaskUtils.test(TaskUtils.java:132)
    at de.tudarmstadt.ukp.dkpro.tc.mallet.util.TaskUtils.runTestCRF(TaskUtils.java:167)
    at de.tudarmstadt.ukp.dkpro.tc.mallet.util.TaskUtils.runTrainTest(TaskUtils.java:181)
    at de.tudarmstadt.ukp.dkpro.tc.mallet.task.TestTask.execute(TestTask.java:96)
    at de.tudarmstadt.ukp.dkpro.lab.engine.impl.ExecutableTaskEngine.run(ExecutableTaskEngine.java:55)
    at de.tudarmstadt.ukp.dkpro.lab.task.impl.BatchTask.runNewExecution(BatchTask.java:350)
    at de.tudarmstadt.ukp.dkpro.lab.task.impl.BatchTask.executeConfiguration(BatchTask.java:255)
    at de.tudarmstadt.ukp.dkpro.lab.task.impl.BatchTask.execute(BatchTask.java:185)
    at de.tudarmstadt.ukp.dkpro.tc.mallet.task.BatchTaskCrossValidation$1.execute(BatchTaskCrossValidation.java:159)
    at de.tudarmstadt.ukp.dkpro.lab.engine.impl.ExecutableTaskEngine.run(ExecutableTaskEngine.java:55)
    at de.tudarmstadt.ukp.dkpro.lab.task.impl.BatchTask.runNewExecution(BatchTask.java:350)
    at de.tudarmstadt.ukp.dkpro.lab.task.impl.BatchTask.executeConfiguration(BatchTask.java:255)
    at de.tudarmstadt.ukp.dkpro.lab.task.impl.BatchTask.execute(BatchTask.java:185)
    at de.tudarmstadt.ukp.dkpro.tc.mallet.task.BatchTaskCrossValidation.execute(BatchTaskCrossValidation.java:226)

Original issue reported on code.google.com by eckle.kohler on 15 Jul 2014 at 9:42

Attachments:

GoogleCodeExporter commented 9 years ago 
This looks like a mallet problem. Not sure whether we can do much about it from 
within TC.

Original comment by torsten....@gmail.com on 15 Jul 2014 at 10:21

GoogleCodeExporter commented 9 years ago

Original comment by daxenber...@gmail.com on 29 Aug 2014 at 10:59

GoogleCodeExporter commented 9 years ago 
Some additional piece of information: The same problem happens for some 
sentences in the POS tagging example.

Original comment by torsten....@gmail.com on 8 Sep 2014 at 3:39

GoogleCodeExporter commented 9 years ago 
After switching to CRFSuite, this seems to work now.

Original comment by torsten....@gmail.com on 7 Nov 2014 at 8:59

GoogleCodeExporter commented 9 years ago

Original comment by daxenber...@gmail.com on 1 Apr 2015 at 5:10