gchrupala / morfette

Supervised learning of morphology
BSD 2-Clause "Simplified" License
28 stars 5 forks source link

morfete in eval shouldn't rely on accessing the training file #5

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago
What steps will reproduce the problem?

if one has no access to the training set,  morfette eval will cause an error 
(morfette: 
GramLab/Morfette/Utils.hs:(299,0)-(327,44): Non-exhaustive patterns in function 
eval)

workaround :  use /dev/null instead of nothing

was morfette eval --ignore-case TRAIN test gold 
if one has no TRAIN run
morfette  eval --ignore-case /dev/null test gold

Original issue reported on code.google.com by djame.seddah@gmail.com on 1 Feb 2010 at 4:36

GoogleCodeExporter commented 9 years ago
Hmm, are there many cases when people have no training data, but do have gold
standard test data? For those few cases maybe the workaround is fine.

Original comment by pitekus on 1 Feb 2010 at 3:53

GoogleCodeExporter commented 9 years ago

Original comment by pitekus on 1 Feb 2010 at 3:53

GoogleCodeExporter commented 9 years ago
Just to add something about the lack of training data : 
I've created a very small gold standard for out of domain tagging. So people 
can try to tag with morfette, and 
eventually create some scripts to correct obvious mistakes. So when they 
evaluate agains my simili gold, they 
don't have the training data (real case, that happenned just today)

Original comment by djame.seddah@gmail.com on 1 Feb 2010 at 5:50