search

habeanf / yap

Yet Another (natural language) Parser
Apache License 2.0
43 stars 33 forks source link

Single sentence file may not process successfully #5

Closed matanox closed 6 years ago

matanox commented 6 years ago

Somewhere between a question and an issue ― If an input file (input.raw) contains only a single sentence, e.g.:

עשרות
אנשים
מגיעים
מתאילנד

Then no tokens seem to go detected and the output file is empty, when running:

./yap hebma -raw input.raw -out lattices.conll

In further experimentation it may seem like the first sentence may get ignored, or some other irregularity causing this. Thing is this is the classical scenario for trying a single sentence, unless there's also an interactive mode aside requiring file input.

Thanks in advance for your commenting!

matanox commented 6 years ago

BTW the demo at http://onlp.openu.org.il might seem to be down...

habeanf commented 6 years ago

You need to add an empty line after the last word. There should be two newlines at the end of a sentence. Regarding onlp.openu.org.il, you should discuss with @rtsarfaty or @aseker00

matanox commented 6 years ago

Doh, it was https://github.com/atom/atom/issues/3969 Must have been really late at night...

matanox commented 6 years ago

Will do.